-- Logs begin at Tue 2022-09-27 15:41:40 UTC, end at Tue 2022-09-27 16:57:50 UTC. -- Sep 27 16:15:37.275165 dv-cinder-855060-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 27 16:15:37.285512 dv-cinder-855060-2-smb devstack@keystone.service[81617]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 27 16:15:37.287577 dv-cinder-855060-2-smb devstack@keystone.service[81617]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 27 16:15:37 2022] *** Sep 27 16:15:37.287577 dv-cinder-855060-2-smb devstack@keystone.service[81617]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 27 16:15:37.287577 dv-cinder-855060-2-smb devstack@keystone.service[81617]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 27 16:15:37.287577 dv-cinder-855060-2-smb devstack@keystone.service[81617]: nodename: dv-cinder-855060-2-smb Sep 27 16:15:37.287577 dv-cinder-855060-2-smb devstack@keystone.service[81617]: machine: x86_64 Sep 27 16:15:37.287577 dv-cinder-855060-2-smb devstack@keystone.service[81617]: clock source: unix Sep 27 16:15:37.287577 dv-cinder-855060-2-smb devstack@keystone.service[81617]: pcre jit disabled Sep 27 16:15:37.287577 dv-cinder-855060-2-smb devstack@keystone.service[81617]: detected number of CPU cores: 4 Sep 27 16:15:37.287577 dv-cinder-855060-2-smb devstack@keystone.service[81617]: current working directory: / Sep 27 16:15:37.287577 dv-cinder-855060-2-smb devstack@keystone.service[81617]: detected binary path: /usr/bin/uwsgi-core Sep 27 16:15:37.287577 dv-cinder-855060-2-smb devstack@keystone.service[81617]: your processes number limit is 47680 Sep 27 16:15:37.288223 dv-cinder-855060-2-smb devstack@keystone.service[81617]: your memory page size is 4096 bytes Sep 27 16:15:37.288223 dv-cinder-855060-2-smb devstack@keystone.service[81617]: detected max file descriptor number: 2048 Sep 27 16:15:37.288223 dv-cinder-855060-2-smb devstack@keystone.service[81617]: lock engine: pthread robust mutexes Sep 27 16:15:37.288223 dv-cinder-855060-2-smb devstack@keystone.service[81617]: thunder lock: enabled Sep 27 16:15:37.288223 dv-cinder-855060-2-smb devstack@keystone.service[81617]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 27 16:15:37.288223 dv-cinder-855060-2-smb devstack@keystone.service[81617]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 27 16:15:37.327714 dv-cinder-855060-2-smb devstack@keystone.service[81617]: Python main interpreter initialized at 0x562ad067b9c0 Sep 27 16:15:37.327714 dv-cinder-855060-2-smb devstack@keystone.service[81617]: python threads support enabled Sep 27 16:15:37.327714 dv-cinder-855060-2-smb devstack@keystone.service[81617]: your server socket listen backlog is limited to 100 connections Sep 27 16:15:37.327714 dv-cinder-855060-2-smb devstack@keystone.service[81617]: your mercy for graceful operations on workers is 90 seconds Sep 27 16:15:37.328096 dv-cinder-855060-2-smb devstack@keystone.service[81617]: mapped 403077 bytes (393 KB) for 2 cores Sep 27 16:15:37.328176 dv-cinder-855060-2-smb devstack@keystone.service[81617]: *** Operational MODE: preforking *** Sep 27 16:15:37.328406 dv-cinder-855060-2-smb devstack@keystone.service[81617]: *** uWSGI is running in multiple interpreter mode *** Sep 27 16:15:37.328406 dv-cinder-855060-2-smb devstack@keystone.service[81617]: spawned uWSGI master process (pid: 81617) Sep 27 16:15:37.328612 dv-cinder-855060-2-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 27 16:15:37.329751 dv-cinder-855060-2-smb devstack@keystone.service[81617]: spawned uWSGI worker 1 (pid: 81630, cores: 1) Sep 27 16:15:37.329751 dv-cinder-855060-2-smb devstack@keystone.service[81617]: spawned uWSGI worker 2 (pid: 81631, cores: 1) Sep 27 16:15:37.329751 dv-cinder-855060-2-smb devstack@keystone.service[81617]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 27 16:15:41.683486 dv-cinder-855060-2-smb devstack@keystone.service[81630]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 16:15:41.683486 dv-cinder-855060-2-smb devstack@keystone.service[81630]: from cryptography.utils import int_from_bytes Sep 27 16:15:41.684353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 16:15:41.684353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: from cryptography.utils import int_from_bytes Sep 27 16:15:41.687020 dv-cinder-855060-2-smb devstack@keystone.service[81631]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 16:15:41.687020 dv-cinder-855060-2-smb devstack@keystone.service[81631]: from cryptography.utils import int_from_bytes Sep 27 16:15:41.687982 dv-cinder-855060-2-smb devstack@keystone.service[81631]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 16:15:41.687982 dv-cinder-855060-2-smb devstack@keystone.service[81631]: from cryptography.utils import int_from_bytes Sep 27 16:15:41.735128 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 16:15:41.735310 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 16:15:41.735501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] command line args: [] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 16:15:41.735772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 16:15:41.735952 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ================================================================================ {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 16:15:41.736210 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] admin_token = **** {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.736482 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] config_dir = [] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.736673 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.736855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] config_source = [] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.737138 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] debug = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.737275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.738457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.738457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.738457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.738457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.738841 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] list_limit = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.738914 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 16:15:41.738998 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] log_config_append = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.739076 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 16:15:41.739155 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.739269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] command line args: [] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 16:15:41.739353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] log_dir = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.739353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] log_file = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.739493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 16:15:41.739493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ================================================================================ {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 16:15:41.739633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.739710 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] admin_token = **** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.739793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.739898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] config_dir = [] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.739985 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.740090 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.740205 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.740292 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] config_source = [] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.740382 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.742222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] debug = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.742344 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.742432 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.742577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.742649 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.742729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.742809 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.742929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.743004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.743126 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.743203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.743330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.743413 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] list_limit = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.743491 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.743563 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] log_config_append = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.743639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.743715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.743715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] log_dir = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.743858 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.743933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] log_file = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.744013 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.744085 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.744085 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.744218 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.744291 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.744405 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] publish_errors = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.744488 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.744570 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.744643 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.744643 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.744782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.744782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.744936 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.745064 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.745146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.745224 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.745296 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.745366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] standard_threads = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.745446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.745519 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.745589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.745665 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.745736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.745806 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.745928 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.746002 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] use_journal = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.746002 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] use_json = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.746200 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.746278 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] use_stderr = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.746357 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.746431 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] use_syslog = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.746431 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.746564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.746636 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.746714 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] publish_errors = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.746793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.746865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.746941 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.747013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.747095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.747171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.747242 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.747312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.747467 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.747546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.747717 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.747796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] standard_threads = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.747956 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.748067 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.748202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.748325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.748508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.748590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.748696 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] use_journal = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.748775 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.748876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] use_json = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.748953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.749054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] use_stderr = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.749171 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.749256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] use_syslog = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.749409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.749495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:15:41.749657 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.749794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.750421 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.750543 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.750663 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.750778 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.750900 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.751016 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.751150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.751276 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.751397 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.751513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.751635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.751750 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.751870 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.751985 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.752104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.752234 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.752391 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.752514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.752629 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.752742 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.752861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.752976 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.753101 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.753221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.753338 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.753451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.753570 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.753685 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.753810 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.753932 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.754048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.754161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.754274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.754388 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.754577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.754700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.754815 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.754935 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.755055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.755205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.755344 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.755461 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.755574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.755694 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.755814 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.755929 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.756051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.756166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.756280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.756423 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.756540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.756663 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.756789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.756911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.757032 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.757147 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.757260 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.757372 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.757501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.757618 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.757738 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.757853 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.757966 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.758084 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.758209 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.758325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.758439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.758560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.758706 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.758819 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.758917 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.759012 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.759107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.759203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.759299 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.759451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.759568 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.759669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.759774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.759899 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.760014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.760132 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.760256 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.760437 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.760558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.760676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.760797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.760913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.761029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.761152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.761268 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.761382 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.761493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.761608 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.761732 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.761854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.761979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.762102 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.762218 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.762333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.762447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.762569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.762682 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.762798 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.762912 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.763016 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.763134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.763259 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.763375 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.763500 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.763733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.763858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.763974 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.764100 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.764100 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.764318 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.764318 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.764552 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.764667 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.764793 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.764793 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.765023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.765138 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.765301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.765301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.765526 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.765526 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.766352 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.766467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.766582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.766696 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.766886 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.767006 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.767120 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.767120 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.767340 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.767456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.767586 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.767704 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.767819 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.767934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.768048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.768162 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.768290 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.768479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.768597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.768712 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.768826 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.768947 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.769065 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.769191 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.769308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.769423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.769538 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.769642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.769761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.769886 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.770003 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.770110 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.770207 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.770304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.770400 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.770503 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.770602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.770698 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.770795 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.770951 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.771077 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.771204 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.771320 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.771435 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.771550 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.771665 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.771786 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.771911 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.772029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.772145 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.772260 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.772387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.772503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.772632 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.772749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.772871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.772987 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.773101 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] auth.external = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.773217 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.773339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.773456 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.773577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.773694 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.773809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.773929 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.773929 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.774157 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] auth.password = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.774280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.774397 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] auth.token = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.774511 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.774653 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.774794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.774918 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.775043 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.775161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.775161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.775416 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.775540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.775658 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.775782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.775899 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.776014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.776139 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.776257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] credential.caching = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.776420 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.776552 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.776688 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] auth.external = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.776845 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.776971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.777090 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.777206 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.777332 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.777455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.777455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] auth.password = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.777673 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.777794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] auth.token = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.777911 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.778043 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.778161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.778277 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.778397 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.778515 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.778640 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.778757 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.778873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.778988 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.779103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.779217 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.779343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.779461 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.779576 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.779691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] credential.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.779805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.779920 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.780047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.780165 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.780280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] federation.caching = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.780922 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.781060 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.781173 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.781354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.781456 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.781554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.781652 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.781749 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.781847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.781953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.782054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.782152 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.782248 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.782345 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.782442 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.782551 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.782652 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.782758 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.782856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.782953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.783051 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.783162 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.783263 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.783366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] identity.caching = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.783467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.783571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.783671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] federation.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.783776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.783884 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.783984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.784088 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.784186 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.784283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.784442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.784553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.784651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.784756 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.784855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.784959 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.785065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.785165 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.785262 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.785413 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.785520 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.785617 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.785723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.785830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.785928 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.786024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.786121 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.786224 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.786330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.786429 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.786526 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.786623 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.786730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.786828 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.786934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.787039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.787137 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.787234 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.787330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.787446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.787553 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.787651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.787748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.787844 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.787948 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.788056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.788156 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.788259 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.788432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.788558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.788675 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.788806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.788927 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.789044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.789161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.789278 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.789394 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.789518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.789635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.789751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.789867 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.789983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.790098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.790222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.790346 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.790463 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.790579 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.790693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.790808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.790932 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.791051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.791167 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.791292 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.791409 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.791525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.791649 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.791776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.791904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.792019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.792136 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.792251 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.792394 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.792507 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.792605 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.792605 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.792786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.792882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.792989 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.793089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.793187 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.793187 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.793368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.793720 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.793827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.793926 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.794023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.794120 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.794218 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.794314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.794418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.794518 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.794615 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.794752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.user = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.794859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.794994 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.795109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.795234 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.795338 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.795487 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.795599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.795697 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.795842 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.795949 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.796098 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.796204 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.796386 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.796497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.796608 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.796709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.796865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.796971 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.797606 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.797737 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.797856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.797972 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.798087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.798202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.798318 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.798443 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.798562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.798677 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.798793 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.798907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.799022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.799145 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.799264 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.799380 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.799495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.799610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.799724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.799848 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.799965 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.800080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.800202 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.800320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.800461 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.800592 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.800710 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.800825 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.800941 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.801056 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.801171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.801294 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.801412 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.801529 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.801644 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.801758 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.801874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.801997 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.802115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.802230 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.802345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.802460 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.802585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.802703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.802819 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.802933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.803048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.803163 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.803361 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.803481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.803611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.803883 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.803997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.804113 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.804113 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] resource.caching = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.804388 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.804508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.804625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.804742 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.804858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.804987 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.805106 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.805222 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.805338 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.805453 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.805605 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.805732 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.805851 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.805967 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.806082 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.806198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.806313 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.806438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.806556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.806672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] role.caching = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.806788 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.806902 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] role.driver = sql {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.807017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.807141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.807258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.807374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.807494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.807610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.807726 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] resource.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.807852 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.807969 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.808085 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.808201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.808316 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.808449 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.808577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.808696 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.808811 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.808928 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.809043 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.809158 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.809281 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.809399 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.809514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.809629 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.809728 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.809825 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.809931 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.810032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] role.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.810129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.810226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] role.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.810226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.810406 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.810512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.810612 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.810709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.810807 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.810904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.811001 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.811106 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.811206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.811303 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.811401 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.811498 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.811603 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.811744 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.811849 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.811953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.812053 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.812151 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.812257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.812374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.812979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.813078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.817053 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.817169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.817311 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.817405 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.817481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.817481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.817622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.817695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.817777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.817853 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.817926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.818004 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.818078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.818151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.818232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.818314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] token.caching = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.818389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.818462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.818535 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.818608 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.818688 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.818764 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.818836 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.818909 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.818982 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.819054 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.819135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.819210 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.819283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.819361 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.819435 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.819507 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.819587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.819663 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.819736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.819808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.819880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.819953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.820033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.820109 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.820181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.820253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.820325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.820460 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.820546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] token.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.820629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.820714 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.820796 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.820871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.820944 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.821016 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.821099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.connection = **** {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.821174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.821247 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.821319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.821391 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.821464 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.821545 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.821620 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.821692 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.821764 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.821835 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.821907 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.821988 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.822063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.822135 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.822207 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.822279 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.822350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.822431 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.822506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.822579 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.822651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.822722 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.822795 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.822879 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.823030 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.823107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.823181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.823253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.823325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.connection = **** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.823397 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.823477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.823552 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.823552 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.823683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.823775 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.823854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.823937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 16:15:41.824065 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.824065 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.824065 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.824065 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.824318 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.824487 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.824727 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.824975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.825212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.825464 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.825704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.825950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.826184 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.826426 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.826665 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:15:41.826838 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 16:15:41.853222 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:41.853455 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:41.853684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:41.855821 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:41.856059 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:41.856289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:41.862055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:41.864667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:41.894325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:41.894445 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:41.894577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:41.894675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:41.966974 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:41.967125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.018232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.018464 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.018613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.018877 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.194287 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.194515 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.194607 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.194746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.194855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.194974 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.195067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.195198 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.195281 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.195420 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.195506 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.195638 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.226652 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.226861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.226966 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.227118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.227254 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.227340 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.227416 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.227567 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.227659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.227783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.227864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.228000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.228081 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.228227 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.249733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.250555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.263098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.263327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.263430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.263551 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.263635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.263774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.263855 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.263991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.264084 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.264207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.264291 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.264460 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.264546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.264685 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 16:15:42.289805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.290010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.290097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 16:15:42.290255 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 16:15:42.290381 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.290585 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 16:15:42.290666 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.290792 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 16:15:42.290873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.291071 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.291161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.291338 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.291419 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.291603 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.291683 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.291869 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.302073 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.302351 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.302435 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.302623 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.302708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.302908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.302994 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.303203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.310371 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.311579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.314122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.314425 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.314710 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.314995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.315156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.315282 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.315446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.315550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.315734 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.315816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.316023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.316114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.316316 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.316418 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.316607 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.316688 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.316883 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.316967 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.317162 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.317437 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.317713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.318258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.339667 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.341097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.341246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.341534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.342450 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.342743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.346780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.347066 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.347352 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.347978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.353719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.353719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.353922 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.354051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.354921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.355217 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.360319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.360643 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.360935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.361227 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.361508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.361607 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.361785 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.361873 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.362056 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.362175 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.362329 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.362471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.362757 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.363045 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.363329 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.363608 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.377876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.378157 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.379250 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.379537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.382001 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.383408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.386324 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.386324 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.387968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.387968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.389878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.391251 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.393082 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.394378 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.396280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.396620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.396907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.397191 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.397471 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.397631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.397752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.397938 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.398247 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.398548 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.398836 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.399119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.414103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.414398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.414667 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.414934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.415518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.415813 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.416090 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.416385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.422732 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.424112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.424269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.425751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.425849 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.426125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.427292 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.427574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.428819 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.429109 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.429400 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.429695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.430089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.430269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.430569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.430859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.431151 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.431556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.441527 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.441813 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.442098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.442392 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.442778 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.443013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.443098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.443310 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.443410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.443640 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.443930 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.444327 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.444635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.444930 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.458860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.462475 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.462565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.463654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.464820 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.466523 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.466629 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.467995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.468080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.468324 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.469278 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.470111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.470400 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.470833 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.475664 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.477212 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.477314 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.478839 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.480034 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.480458 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.480751 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.481041 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.481838 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.482238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.482529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.482810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.489596 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.489889 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.490175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.491286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.491585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.491870 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.497167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.497457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.497755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.498036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.498314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.498590 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.498859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 16:15:42.498944 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.499144 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.499226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.499425 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.499517 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.499728 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.499813 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.500037 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.500122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.500323 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.500431 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.507540 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.507622 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.507686 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.507762 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.507829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.507829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.507829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.507829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.507829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.507829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 16:15:42.535595 dv-cinder-855060-2-smb devstack@keystone.service[81630]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562ad067b9c0 pid: 81630 (default app) Sep 27 16:15:42.537313 dv-cinder-855060-2-smb devstack@keystone.service[81631]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562ad067b9c0 pid: 81631 (default app) Sep 27 16:15:42.538957 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8baf5c-6813-48c2-97be-c2a0ad6c63e2 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:42.539247 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8baf5c-6813-48c2-97be-c2a0ad6c63e2 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:42.539520 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8baf5c-6813-48c2-97be-c2a0ad6c63e2 None None] PATH_INFO: `/v3` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:42.543981 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Tue Sep 27 16:15:42 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:15:50.322396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05dab5-3e1d-4652-9411-5644a6bd2953 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:50.322916 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05dab5-3e1d-4652-9411-5644a6bd2953 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:50.323024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05dab5-3e1d-4652-9411-5644a6bd2953 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:50.327191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:15:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:15:50.332582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc108fd-c50d-48a9-895b-274708f1e386 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:50.333048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc108fd-c50d-48a9-895b-274708f1e386 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:50.333240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc108fd-c50d-48a9-895b-274708f1e386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:50.404202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: INFO dbcounter [None req-1fc108fd-c50d-48a9-895b-274708f1e386 None None] Registered counter for database keystone Sep 27 16:15:50.425613 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG oslo_db.sqlalchemy.engines [None req-1fc108fd-c50d-48a9-895b-274708f1e386 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 16:15:50.431827 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writer thread running {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 16:15:50.610612 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG passlib.handlers.bcrypt [None req-1fc108fd-c50d-48a9-895b-274708f1e386 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81630) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 27 16:15:50.610929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG passlib.handlers.bcrypt [None req-1fc108fd-c50d-48a9-895b-274708f1e386 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81630) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 27 16:15:50.667700 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-1fc108fd-c50d-48a9-895b-274708f1e386 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:15:50.669579 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-1fc108fd-c50d-48a9-895b-274708f1e386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:15:50.795364 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:15:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 27 16:15:51.227524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05dab5-3e1d-4652-9411-5644a6bd2953 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:15:51.297426 dv-cinder-855060-2-smb devstack@keystone.service[81631]: INFO dbcounter [None req-6d05dab5-3e1d-4652-9411-5644a6bd2953 None None] Registered counter for database keystone Sep 27 16:15:51.316543 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG oslo_db.sqlalchemy.engines [None req-6d05dab5-3e1d-4652-9411-5644a6bd2953 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81631) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 16:15:51.323364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writer thread running {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 16:15:51.441557 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05dab5-3e1d-4652-9411-5644a6bd2953 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:15:51.445817 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce1301-4018-43d0-93c3-e45bcd955350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:15:51.446438 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1301-4018-43d0-93c3-e45bcd955350 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:51.446719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1301-4018-43d0-93c3-e45bcd955350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:51.446990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1301-4018-43d0-93c3-e45bcd955350 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:51.455142 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce1301-4018-43d0-93c3-e45bcd955350 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:15:51.506067 dv-cinder-855060-2-smb devstack@keystone.service[81631]: WARNING keystone.common.rbac_enforcer.enforcer [None req-77ce1301-4018-43d0-93c3-e45bcd955350 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 27 16:15:51.506360 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce1301-4018-43d0-93c3-e45bcd955350 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:15:51.515664 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Tue Sep 27 16:15:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 16:15:51.521599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc108fd-c50d-48a9-895b-274708f1e386 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:15:51.538587 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc108fd-c50d-48a9-895b-274708f1e386 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:15:51.542993 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464b241-6de0-4d25-ac32-56890336b2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:15:51.544355 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464b241-6de0-4d25-ac32-56890336b2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:51.544648 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464b241-6de0-4d25-ac32-56890336b2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:51.544922 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464b241-6de0-4d25-ac32-56890336b2f1 admin admin] PATH_INFO: `/v3/projects/e4cc0d5ca9c1419e8012fd96a408e70a` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:51.546507 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464b241-6de0-4d25-ac32-56890336b2f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=e4cc0d5ca9c1419e8012fd96a408e70a)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:15:51.598632 dv-cinder-855060-2-smb devstack@keystone.service[81630]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9464b241-6de0-4d25-ac32-56890336b2f1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 27 16:15:51.598979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464b241-6de0-4d25-ac32-56890336b2f1 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:15:51.603453 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Tue Sep 27 16:15:51 2022] GET /identity/v3/projects/e4cc0d5ca9c1419e8012fd96a408e70a => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:15:53.715787 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb8384-974b-444c-bf59-03be6c2c3e58 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:53.716424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb8384-974b-444c-bf59-03be6c2c3e58 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:53.716424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb8384-974b-444c-bf59-03be6c2c3e58 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:53.720967 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:15:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:15:53.726268 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f50543-bb7c-45c2-b2ec-f636fc82af47 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:53.726683 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f50543-bb7c-45c2-b2ec-f636fc82af47 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:53.726831 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f50543-bb7c-45c2-b2ec-f636fc82af47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:53.747211 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-38f50543-bb7c-45c2-b2ec-f636fc82af47 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:15:53.748754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-38f50543-bb7c-45c2-b2ec-f636fc82af47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:15:53.756622 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:15:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 27 16:15:54.022793 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb8384-974b-444c-bf59-03be6c2c3e58 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:15:54.034729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb8384-974b-444c-bf59-03be6c2c3e58 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:15:54.038850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b548e-8d94-4e56-bf18-d94da4a9f1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:15:54.039442 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b548e-8d94-4e56-bf18-d94da4a9f1dd admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:54.039716 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b548e-8d94-4e56-bf18-d94da4a9f1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:54.039991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b548e-8d94-4e56-bf18-d94da4a9f1dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:54.048188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b548e-8d94-4e56-bf18-d94da4a9f1dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:15:54.049975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b548e-8d94-4e56-bf18-d94da4a9f1dd admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:15:54.058945 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Tue Sep 27 16:15:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 16:15:54.065030 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f50543-bb7c-45c2-b2ec-f636fc82af47 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:15:54.074207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f50543-bb7c-45c2-b2ec-f636fc82af47 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:15:54.078625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45433116-e91e-4464-98df-ef7e46aca86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:15:54.079272 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45433116-e91e-4464-98df-ef7e46aca86b admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:54.079562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45433116-e91e-4464-98df-ef7e46aca86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:54.079842 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45433116-e91e-4464-98df-ef7e46aca86b admin admin] PATH_INFO: `/v3/users/09247daecb7c4c7e95eb12e5544033af` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:54.081183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45433116-e91e-4464-98df-ef7e46aca86b admin admin] RBAC: Authorizing `identity:get_user(user_id=09247daecb7c4c7e95eb12e5544033af)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:15:54.083033 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45433116-e91e-4464-98df-ef7e46aca86b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:15:54.084608 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Tue Sep 27 16:15:54 2022] GET /identity/v3/users/09247daecb7c4c7e95eb12e5544033af => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:15:56.281291 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545a89c-035f-47f7-8203-41d920b49ebd None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:56.281816 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545a89c-035f-47f7-8203-41d920b49ebd None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:56.281907 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545a89c-035f-47f7-8203-41d920b49ebd None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:56.283173 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:15:56.288265 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac453ff9-f733-4783-952b-422414ddbf6d None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:56.288714 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac453ff9-f733-4783-952b-422414ddbf6d None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:56.288879 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac453ff9-f733-4783-952b-422414ddbf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:56.307321 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-ac453ff9-f733-4783-952b-422414ddbf6d None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:15:56.308438 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514eae8-6686-438d-9e52-9ef6aae3dacd None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:56.308541 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ac453ff9-f733-4783-952b-422414ddbf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:15:56.308727 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514eae8-6686-438d-9e52-9ef6aae3dacd None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:56.309007 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514eae8-6686-438d-9e52-9ef6aae3dacd None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:56.310300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:15:56.316021 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5a323-9841-4eb8-9522-061c76da20a8 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:56.316306 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5a323-9841-4eb8-9522-061c76da20a8 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:56.316612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5a323-9841-4eb8-9522-061c76da20a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:56.357041 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG passlib.handlers.bcrypt [None req-9eb5a323-9841-4eb8-9522-061c76da20a8 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81631) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 27 16:15:56.357440 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG passlib.handlers.bcrypt [None req-9eb5a323-9841-4eb8-9522-061c76da20a8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81631) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 27 16:15:56.390743 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:15:56.407850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9eb5a323-9841-4eb8-9522-061c76da20a8 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:15:56.409474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9eb5a323-9841-4eb8-9522-061c76da20a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:15:56.509934 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:15:56.654437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac453ff9-f733-4783-952b-422414ddbf6d None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:15:56.679389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:15:56.758911 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac453ff9-f733-4783-952b-422414ddbf6d None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:15:56.773665 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5a323-9841-4eb8-9522-061c76da20a8 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:15:56.794447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88248653-36e5-4c34-85a3-8cd1982de676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:15:56.795095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88248653-36e5-4c34-85a3-8cd1982de676 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:56.795380 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88248653-36e5-4c34-85a3-8cd1982de676 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:56.795664 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88248653-36e5-4c34-85a3-8cd1982de676 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:56.808358 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88248653-36e5-4c34-85a3-8cd1982de676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:15:56.816863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-88248653-36e5-4c34-85a3-8cd1982de676 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:15:56.816863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:15:56.816863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:15:56.816863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:15:56.816863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:15:56.816863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:15:56.816863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:15:56.816863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:15:56.816863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:15:56.816863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:15:56.816863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:15:56.816863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:15:56.816863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:15:56.816863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:15:56.816863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:15:56.816863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:15:56.817856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:15:56.817856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:15:56.817856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:15:56.817856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:15:56.817856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:15:56.817856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:15:56.817856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:15:56.817856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:15:56.817856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:15:56.817856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:15:56.817856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:15:56.817856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:15:56.817856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:15:56.817856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:15:56.817856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:15:56.817856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:15:56.818793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:15:56.818793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:15:56.818793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:15:56.818793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:15:56.818793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:15:56.818793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:15:56.818793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:15:56.818793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:15:56.818793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:15:56.818793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:15:56.818793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:15:56.818793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:15:56.818793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:15:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:15:56.823682 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88248653-36e5-4c34-85a3-8cd1982de676 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:15:56.879610 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5a323-9841-4eb8-9522-061c76da20a8 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:15:56.881855 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:15:56.904754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:15:56.916231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff9396-922f-48b5-a26f-e31f43532240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:15:56.917120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff9396-922f-48b5-a26f-e31f43532240 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:56.917411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff9396-922f-48b5-a26f-e31f43532240 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:56.917686 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff9396-922f-48b5-a26f-e31f43532240 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:56.923601 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88248653-36e5-4c34-85a3-8cd1982de676 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:15:56.957227 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee73d0-81a8-46bc-97e0-6f2b80d80701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:15:56.957834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee73d0-81a8-46bc-97e0-6f2b80d80701 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:56.958121 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee73d0-81a8-46bc-97e0-6f2b80d80701 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:56.958392 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee73d0-81a8-46bc-97e0-6f2b80d80701 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:56.959067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee73d0-81a8-46bc-97e0-6f2b80d80701 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:15:56.959371 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee73d0-81a8-46bc-97e0-6f2b80d80701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:15:56.960810 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee73d0-81a8-46bc-97e0-6f2b80d80701 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:15:56.972881 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:15:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:15:56.978432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee73d0-81a8-46bc-97e0-6f2b80d80701 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:15:56.986326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff9396-922f-48b5-a26f-e31f43532240 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:15:56.987856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff9396-922f-48b5-a26f-e31f43532240 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:15:57.074716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee73d0-81a8-46bc-97e0-6f2b80d80701 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:15:57.084255 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:15:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 16:15:57.089727 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff9396-922f-48b5-a26f-e31f43532240 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:15:57.092321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:15:57.107582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e551a4-a54e-44ef-872e-591feb427a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:15:57.108211 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e551a4-a54e-44ef-872e-591feb427a6a None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:57.108525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e551a4-a54e-44ef-872e-591feb427a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:57.108802 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e551a4-a54e-44ef-872e-591feb427a6a None admin] PATH_INFO: `/v3/users/09247daecb7c4c7e95eb12e5544033af` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:57.110479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e551a4-a54e-44ef-872e-591feb427a6a None admin] RBAC: Authorizing `identity:get_user(user_id=09247daecb7c4c7e95eb12e5544033af)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:15:57.111941 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e551a4-a54e-44ef-872e-591feb427a6a None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:15:57.113534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:15:56 2022] GET /identity/v3/users/09247daecb7c4c7e95eb12e5544033af => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:15:57.118795 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e551a4-a54e-44ef-872e-591feb427a6a None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:15:57.132686 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:15:57.187209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff9396-922f-48b5-a26f-e31f43532240 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:15:57.215708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e551a4-a54e-44ef-872e-591feb427a6a None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:15:57.220633 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38901d57-ea4b-4b7b-bcae-a0bc9125dbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:15:57.221479 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38901d57-ea4b-4b7b-bcae-a0bc9125dbef None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:57.221758 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38901d57-ea4b-4b7b-bcae-a0bc9125dbef None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:57.222030 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38901d57-ea4b-4b7b-bcae-a0bc9125dbef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:57.241597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38901d57-ea4b-4b7b-bcae-a0bc9125dbef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:15:57.243075 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38901d57-ea4b-4b7b-bcae-a0bc9125dbef None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:15:57.250191 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba70d1-fb26-40f5-a3b3-132dc21125de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:15:57.250828 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba70d1-fb26-40f5-a3b3-132dc21125de None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:57.251115 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba70d1-fb26-40f5-a3b3-132dc21125de None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:57.251393 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba70d1-fb26-40f5-a3b3-132dc21125de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:57.252563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba70d1-fb26-40f5-a3b3-132dc21125de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:15:57.254046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba70d1-fb26-40f5-a3b3-132dc21125de None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:15:57.255596 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 10/18] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:15:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:15:57.261015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-38901d57-ea4b-4b7b-bcae-a0bc9125dbef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:15:57.261015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:15:57.261015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:15:57.261015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:15:57.261015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:15:57.261015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:15:57.261015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:15:57.261015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:15:57.261015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:15:57.261015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:15:57.261015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:15:57.261015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:15:57.261015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:15:57.261015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:15:57.261015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:15:57.261015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:15:57.261950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:15:57.261950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:15:57.261950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:15:57.261950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:15:57.261950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:15:57.261950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:15:57.261950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:15:57.261950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:15:57.261950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:15:57.261950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:15:57.261950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:15:57.261950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:15:57.261950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:15:57.261950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:15:57.261950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:15:57.261950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:15:57.261950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:15:57.262751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:15:57.262751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:15:57.262751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:15:57.262913 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba70d1-fb26-40f5-a3b3-132dc21125de None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:15:57.262981 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 9/19] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:15:57.268025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38901d57-ea4b-4b7b-bcae-a0bc9125dbef None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:15:57.323804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:15:57.343672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:15:57.362136 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba70d1-fb26-40f5-a3b3-132dc21125de None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:15:57.368655 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38901d57-ea4b-4b7b-bcae-a0bc9125dbef None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:15:57.396321 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83532bf9-18d6-4a88-8992-62c3a94ece10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:15:57.396946 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83532bf9-18d6-4a88-8992-62c3a94ece10 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:57.397225 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83532bf9-18d6-4a88-8992-62c3a94ece10 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:57.397500 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83532bf9-18d6-4a88-8992-62c3a94ece10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:57.398216 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83532bf9-18d6-4a88-8992-62c3a94ece10 None admin] RBAC: Adding query filter params (role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.domain.id=default, user.id=09247daecb7c4c7e95eb12e5544033af) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:15:57.398519 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83532bf9-18d6-4a88-8992-62c3a94ece10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:15:57.399965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83532bf9-18d6-4a88-8992-62c3a94ece10 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:15:57.402061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49586ef9-7f28-46db-b299-0a6ed2cfb4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:15:57.402675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49586ef9-7f28-46db-b299-0a6ed2cfb4bb None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:57.402957 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49586ef9-7f28-46db-b299-0a6ed2cfb4bb None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:57.403231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49586ef9-7f28-46db-b299-0a6ed2cfb4bb None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:57.403866 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49586ef9-7f28-46db-b299-0a6ed2cfb4bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:15:57.404171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49586ef9-7f28-46db-b299-0a6ed2cfb4bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:15:57.405588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49586ef9-7f28-46db-b299-0a6ed2cfb4bb None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:15:57.406341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1322 bytes} [Tue Sep 27 16:15:57 2022] GET /identity/v3/role_assignments?user.id=09247daecb7c4c7e95eb12e5544033af&scope.domain.id=default&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:15:57.425133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:15:59.906931 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0090c6-2889-427e-a53d-6cd3eca1b551 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:59.907450 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0090c6-2889-427e-a53d-6cd3eca1b551 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:59.907526 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0090c6-2889-427e-a53d-6cd3eca1b551 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:59.908879 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:15:59.914577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e063b-1b47-4d77-af4a-3d8ca75a1004 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:15:59.915067 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e063b-1b47-4d77-af4a-3d8ca75a1004 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:15:59.915153 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e063b-1b47-4d77-af4a-3d8ca75a1004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:15:59.945843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-798e063b-1b47-4d77-af4a-3d8ca75a1004 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:15:59.947065 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-798e063b-1b47-4d77-af4a-3d8ca75a1004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:00.038609 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:00.046268 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841850f-e79c-48b8-9097-bc44327db6e6 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:00.047075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841850f-e79c-48b8-9097-bc44327db6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:00.047407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841850f-e79c-48b8-9097-bc44327db6e6 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:00.048839 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:00.066473 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8177c2-b4fa-434a-a387-1c710fbbc257 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:00.066757 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8177c2-b4fa-434a-a387-1c710fbbc257 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:00.067045 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8177c2-b4fa-434a-a387-1c710fbbc257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:00.089317 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1c8177c2-b4fa-434a-a387-1c710fbbc257 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:00.090517 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1c8177c2-b4fa-434a-a387-1c710fbbc257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:00.133888 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:00.165877 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 12/25] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:00.283293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a05b2-01fa-4d6c-9aed-52e91b344de4 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:00.283626 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a05b2-01fa-4d6c-9aed-52e91b344de4 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:00.283847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a05b2-01fa-4d6c-9aed-52e91b344de4 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:00.285468 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 14/26] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:00.290399 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cce6a-6bd1-43c9-a75e-98b240b2d731 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:00.290692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cce6a-6bd1-43c9-a75e-98b240b2d731 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:00.290977 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cce6a-6bd1-43c9-a75e-98b240b2d731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:00.319937 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-f30cce6a-6bd1-43c9-a75e-98b240b2d731 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:00.319937 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f30cce6a-6bd1-43c9-a75e-98b240b2d731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:00.421497 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 13/27] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:00.523451 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a05b2-01fa-4d6c-9aed-52e91b344de4 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:00.610089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfa1a8-0025-44a5-94a6-fde60b49865f None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:00.610686 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfa1a8-0025-44a5-94a6-fde60b49865f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:00.611166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfa1a8-0025-44a5-94a6-fde60b49865f None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:00.614350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 14/28] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:00.617798 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fd5fa-c9bc-4c15-beb0-0f073d8ed439 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:00.618328 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fd5fa-c9bc-4c15-beb0-0f073d8ed439 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:00.618815 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fd5fa-c9bc-4c15-beb0-0f073d8ed439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:00.646350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-425fd5fa-c9bc-4c15-beb0-0f073d8ed439 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:00.647885 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-425fd5fa-c9bc-4c15-beb0-0f073d8ed439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:00.685987 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a05b2-01fa-4d6c-9aed-52e91b344de4 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:00.750455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 15/29] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:16:00.753581 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fd5fa-c9bc-4c15-beb0-0f073d8ed439 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:00.766515 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fad7a-e4c0-436a-a8e7-b6c9d6ba0ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:00.767512 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fad7a-e4c0-436a-a8e7-b6c9d6ba0ddf None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:00.767997 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fad7a-e4c0-436a-a8e7-b6c9d6ba0ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:00.768548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fad7a-e4c0-436a-a8e7-b6c9d6ba0ddf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:00.795411 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fad7a-e4c0-436a-a8e7-b6c9d6ba0ddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:00.803843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-679fad7a-e4c0-436a-a8e7-b6c9d6ba0ddf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:16:00.803843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:00.803843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:00.803843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:00.803843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:00.803843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:00.803843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:00.803843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:00.803843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:00.803843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:00.803843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:00.803843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:00.803843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:00.803843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:00.803843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:00.803843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:00.804822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:00.804822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:00.804822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:00.804822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:00.804822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:00.804822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:00.804822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:00.804822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:00.804822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:00.804822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:00.804822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:00.804822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:00.804822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:00.804822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:00.804822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:00.804822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:00.805582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:00.805582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:00.805582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:00.805582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:00.805582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:00.805582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:00.805582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:00.805582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:00.805582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:00.805582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:00.805582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:16:00.805582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:00.807864 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 15/30] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:16:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:00.812112 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fad7a-e4c0-436a-a8e7-b6c9d6ba0ddf None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:00.819012 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:00.829026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:00.948317 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fd5fa-c9bc-4c15-beb0-0f073d8ed439 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:00.996189 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fad7a-e4c0-436a-a8e7-b6c9d6ba0ddf None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:01.006170 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc70329-037b-46e2-99e0-fbbd885585fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:01.006790 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc70329-037b-46e2-99e0-fbbd885585fa None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:01.007072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc70329-037b-46e2-99e0-fbbd885585fa None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:01.007349 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc70329-037b-46e2-99e0-fbbd885585fa None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:01.008026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc70329-037b-46e2-99e0-fbbd885585fa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:01.009953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc70329-037b-46e2-99e0-fbbd885585fa None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:01.048697 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a55a4d-9b17-4019-9796-e36d86ba37e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:01.049544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a55a4d-9b17-4019-9796-e36d86ba37e5 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:01.050029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a55a4d-9b17-4019-9796-e36d86ba37e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:01.050462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a55a4d-9b17-4019-9796-e36d86ba37e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:01.051270 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a55a4d-9b17-4019-9796-e36d86ba37e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:01.051734 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a55a4d-9b17-4019-9796-e36d86ba37e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:01.053425 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a55a4d-9b17-4019-9796-e36d86ba37e5 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:01.063533 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 16/31] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:01.064758 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a55a4d-9b17-4019-9796-e36d86ba37e5 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:01.165142 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:01.231661 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a55a4d-9b17-4019-9796-e36d86ba37e5 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:01.317098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38cbac-5297-4286-b1f4-a4a95541b3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:01.318051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38cbac-5297-4286-b1f4-a4a95541b3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:01.318540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38cbac-5297-4286-b1f4-a4a95541b3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:01.319033 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38cbac-5297-4286-b1f4-a4a95541b3d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:01.339871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38cbac-5297-4286-b1f4-a4a95541b3d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:01.342089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38cbac-5297-4286-b1f4-a4a95541b3d2 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:01.353525 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 16/32] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Sep 27 16:16:00 2022] POST /identity/v3/roles => generated 219 bytes in 600 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:16:01.360966 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc70329-037b-46e2-99e0-fbbd885585fa None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:01.365780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-bc38cbac-5297-4286-b1f4-a4a95541b3d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:16:01.365780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:01.365780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:01.365780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:01.365780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:01.365780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:01.365780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:01.365780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:01.365780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:01.365780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:01.365780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:01.365780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:01.365780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:16:01.365780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:16:01.365780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:16:01.365780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:16:01.366736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:01.366736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:01.366736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:01.366736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:01.366736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:01.366736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:01.366736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:01.366736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:01.366736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:01.366736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:01.366736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:01.366736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:01.366736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:01.366736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:01.366736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:01.366736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:01.366736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:16:01.367559 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:16:01.367559 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:16:01.367559 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:01.376614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 17/33] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:01.377996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38cbac-5297-4286-b1f4-a4a95541b3d2 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:01.636713 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38cbac-5297-4286-b1f4-a4a95541b3d2 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:01.659508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:01.669736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:01.680076 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc70329-037b-46e2-99e0-fbbd885585fa None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:01.683613 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc9979-32d7-4533-83de-d183bc4eb659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:01.684236 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc9979-32d7-4533-83de-d183bc4eb659 None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:01.684551 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc9979-32d7-4533-83de-d183bc4eb659 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:01.684829 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc9979-32d7-4533-83de-d183bc4eb659 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:01.685508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc9979-32d7-4533-83de-d183bc4eb659 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:01.687000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc9979-32d7-4533-83de-d183bc4eb659 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:01.720033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dfe5c-7944-4b82-8ac7-19b84abaa35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:01.720759 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dfe5c-7944-4b82-8ac7-19b84abaa35a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:01.721051 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dfe5c-7944-4b82-8ac7-19b84abaa35a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:01.721324 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dfe5c-7944-4b82-8ac7-19b84abaa35a None admin] PATH_INFO: `/v3/users/09247daecb7c4c7e95eb12e5544033af` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:01.722947 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563dfe5c-7944-4b82-8ac7-19b84abaa35a None admin] RBAC: Authorizing `identity:get_user(user_id=09247daecb7c4c7e95eb12e5544033af)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:01.724552 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563dfe5c-7944-4b82-8ac7-19b84abaa35a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:01.726161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 17/34] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:01 2022] GET /identity/v3/users/09247daecb7c4c7e95eb12e5544033af => generated 247 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:01.726929 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dfe5c-7944-4b82-8ac7-19b84abaa35a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:01.828053 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dfe5c-7944-4b82-8ac7-19b84abaa35a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:01.860954 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10f612-84d6-43b7-beb7-ff9ebdcf9aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:01.861551 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10f612-84d6-43b7-beb7-ff9ebdcf9aef None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:01.861833 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10f612-84d6-43b7-beb7-ff9ebdcf9aef None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:01.862112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10f612-84d6-43b7-beb7-ff9ebdcf9aef None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:01.862749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10f612-84d6-43b7-beb7-ff9ebdcf9aef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:01.863056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10f612-84d6-43b7-beb7-ff9ebdcf9aef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:01.864456 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10f612-84d6-43b7-beb7-ff9ebdcf9aef None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:01.875842 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 18/35] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:01.877092 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0884cc-30d1-4e18-9b3f-0888c2d8f71c None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:01.877379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0884cc-30d1-4e18-9b3f-0888c2d8f71c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:01.877658 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0884cc-30d1-4e18-9b3f-0888c2d8f71c None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:01.879059 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:01.879864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1998f-05e9-481a-9030-6603e096d138 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:01.880150 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1998f-05e9-481a-9030-6603e096d138 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:01.880446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1998f-05e9-481a-9030-6603e096d138 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:01.881771 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 20/37] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:01.882327 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1998f-05e9-481a-9030-6603e096d138 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:01.888958 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 18/38] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Sep 27 16:16:01 2022] POST /identity/v3/roles => generated 225 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:16:01.889983 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc9979-32d7-4533-83de-d183bc4eb659 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:01.915392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:02.006693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1998f-05e9-481a-9030-6603e096d138 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:02.012048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc9979-32d7-4533-83de-d183bc4eb659 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:02.048740 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276d7af-834c-42dc-bd88-8c64a9882b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:02.049417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276d7af-834c-42dc-bd88-8c64a9882b81 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:02.049711 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276d7af-834c-42dc-bd88-8c64a9882b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:02.050049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276d7af-834c-42dc-bd88-8c64a9882b81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:02.051275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276d7af-834c-42dc-bd88-8c64a9882b81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:02.052797 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276d7af-834c-42dc-bd88-8c64a9882b81 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:02.052972 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379914d-2288-4ed8-a3b2-1c1dc25eeadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:02.053621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379914d-2288-4ed8-a3b2-1c1dc25eeadb None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:02.053912 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379914d-2288-4ed8-a3b2-1c1dc25eeadb None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:02.054193 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379914d-2288-4ed8-a3b2-1c1dc25eeadb None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:02.054456 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 21/39] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:16:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:02.056028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248c212-61db-4b56-b695-8accaef92bb9 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:02.056134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379914d-2288-4ed8-a3b2-1c1dc25eeadb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:02.056215 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248c212-61db-4b56-b695-8accaef92bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:02.056215 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248c212-61db-4b56-b695-8accaef92bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:02.057441 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379914d-2288-4ed8-a3b2-1c1dc25eeadb None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:02.076967 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-5248c212-61db-4b56-b695-8accaef92bb9 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:02.078584 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5248c212-61db-4b56-b695-8accaef92bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:02.145883 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 22/40] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:02.147237 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8780b9-ea7d-4a06-ac6a-4073010552b3 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:02.147535 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8780b9-ea7d-4a06-ac6a-4073010552b3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:02.147818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8780b9-ea7d-4a06-ac6a-4073010552b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:02.165347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9b8780b9-ea7d-4a06-ac6a-4073010552b3 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:02.166320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 19/41] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 27 16:16:01 2022] POST /identity/v3/projects => generated 301 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:16:02.166793 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9b8780b9-ea7d-4a06-ac6a-4073010552b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:02.167415 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379914d-2288-4ed8-a3b2-1c1dc25eeadb None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:02.186587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:02.201261 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:02.246595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 23/42] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:02.303975 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379914d-2288-4ed8-a3b2-1c1dc25eeadb None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:02.348113 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ba007-98a1-4548-ad14-3728a538b549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:02.349398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ba007-98a1-4548-ad14-3728a538b549 None admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:02.349886 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ba007-98a1-4548-ad14-3728a538b549 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:02.350335 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ba007-98a1-4548-ad14-3728a538b549 None admin] PATH_INFO: `/v3/domains/default/users/09247daecb7c4c7e95eb12e5544033af/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:02.352652 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ba007-98a1-4548-ad14-3728a538b549 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=09247daecb7c4c7e95eb12e5544033af, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:02.354312 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ba007-98a1-4548-ad14-3728a538b549 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:02.444393 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 20/43] 10.222.0.26 () {58 vars in 1361 bytes} [Tue Sep 27 16:16:02 2022] PUT /identity/v3/domains/default/users/09247daecb7c4c7e95eb12e5544033af/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:16:02.466957 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8780b9-ea7d-4a06-ac6a-4073010552b3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:02.528262 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ba007-98a1-4548-ad14-3728a538b549 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:02.582743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8780b9-ea7d-4a06-ac6a-4073010552b3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:02.625697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacec9d7-2a04-46bb-bad5-d8e93c7fc0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:02.626312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacec9d7-2a04-46bb-bad5-d8e93c7fc0e3 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:02.626596 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacec9d7-2a04-46bb-bad5-d8e93c7fc0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:02.626875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacec9d7-2a04-46bb-bad5-d8e93c7fc0e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:02.627671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacec9d7-2a04-46bb-bad5-d8e93c7fc0e3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:02.629128 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacec9d7-2a04-46bb-bad5-d8e93c7fc0e3 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:02.630374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:02.640966 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ba007-98a1-4548-ad14-3728a538b549 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:02.675262 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7340-072f-4996-b196-3e51b1a13298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:02.675895 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7340-072f-4996-b196-3e51b1a13298 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:02.676180 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7340-072f-4996-b196-3e51b1a13298 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:02.676496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7340-072f-4996-b196-3e51b1a13298 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:02.677597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb7340-072f-4996-b196-3e51b1a13298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:02.679061 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb7340-072f-4996-b196-3e51b1a13298 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:02.680675 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 21/44] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:16:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:02.686016 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7340-072f-4996-b196-3e51b1a13298 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:02.694918 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 24/45] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Sep 27 16:16:02 2022] POST /identity/v3/roles => generated 223 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:16:02.902676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7340-072f-4996-b196-3e51b1a13298 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:02.942676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bea4ef-c058-4a38-804f-bccafb58f34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:02.943301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bea4ef-c058-4a38-804f-bccafb58f34e None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:02.943586 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bea4ef-c058-4a38-804f-bccafb58f34e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:02.943861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bea4ef-c058-4a38-804f-bccafb58f34e None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:02.944615 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bea4ef-c058-4a38-804f-bccafb58f34e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:02.946117 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bea4ef-c058-4a38-804f-bccafb58f34e None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:03.028085 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 22/46] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 27 16:16:02 2022] POST /identity/v3/projects => generated 312 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:16:04.601847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea5b47-962d-4754-aad2-405d4fa3ffbd None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:04.602361 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea5b47-962d-4754-aad2-405d4fa3ffbd None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:04.602478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea5b47-962d-4754-aad2-405d4fa3ffbd None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:04.603740 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 25/47] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:04.610189 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab775bd1-40fa-48ab-8b07-9d9efd3b17ae None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:04.610590 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab775bd1-40fa-48ab-8b07-9d9efd3b17ae None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:04.610865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab775bd1-40fa-48ab-8b07-9d9efd3b17ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:04.629513 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-ab775bd1-40fa-48ab-8b07-9d9efd3b17ae None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:04.630999 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ab775bd1-40fa-48ab-8b07-9d9efd3b17ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:04.633737 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:04.697241 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 23/48] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:04.964643 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea5b47-962d-4754-aad2-405d4fa3ffbd None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:04.980201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:05.069428 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea5b47-962d-4754-aad2-405d4fa3ffbd None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:05.104424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50a1e-cc82-43a4-97b5-60ce2d825d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:05.105062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50a1e-cc82-43a4-97b5-60ce2d825d04 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:05.105348 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50a1e-cc82-43a4-97b5-60ce2d825d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:05.105629 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50a1e-cc82-43a4-97b5-60ce2d825d04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:05.117119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea50a1e-cc82-43a4-97b5-60ce2d825d04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:05.123460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-dea50a1e-cc82-43a4-97b5-60ce2d825d04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:16:05.123460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:05.123460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:05.123460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:05.123460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:05.123460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:05.123460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:05.123460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:05.123460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:05.123460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:05.123460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:05.123460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:05.123460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:05.123460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:05.123460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:05.123460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:05.124424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:05.124424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:05.124424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:05.124424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:05.124424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:05.124424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:05.124424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:05.124424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:05.124424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:05.124424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:05.124424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:05.124424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:05.124424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:05.124424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:05.124424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:05.124424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:05.125180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:05.125180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:05.125180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:05.125180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:05.125180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:05.125180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:05.125180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:05.125180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:05.125180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:05.125180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:05.125180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:16:05.125180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:05.125180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 26/49] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:16:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:05.130609 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab775bd1-40fa-48ab-8b07-9d9efd3b17ae None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:05.168292 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dbdfc-75da-48c0-a3cd-447d2f88ac8b None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:05.168856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dbdfc-75da-48c0-a3cd-447d2f88ac8b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:05.169169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dbdfc-75da-48c0-a3cd-447d2f88ac8b None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:05.170951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 27/50] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:16:05.176637 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86841930-d256-4ff6-8508-3e6beb9c1333 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:05.176940 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86841930-d256-4ff6-8508-3e6beb9c1333 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:05.177224 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86841930-d256-4ff6-8508-3e6beb9c1333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:05.194882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-86841930-d256-4ff6-8508-3e6beb9c1333 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:05.196086 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-86841930-d256-4ff6-8508-3e6beb9c1333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:05.229257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab775bd1-40fa-48ab-8b07-9d9efd3b17ae None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:05.262295 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab53550-94ff-4246-8b21-dc222758f0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:05.262910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab53550-94ff-4246-8b21-dc222758f0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:05.263077 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 28/51] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:16:05.264436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab53550-94ff-4246-8b21-dc222758f0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:05.264756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab53550-94ff-4246-8b21-dc222758f0d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:05.265990 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab53550-94ff-4246-8b21-dc222758f0d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:05.266328 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab53550-94ff-4246-8b21-dc222758f0d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:05.267721 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab53550-94ff-4246-8b21-dc222758f0d1 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:05.276066 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 24/52] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:05.282152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86841930-d256-4ff6-8508-3e6beb9c1333 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:05.284712 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:05.481405 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86841930-d256-4ff6-8508-3e6beb9c1333 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:05.513410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289ab3e-71fd-48db-8f00-5528418aac80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:05.514035 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289ab3e-71fd-48db-8f00-5528418aac80 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:05.514319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289ab3e-71fd-48db-8f00-5528418aac80 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:05.514597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289ab3e-71fd-48db-8f00-5528418aac80 None admin] PATH_INFO: `/v3/users/09247daecb7c4c7e95eb12e5544033af` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:05.516238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289ab3e-71fd-48db-8f00-5528418aac80 None admin] RBAC: Authorizing `identity:get_user(user_id=09247daecb7c4c7e95eb12e5544033af)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:05.517725 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289ab3e-71fd-48db-8f00-5528418aac80 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:05.519297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 29/53] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:05 2022] GET /identity/v3/users/09247daecb7c4c7e95eb12e5544033af => generated 247 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:05.524793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab53550-94ff-4246-8b21-dc222758f0d1 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:05.527636 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:05.535376 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289ab3e-71fd-48db-8f00-5528418aac80 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:05.604449 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:05.626352 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab53550-94ff-4246-8b21-dc222758f0d1 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:05.635150 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289ab3e-71fd-48db-8f00-5528418aac80 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:05.660495 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229248a-64e4-4442-af64-867b35b9b985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:05.661120 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229248a-64e4-4442-af64-867b35b9b985 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:05.661406 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229248a-64e4-4442-af64-867b35b9b985 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:05.661678 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229248a-64e4-4442-af64-867b35b9b985 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:05.662785 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229248a-64e4-4442-af64-867b35b9b985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:05.664239 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229248a-64e4-4442-af64-867b35b9b985 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:05.665821 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 25/54] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:16:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:05.669162 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b4182-cf4b-4163-b99f-6dde0975342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:05.669816 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b4182-cf4b-4163-b99f-6dde0975342f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:05.670097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b4182-cf4b-4163-b99f-6dde0975342f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:05.670371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b4182-cf4b-4163-b99f-6dde0975342f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:05.672174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b4182-cf4b-4163-b99f-6dde0975342f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:05.672418 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229248a-64e4-4442-af64-867b35b9b985 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:05.673670 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b4182-cf4b-4163-b99f-6dde0975342f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:05.675221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 30/55] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:16:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:05.680474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b4182-cf4b-4163-b99f-6dde0975342f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:05.739955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:05.769502 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229248a-64e4-4442-af64-867b35b9b985 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:05.778346 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b4182-cf4b-4163-b99f-6dde0975342f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:05.806869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7e1c5-edd8-4ab1-b14d-cc3489c29a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:05.807474 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7e1c5-edd8-4ab1-b14d-cc3489c29a40 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:05.807763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7e1c5-edd8-4ab1-b14d-cc3489c29a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:05.808039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7e1c5-edd8-4ab1-b14d-cc3489c29a40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:05.808793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7e1c5-edd8-4ab1-b14d-cc3489c29a40 None admin] RBAC: Adding query filter params (role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.domain.id=default, user.id=09247daecb7c4c7e95eb12e5544033af) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:05.809105 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7e1c5-edd8-4ab1-b14d-cc3489c29a40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:05.810555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7e1c5-edd8-4ab1-b14d-cc3489c29a40 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:05.815320 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d3915-e6ec-4061-bf5b-3a308c7458bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:05.815933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d3915-e6ec-4061-bf5b-3a308c7458bd None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:05.816436 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d3915-e6ec-4061-bf5b-3a308c7458bd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:05.816548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 26/56] 10.222.0.26 () {56 vars in 1322 bytes} [Tue Sep 27 16:16:05 2022] GET /identity/v3/role_assignments?user.id=09247daecb7c4c7e95eb12e5544033af&scope.domain.id=default&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:05.816655 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d3915-e6ec-4061-bf5b-3a308c7458bd None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:05.817165 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d3915-e6ec-4061-bf5b-3a308c7458bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:05.818676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d3915-e6ec-4061-bf5b-3a308c7458bd None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:05.830344 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:05.924457 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 31/57] 10.222.0.26 () {60 vars in 1140 bytes} [Tue Sep 27 16:16:05 2022] POST /identity/v3/projects => generated 298 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:16:08.066368 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58796a72-12b6-4a11-9338-1342d00a2be9 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:08.066855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58796a72-12b6-4a11-9338-1342d00a2be9 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:08.066855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58796a72-12b6-4a11-9338-1342d00a2be9 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:08.068223 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 27/58] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:08.073610 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55518359-789d-488d-a5c1-655e7dba6d71 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:08.074019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55518359-789d-488d-a5c1-655e7dba6d71 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:08.074176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55518359-789d-488d-a5c1-655e7dba6d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:08.092161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-55518359-789d-488d-a5c1-655e7dba6d71 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:08.093911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-55518359-789d-488d-a5c1-655e7dba6d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:08.158596 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 32/59] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:08.433199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58796a72-12b6-4a11-9338-1342d00a2be9 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:08.533604 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58796a72-12b6-4a11-9338-1342d00a2be9 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:08.568029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f78c1b-7aed-441c-bfd3-9bbbd71257db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:08.568679 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f78c1b-7aed-441c-bfd3-9bbbd71257db None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:08.568959 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f78c1b-7aed-441c-bfd3-9bbbd71257db None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:08.569267 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f78c1b-7aed-441c-bfd3-9bbbd71257db None admin] PATH_INFO: `/v3/domains/default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:08.570374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f78c1b-7aed-441c-bfd3-9bbbd71257db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:08.571884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f78c1b-7aed-441c-bfd3-9bbbd71257db None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:08.573445 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 28/60] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:16:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:08.578964 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55518359-789d-488d-a5c1-655e7dba6d71 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:08.673982 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55518359-789d-488d-a5c1-655e7dba6d71 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:08.693020 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:08.705918 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dd122-ff70-40f7-bf38-7be4549b06a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:08.706523 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dd122-ff70-40f7-bf38-7be4549b06a8 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:08.706804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dd122-ff70-40f7-bf38-7be4549b06a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:08.707419 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dd122-ff70-40f7-bf38-7be4549b06a8 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:08.707721 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dd122-ff70-40f7-bf38-7be4549b06a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:08.709264 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dd122-ff70-40f7-bf38-7be4549b06a8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:08.803636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 33/61] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 27 16:16:08 2022] POST /identity/v3/users => generated 275 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:16:11.832452 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65503f-6c4b-4573-b30f-ca6af8c2d923 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:11.833423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65503f-6c4b-4573-b30f-ca6af8c2d923 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:11.833933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65503f-6c4b-4573-b30f-ca6af8c2d923 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:11.835566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 29/62] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:11.841312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85096a9c-c478-4b85-b26c-539194e2dd4e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:11.842097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85096a9c-c478-4b85-b26c-539194e2dd4e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:11.842548 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85096a9c-c478-4b85-b26c-539194e2dd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:11.867882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-85096a9c-c478-4b85-b26c-539194e2dd4e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:11.869499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-85096a9c-c478-4b85-b26c-539194e2dd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:11.957902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 34/63] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:12.289545 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7fcd7-3529-4591-a3a2-63abcea4f43d None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:12.290072 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7fcd7-3529-4591-a3a2-63abcea4f43d None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:12.290511 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7fcd7-3529-4591-a3a2-63abcea4f43d None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:12.292085 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 30/64] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:12.299023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623c681-85e3-4a34-9822-42577f14e6ab None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:12.299545 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623c681-85e3-4a34-9822-42577f14e6ab None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:12.299967 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623c681-85e3-4a34-9822-42577f14e6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:12.325393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-f623c681-85e3-4a34-9822-42577f14e6ab None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:12.327038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f623c681-85e3-4a34-9822-42577f14e6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:12.422579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 35/65] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:12.439772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa613cf-189f-4fdc-83bd-7383097b2244 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:12.440282 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa613cf-189f-4fdc-83bd-7383097b2244 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:12.440731 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa613cf-189f-4fdc-83bd-7383097b2244 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:12.442292 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 31/66] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:12.448002 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746be0e-260b-4b15-b1a1-e09eed7cecd2 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:12.448522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746be0e-260b-4b15-b1a1-e09eed7cecd2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:12.448942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746be0e-260b-4b15-b1a1-e09eed7cecd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:12.473423 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6746be0e-260b-4b15-b1a1-e09eed7cecd2 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:12.474643 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6746be0e-260b-4b15-b1a1-e09eed7cecd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:12.476432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa613cf-189f-4fdc-83bd-7383097b2244 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:12.479614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:12.513363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:12.569258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 36/67] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:12.570302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200d983-f9e1-4644-b465-0c4a5bde6ff1 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:12.570596 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200d983-f9e1-4644-b465-0c4a5bde6ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:12.570989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200d983-f9e1-4644-b465-0c4a5bde6ff1 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:12.572514 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 37/68] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:12.586466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67274e-1220-4d66-a40f-c621de093c15 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:12.586751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67274e-1220-4d66-a40f-c621de093c15 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:12.587034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67274e-1220-4d66-a40f-c621de093c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:12.608561 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-2f67274e-1220-4d66-a40f-c621de093c15 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:12.610406 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2f67274e-1220-4d66-a40f-c621de093c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:12.670547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa613cf-189f-4fdc-83bd-7383097b2244 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:12.701892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 38/69] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:16:12.714459 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546b82b-870a-4e42-88e5-ffa9a591ab02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:12.715112 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546b82b-870a-4e42-88e5-ffa9a591ab02 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:12.715396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546b82b-870a-4e42-88e5-ffa9a591ab02 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:12.715671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546b82b-870a-4e42-88e5-ffa9a591ab02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:12.725905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67274e-1220-4d66-a40f-c621de093c15 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:12.738251 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546b82b-870a-4e42-88e5-ffa9a591ab02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:12.743172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-4546b82b-870a-4e42-88e5-ffa9a591ab02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:12.743172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:12.743172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:12.743172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:12.743172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:12.743172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:12.743172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:12.743172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:12.743172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:12.743172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:12.743172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:12.743172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:12.743172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:12.743172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:12.743172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:12.743172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:12.744207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:12.744207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:12.744207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:12.744207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:12.744207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:12.744207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:12.744207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:12.744207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:12.744207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:12.744207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:12.744207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:12.744207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:12.744207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:12.744207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:12.744207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:12.744207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:12.745305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:12.745305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:12.745305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:12.745305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:12.745305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:12.745305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:12.745305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:12.745305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:12.745305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:12.745305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:12.745305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:12.745305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:12.745305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 32/70] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:16:12.753248 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546b82b-870a-4e42-88e5-ffa9a591ab02 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:12.840643 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:12.850172 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67274e-1220-4d66-a40f-c621de093c15 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:12.874908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:12.904608 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d55c39-24b6-4aa0-a9d5-b0139f3ed63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:12.905245 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d55c39-24b6-4aa0-a9d5-b0139f3ed63c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:12.906078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d55c39-24b6-4aa0-a9d5-b0139f3ed63c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:12.906355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d55c39-24b6-4aa0-a9d5-b0139f3ed63c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:12.916613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d55c39-24b6-4aa0-a9d5-b0139f3ed63c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:12.921972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-92d55c39-24b6-4aa0-a9d5-b0139f3ed63c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:16:12.921972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:12.921972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:12.921972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:12.921972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:12.921972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:12.921972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:12.921972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:12.921972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:12.921972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:12.921972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:12.921972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:12.921972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:12.921972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:12.921972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:12.921972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:12.923023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:12.923023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:12.923023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:12.923023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:12.923023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:12.923023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:12.923023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:12.923023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:12.923023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:12.923023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:12.923023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:12.923023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:12.923023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:12.923023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:12.923023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:12.923023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:12.928724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:12.928724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:12.928724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:12.928724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:12.928724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:12.928724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:12.928724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:12.928724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:12.928724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:12.928724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:12.928724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:16:12.928724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:12.928724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 39/71] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:16:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:16:12.928724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d55c39-24b6-4aa0-a9d5-b0139f3ed63c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:12.933434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546b82b-870a-4e42-88e5-ffa9a591ab02 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:12.970885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83690310-bc84-4b1f-9aff-23f6add8e669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:12.971802 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83690310-bc84-4b1f-9aff-23f6add8e669 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:12.972312 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83690310-bc84-4b1f-9aff-23f6add8e669 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:12.972757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83690310-bc84-4b1f-9aff-23f6add8e669 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:12.973561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83690310-bc84-4b1f-9aff-23f6add8e669 None admin] RBAC: Adding query filter params (name=member) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:12.974036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83690310-bc84-4b1f-9aff-23f6add8e669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:12.975569 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83690310-bc84-4b1f-9aff-23f6add8e669 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:12.984759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 33/72] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:12.986164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce19b31-c502-4ed0-93f7-ce593b0c678d None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:12.986448 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce19b31-c502-4ed0-93f7-ce593b0c678d None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:12.986725 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce19b31-c502-4ed0-93f7-ce593b0c678d None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:12.987930 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 34/73] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:12.988649 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce19b31-c502-4ed0-93f7-ce593b0c678d None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:13.035611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d55c39-24b6-4aa0-a9d5-b0139f3ed63c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:13.068902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d75c63-4a45-45e6-948a-bf90b020236a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:13.069522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d75c63-4a45-45e6-948a-bf90b020236a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:13.069804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d75c63-4a45-45e6-948a-bf90b020236a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:13.070075 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d75c63-4a45-45e6-948a-bf90b020236a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:13.080554 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d75c63-4a45-45e6-948a-bf90b020236a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:13.085490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-f8d75c63-4a45-45e6-948a-bf90b020236a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:13.085490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:13.085490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:13.085490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:13.085490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:13.085490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:13.085490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:13.085490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:13.085490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:13.085490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:13.085490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:13.085490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:13.085490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:13.085490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:13.085490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:13.085490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:13.086447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:13.086447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:13.086447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:13.086447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:13.086447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:13.086447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:13.086447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:13.086447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:13.086447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:13.086447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:13.086447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:13.086447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:13.086447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:13.086447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:13.086447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:13.086447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:13.087212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:13.087212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:13.087212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:13.087212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:13.087212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:13.087212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:13.087212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:13.087212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:13.087212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:13.087212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:13.087212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:13.087212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:13.087212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 40/74] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:16:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:13.087831 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d75c63-4a45-45e6-948a-bf90b020236a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:13.098140 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce19b31-c502-4ed0-93f7-ce593b0c678d None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:13.106410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:13.120291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:13.131079 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8f5b8-d01a-420e-a80e-f8316de45a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:13.131697 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8f5b8-d01a-420e-a80e-f8316de45a41 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:13.131980 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8f5b8-d01a-420e-a80e-f8316de45a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:13.132256 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8f5b8-d01a-420e-a80e-f8316de45a41 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:13.132953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8f5b8-d01a-420e-a80e-f8316de45a41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:13.133260 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8f5b8-d01a-420e-a80e-f8316de45a41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:13.134659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8f5b8-d01a-420e-a80e-f8316de45a41 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:13.143919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 35/75] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:13.145158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c105686-5a58-4fdb-94ca-e951951a853e None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:13.145404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c105686-5a58-4fdb-94ca-e951951a853e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:13.145714 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c105686-5a58-4fdb-94ca-e951951a853e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:13.167400 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-2c105686-5a58-4fdb-94ca-e951951a853e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:13.168640 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-2c105686-5a58-4fdb-94ca-e951951a853e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:13.193186 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d75c63-4a45-45e6-948a-bf90b020236a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:13.227178 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d03c9-a6e4-433f-8656-5f7d686066e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:13.227800 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d03c9-a6e4-433f-8656-5f7d686066e7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:13.228080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d03c9-a6e4-433f-8656-5f7d686066e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:13.228455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d03c9-a6e4-433f-8656-5f7d686066e7 None admin] PATH_INFO: `/v3/users/3e16364861b54675955ca4da10f6c281` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:13.233627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 36/76] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:13.234512 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c105686-5a58-4fdb-94ca-e951951a853e None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:13.243020 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d03c9-a6e4-433f-8656-5f7d686066e7 None admin] RBAC: Authorizing `identity:get_user(user_id=3e16364861b54675955ca4da10f6c281)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:13.244496 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d03c9-a6e4-433f-8656-5f7d686066e7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:13.246183 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 41/77] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:13 2022] GET /identity/v3/users/3e16364861b54675955ca4da10f6c281 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:13.246866 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d03c9-a6e4-433f-8656-5f7d686066e7 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:13.328956 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:13.349037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c105686-5a58-4fdb-94ca-e951951a853e None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:13.352144 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d03c9-a6e4-433f-8656-5f7d686066e7 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:13.366291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:13.383806 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac9d4a-01a3-4579-b9e9-53afe0fc712d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:13.384477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac9d4a-01a3-4579-b9e9-53afe0fc712d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:13.384765 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac9d4a-01a3-4579-b9e9-53afe0fc712d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:13.385044 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac9d4a-01a3-4579-b9e9-53afe0fc712d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:13.388056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ad0d2-7d16-4caf-98a8-b11878c6f754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:13.388760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ad0d2-7d16-4caf-98a8-b11878c6f754 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:13.389092 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ad0d2-7d16-4caf-98a8-b11878c6f754 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:13.389368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ad0d2-7d16-4caf-98a8-b11878c6f754 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:13.390084 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ad0d2-7d16-4caf-98a8-b11878c6f754 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:13.390388 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ad0d2-7d16-4caf-98a8-b11878c6f754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:13.391756 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ad0d2-7d16-4caf-98a8-b11878c6f754 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:13.395106 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac9d4a-01a3-4579-b9e9-53afe0fc712d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:13.400890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-bbac9d4a-01a3-4579-b9e9-53afe0fc712d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:13.400890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:13.400890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:13.400890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:13.400890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:13.400890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:13.400890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:13.400890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:13.400890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:13.400890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:13.400890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:13.400890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:13.400890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:13.400890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:13.400890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:13.400890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:13.401907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:13.401907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:13.401907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:13.401907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:13.401907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:13.401907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:13.401907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:13.401907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:13.401907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:13.401907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:13.401907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:13.401907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:13.401907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:13.401907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:13.401907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:13.401907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:13.402865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:13.402865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:13.402865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:13.402865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:13.402865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:13.402865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:13.402865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:13.402865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:13.402865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:13.402865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:13.402865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:13.402865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:13.405987 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 37/78] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:13.411362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 42/79] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:16:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:13.411513 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac9d4a-01a3-4579-b9e9-53afe0fc712d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:13.411600 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ad0d2-7d16-4caf-98a8-b11878c6f754 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:13.510704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ad0d2-7d16-4caf-98a8-b11878c6f754 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:13.511284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac9d4a-01a3-4579-b9e9-53afe0fc712d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:13.544665 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c22de-dffd-4c50-a093-8a568594e47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:13.544850 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85afcaa-6065-4bf8-8df1-51abb6d18349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:13.545274 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c22de-dffd-4c50-a093-8a568594e47a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:13.545366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85afcaa-6065-4bf8-8df1-51abb6d18349 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:13.545556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c22de-dffd-4c50-a093-8a568594e47a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:13.545650 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85afcaa-6065-4bf8-8df1-51abb6d18349 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:13.545832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c22de-dffd-4c50-a093-8a568594e47a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:13.545916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85afcaa-6065-4bf8-8df1-51abb6d18349 None admin] PATH_INFO: `/v3/users/09247daecb7c4c7e95eb12e5544033af` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:13.547022 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85afcaa-6065-4bf8-8df1-51abb6d18349 None admin] RBAC: Authorizing `identity:get_user(user_id=09247daecb7c4c7e95eb12e5544033af)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:13.548512 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85afcaa-6065-4bf8-8df1-51abb6d18349 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:13.549176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:13.550074 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 38/80] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:13 2022] GET /identity/v3/users/09247daecb7c4c7e95eb12e5544033af => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:13.550836 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85afcaa-6065-4bf8-8df1-51abb6d18349 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:13.599022 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:13.612563 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c22de-dffd-4c50-a093-8a568594e47a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:13.613969 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c22de-dffd-4c50-a093-8a568594e47a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:13.653429 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85afcaa-6065-4bf8-8df1-51abb6d18349 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:13.686365 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6285a32-8a0d-4d70-83c3-4645d8b3e7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:13.687022 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6285a32-8a0d-4d70-83c3-4645d8b3e7bf None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:13.687803 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6285a32-8a0d-4d70-83c3-4645d8b3e7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:13.687803 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6285a32-8a0d-4d70-83c3-4645d8b3e7bf None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:13.688243 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6285a32-8a0d-4d70-83c3-4645d8b3e7bf None admin] RBAC: Adding query filter params (name=member) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:13.688572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6285a32-8a0d-4d70-83c3-4645d8b3e7bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:13.689935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6285a32-8a0d-4d70-83c3-4645d8b3e7bf None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:13.697753 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 39/81] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:13.698531 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6285a32-8a0d-4d70-83c3-4645d8b3e7bf None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:13.714669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 43/82] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:13.719553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c22de-dffd-4c50-a093-8a568594e47a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:13.749293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:13.806375 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6285a32-8a0d-4d70-83c3-4645d8b3e7bf None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:13.813658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:13.819742 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c22de-dffd-4c50-a093-8a568594e47a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:13.840950 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f894bf-7c1a-42cf-824f-9216ceacfc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:13.841969 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f894bf-7c1a-42cf-824f-9216ceacfc27 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:13.842470 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f894bf-7c1a-42cf-824f-9216ceacfc27 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:13.842985 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f894bf-7c1a-42cf-824f-9216ceacfc27 None admin] PATH_INFO: `/v3/users/3e16364861b54675955ca4da10f6c281` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:13.844327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f894bf-7c1a-42cf-824f-9216ceacfc27 None admin] RBAC: Authorizing `identity:get_user(user_id=3e16364861b54675955ca4da10f6c281)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:13.845805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f894bf-7c1a-42cf-824f-9216ceacfc27 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:13.847561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 40/83] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:13 2022] GET /identity/v3/users/3e16364861b54675955ca4da10f6c281 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:13.848226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f894bf-7c1a-42cf-824f-9216ceacfc27 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:13.853352 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11267abb-fd47-4f57-aa20-ec78c37e29f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:13.853978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11267abb-fd47-4f57-aa20-ec78c37e29f4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:13.854257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11267abb-fd47-4f57-aa20-ec78c37e29f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:13.854533 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11267abb-fd47-4f57-aa20-ec78c37e29f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:13.855621 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11267abb-fd47-4f57-aa20-ec78c37e29f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:13.857070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11267abb-fd47-4f57-aa20-ec78c37e29f4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:13.858624 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 44/84] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:16:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:13.858624 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11267abb-fd47-4f57-aa20-ec78c37e29f4 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:13.949951 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f894bf-7c1a-42cf-824f-9216ceacfc27 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:13.955249 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11267abb-fd47-4f57-aa20-ec78c37e29f4 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:13.957543 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:13.982786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b72499-114e-40bb-b74b-859d0c6ff709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:13.984101 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b72499-114e-40bb-b74b-859d0c6ff709 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:13.984430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b72499-114e-40bb-b74b-859d0c6ff709 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:13.984709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b72499-114e-40bb-b74b-859d0c6ff709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:13.988507 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46542388-a2a9-485f-bee0-7b62b5682606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:13.989133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46542388-a2a9-485f-bee0-7b62b5682606 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:13.989416 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46542388-a2a9-485f-bee0-7b62b5682606 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:13.989694 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46542388-a2a9-485f-bee0-7b62b5682606 None admin] PATH_INFO: `/v3/users/3e16364861b54675955ca4da10f6c281` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:13.990814 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46542388-a2a9-485f-bee0-7b62b5682606 None admin] RBAC: Authorizing `identity:get_user(user_id=3e16364861b54675955ca4da10f6c281)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:13.992240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46542388-a2a9-485f-bee0-7b62b5682606 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:13.993838 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 45/85] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:13 2022] GET /identity/v3/users/3e16364861b54675955ca4da10f6c281 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:13.993838 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46542388-a2a9-485f-bee0-7b62b5682606 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:14.026288 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:14.051993 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b72499-114e-40bb-b74b-859d0c6ff709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:14.053515 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b72499-114e-40bb-b74b-859d0c6ff709 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:14.094502 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46542388-a2a9-485f-bee0-7b62b5682606 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:14.128610 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31bd2e-5cf5-4f8e-9d58-293695edbbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:14.129243 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31bd2e-5cf5-4f8e-9d58-293695edbbf0 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:14.129525 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31bd2e-5cf5-4f8e-9d58-293695edbbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:14.129807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31bd2e-5cf5-4f8e-9d58-293695edbbf0 None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:14.130926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31bd2e-5cf5-4f8e-9d58-293695edbbf0 None admin] RBAC: Authorizing `identity:get_project(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:14.132424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31bd2e-5cf5-4f8e-9d58-293695edbbf0 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:14.134056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 46/86] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:13 2022] GET /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:14.134823 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31bd2e-5cf5-4f8e-9d58-293695edbbf0 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:14.151966 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 41/87] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:14.152840 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b72499-114e-40bb-b74b-859d0c6ff709 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:14.176259 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:14.226782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:14.232389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31bd2e-5cf5-4f8e-9d58-293695edbbf0 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:14.250019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b72499-114e-40bb-b74b-859d0c6ff709 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:14.265294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f333b0b-60e9-4d5c-a0c0-0b10ddfb1520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:14.265896 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f333b0b-60e9-4d5c-a0c0-0b10ddfb1520 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:14.266172 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f333b0b-60e9-4d5c-a0c0-0b10ddfb1520 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:14.266446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f333b0b-60e9-4d5c-a0c0-0b10ddfb1520 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:14.284211 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb70f35-d1e8-4421-a8b4-e9532cad2090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:14.284847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb70f35-d1e8-4421-a8b4-e9532cad2090 None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:14.285130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb70f35-d1e8-4421-a8b4-e9532cad2090 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:14.285406 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb70f35-d1e8-4421-a8b4-e9532cad2090 None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:14.286055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb70f35-d1e8-4421-a8b4-e9532cad2090 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:14.287506 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb70f35-d1e8-4421-a8b4-e9532cad2090 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:14.331552 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f333b0b-60e9-4d5c-a0c0-0b10ddfb1520 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:14.333065 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f333b0b-60e9-4d5c-a0c0-0b10ddfb1520 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:14.364257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 42/88] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 27 16:16:14 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:16:14.365219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb70f35-d1e8-4421-a8b4-e9532cad2090 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:14.373482 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:14.454868 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 47/89] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:14.456605 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f333b0b-60e9-4d5c-a0c0-0b10ddfb1520 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:14.483160 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb70f35-d1e8-4421-a8b4-e9532cad2090 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:14.513930 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:14.520485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af55dc-bf51-4893-9135-bdb52e71c28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:14.521116 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af55dc-bf51-4893-9135-bdb52e71c28a None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:14.521400 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af55dc-bf51-4893-9135-bdb52e71c28a None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:14.521680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af55dc-bf51-4893-9135-bdb52e71c28a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:14.588625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f333b0b-60e9-4d5c-a0c0-0b10ddfb1520 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:14.602624 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af55dc-bf51-4893-9135-bdb52e71c28a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:14.604315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af55dc-bf51-4893-9135-bdb52e71c28a None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:14.638213 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efaf19-d350-4eb3-b1f6-a12855b4b679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:14.638843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efaf19-d350-4eb3-b1f6-a12855b4b679 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:14.639126 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efaf19-d350-4eb3-b1f6-a12855b4b679 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:14.639400 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efaf19-d350-4eb3-b1f6-a12855b4b679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:14.640943 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efaf19-d350-4eb3-b1f6-a12855b4b679 None admin] RBAC: Adding query filter params (role.id=e7e5b03d7a3d404f841a8341244d5d78, scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9, user.id=3e16364861b54675955ca4da10f6c281) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:14.641046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efaf19-d350-4eb3-b1f6-a12855b4b679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:14.642507 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efaf19-d350-4eb3-b1f6-a12855b4b679 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:14.654054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 48/90] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:16:14 2022] GET /identity/v3/role_assignments?user.id=3e16364861b54675955ca4da10f6c281&scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9&role.id=e7e5b03d7a3d404f841a8341244d5d78 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:14.654985 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efaf19-d350-4eb3-b1f6-a12855b4b679 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:14.659297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:14.733095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 43/91] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:14.733806 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af55dc-bf51-4893-9135-bdb52e71c28a None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:14.784437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:14.798727 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efaf19-d350-4eb3-b1f6-a12855b4b679 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:14.839822 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5af30-def3-4ef7-a5e9-ec1be087cfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:14.840975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5af30-def3-4ef7-a5e9-ec1be087cfce None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:14.841544 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5af30-def3-4ef7-a5e9-ec1be087cfce None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:14.842023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5af30-def3-4ef7-a5e9-ec1be087cfce None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:14.843584 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5af30-def3-4ef7-a5e9-ec1be087cfce None admin] RBAC: Authorizing `identity:get_project(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:14.845587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5af30-def3-4ef7-a5e9-ec1be087cfce None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:14.847887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 49/92] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:14 2022] GET /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:14.848971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5af30-def3-4ef7-a5e9-ec1be087cfce None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:14.867067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af55dc-bf51-4893-9135-bdb52e71c28a None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:14.903587 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c0b46-27fa-4b5e-a7f0-d57d6cd9effe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:14.904212 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c0b46-27fa-4b5e-a7f0-d57d6cd9effe None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:14.904527 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c0b46-27fa-4b5e-a7f0-d57d6cd9effe None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:14.904806 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c0b46-27fa-4b5e-a7f0-d57d6cd9effe None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:14.906008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c0b46-27fa-4b5e-a7f0-d57d6cd9effe None admin] RBAC: Authorizing `identity:get_project(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:14.907478 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c0b46-27fa-4b5e-a7f0-d57d6cd9effe None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:14.909158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 44/93] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:14 2022] GET /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:14.910016 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c0b46-27fa-4b5e-a7f0-d57d6cd9effe None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:14.930161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:14.964741 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5af30-def3-4ef7-a5e9-ec1be087cfce None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:15.002927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19852e5f-f0ca-4f02-b40b-5e38ad562024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:15.004090 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19852e5f-f0ca-4f02-b40b-5e38ad562024 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:15.004605 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19852e5f-f0ca-4f02-b40b-5e38ad562024 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:15.005117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19852e5f-f0ca-4f02-b40b-5e38ad562024 None admin] PATH_INFO: `/v3/projects/1a2f99d80a494b2da5a4f132e65decfa` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:15.006726 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19852e5f-f0ca-4f02-b40b-5e38ad562024 None admin] RBAC: Authorizing `identity:get_project(project_id=1a2f99d80a494b2da5a4f132e65decfa)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:15.009078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19852e5f-f0ca-4f02-b40b-5e38ad562024 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:15.009559 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:15.012098 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 50/94] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:14 2022] GET /identity/v3/projects/1a2f99d80a494b2da5a4f132e65decfa => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:15.013134 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19852e5f-f0ca-4f02-b40b-5e38ad562024 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:15.017701 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c0b46-27fa-4b5e-a7f0-d57d6cd9effe None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:15.058939 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5421b3-b7df-4dcd-ad90-804aec9a0aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:15.060370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5421b3-b7df-4dcd-ad90-804aec9a0aad None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:15.060860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5421b3-b7df-4dcd-ad90-804aec9a0aad None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:15.061348 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5421b3-b7df-4dcd-ad90-804aec9a0aad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:15.063240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5421b3-b7df-4dcd-ad90-804aec9a0aad None admin] RBAC: Adding query filter params (role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9, user.id=09247daecb7c4c7e95eb12e5544033af) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:15.064117 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5421b3-b7df-4dcd-ad90-804aec9a0aad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:15.066148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5421b3-b7df-4dcd-ad90-804aec9a0aad None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:15.073016 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 45/95] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:16:14 2022] GET /identity/v3/role_assignments?user.id=09247daecb7c4c7e95eb12e5544033af&scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:15.074159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5421b3-b7df-4dcd-ad90-804aec9a0aad None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:15.142462 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19852e5f-f0ca-4f02-b40b-5e38ad562024 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:15.194194 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f71ed-2c49-47e0-8351-637c2b48419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:15.195185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f71ed-2c49-47e0-8351-637c2b48419c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:15.195851 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f71ed-2c49-47e0-8351-637c2b48419c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:15.196908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f71ed-2c49-47e0-8351-637c2b48419c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:15.199651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f71ed-2c49-47e0-8351-637c2b48419c None admin] RBAC: Adding query filter params (role.id=f60b6d7b309a4537a233198456c7aa34, scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9, user.id=3e16364861b54675955ca4da10f6c281) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:15.199989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f71ed-2c49-47e0-8351-637c2b48419c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:15.201828 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f71ed-2c49-47e0-8351-637c2b48419c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:15.203188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5421b3-b7df-4dcd-ad90-804aec9a0aad None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:15.209290 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 51/96] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:16:15 2022] GET /identity/v3/role_assignments?user.id=3e16364861b54675955ca4da10f6c281&scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9&role.id=f60b6d7b309a4537a233198456c7aa34 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:15.244086 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9f311-3a5e-447e-9e57-83a1b8e76320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:15.245137 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9f311-3a5e-447e-9e57-83a1b8e76320 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:15.245624 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9f311-3a5e-447e-9e57-83a1b8e76320 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:15.246104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9f311-3a5e-447e-9e57-83a1b8e76320 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:15.247064 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9f311-3a5e-447e-9e57-83a1b8e76320 None admin] RBAC: Adding query filter params (role.id=e7e5b03d7a3d404f841a8341244d5d78, scope.project.id=1a2f99d80a494b2da5a4f132e65decfa, user.id=3e16364861b54675955ca4da10f6c281) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:15.247629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9f311-3a5e-447e-9e57-83a1b8e76320 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:15.250069 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9f311-3a5e-447e-9e57-83a1b8e76320 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:15.256970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 46/97] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:16:15 2022] GET /identity/v3/role_assignments?user.id=3e16364861b54675955ca4da10f6c281&scope.project.id=1a2f99d80a494b2da5a4f132e65decfa&role.id=e7e5b03d7a3d404f841a8341244d5d78 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:17.310873 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9109ba5-89bc-4150-9e13-bd6afa07bea6 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:17.311475 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9109ba5-89bc-4150-9e13-bd6afa07bea6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:17.311475 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9109ba5-89bc-4150-9e13-bd6afa07bea6 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:17.312850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 52/98] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:17.318083 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139e8e9-8c58-4374-a186-aefe29428e82 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:17.318489 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139e8e9-8c58-4374-a186-aefe29428e82 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:17.318706 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139e8e9-8c58-4374-a186-aefe29428e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:17.342243 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-6139e8e9-8c58-4374-a186-aefe29428e82 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:17.343687 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6139e8e9-8c58-4374-a186-aefe29428e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:17.370938 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:17.517011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 47/99] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:17.806772 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e216d7-f302-4668-99e4-a29fa7601646 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:17.807071 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e216d7-f302-4668-99e4-a29fa7601646 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:17.807355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e216d7-f302-4668-99e4-a29fa7601646 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:17.808854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 53/100] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:17.819167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9a6cf-def3-4eb1-a5de-5ddc71a35640 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:17.819532 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9a6cf-def3-4eb1-a5de-5ddc71a35640 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:17.819822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9a6cf-def3-4eb1-a5de-5ddc71a35640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:17.856738 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-4cc9a6cf-def3-4eb1-a5de-5ddc71a35640 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:17.857984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4cc9a6cf-def3-4eb1-a5de-5ddc71a35640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:17.942207 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02798e1d-3bdf-4ed8-8069-32d0139e593a None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:17.942537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02798e1d-3bdf-4ed8-8069-32d0139e593a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:17.942772 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02798e1d-3bdf-4ed8-8069-32d0139e593a None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:17.944117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 54/101] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:17.949661 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa01385-edba-4e75-95bc-092cd92a1b3a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:17.949951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa01385-edba-4e75-95bc-092cd92a1b3a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:17.950232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa01385-edba-4e75-95bc-092cd92a1b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:17.957806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:17.982991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 48/102] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:17.984466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-7aa01385-edba-4e75-95bc-092cd92a1b3a None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:17.985689 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7aa01385-edba-4e75-95bc-092cd92a1b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:17.993175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82824e6-be1e-4125-878d-92600698b8c8 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:17.993471 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82824e6-be1e-4125-878d-92600698b8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:17.993753 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82824e6-be1e-4125-878d-92600698b8c8 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:18.000899 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 49/103] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:16:18.006038 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca35f0f-76e9-46c9-bd4a-efa0e047c233 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:18.006326 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca35f0f-76e9-46c9-bd4a-efa0e047c233 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:18.006607 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca35f0f-76e9-46c9-bd4a-efa0e047c233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:18.033816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-0ca35f0f-76e9-46c9-bd4a-efa0e047c233 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:18.035025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-0ca35f0f-76e9-46c9-bd4a-efa0e047c233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:18.111168 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 55/104] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:16:18.111954 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa01385-edba-4e75-95bc-092cd92a1b3a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:18.165221 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 50/105] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:16:18.213205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa01385-edba-4e75-95bc-092cd92a1b3a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:18.248927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386aab2-1c39-4617-88c3-2085fc2b6a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:18.249593 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386aab2-1c39-4617-88c3-2085fc2b6a24 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:18.249874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386aab2-1c39-4617-88c3-2085fc2b6a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:18.250152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386aab2-1c39-4617-88c3-2085fc2b6a24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:18.252309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:18.265486 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386aab2-1c39-4617-88c3-2085fc2b6a24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:18.270418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-f386aab2-1c39-4617-88c3-2085fc2b6a24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:18.270418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:18.270418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:18.270418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:18.270418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:18.270418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:18.270418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:18.270418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:18.270418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:18.270418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:18.270418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:18.270418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:18.270418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:18.270418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:18.270418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:18.270418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:18.272171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:18.272171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:18.272171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:18.272171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:18.272171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:18.272171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:18.272171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:18.272171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:18.272171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:18.272171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:18.272171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:18.272171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:18.272171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:18.272171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:18.272171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:18.272171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:18.273923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:18.273923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:18.273923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:18.273923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:18.273923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:18.273923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:18.273923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:18.273923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:18.273923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:18.273923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:18.273923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:18.273923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:18.273923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 56/106] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:18.279028 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca35f0f-76e9-46c9-bd4a-efa0e047c233 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:18.304000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:18.414020 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca35f0f-76e9-46c9-bd4a-efa0e047c233 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:18.450228 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54670af-f254-4958-b920-75360253ab5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:18.451180 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54670af-f254-4958-b920-75360253ab5f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:18.451685 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54670af-f254-4958-b920-75360253ab5f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:18.452212 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54670af-f254-4958-b920-75360253ab5f None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:18.453589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54670af-f254-4958-b920-75360253ab5f None admin] RBAC: Adding query filter params (name=member) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:18.454093 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54670af-f254-4958-b920-75360253ab5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:18.455673 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54670af-f254-4958-b920-75360253ab5f None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:18.464176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 51/107] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:18.471417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386aab2-1c39-4617-88c3-2085fc2b6a24 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:18.505813 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54670af-f254-4958-b920-75360253ab5f None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:18.625112 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:18.627796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386aab2-1c39-4617-88c3-2085fc2b6a24 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:18.651273 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54670af-f254-4958-b920-75360253ab5f None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:18.675768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3ad42-ed38-46b0-afce-fcc57b3711f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:18.676833 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3ad42-ed38-46b0-afce-fcc57b3711f4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:18.677317 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3ad42-ed38-46b0-afce-fcc57b3711f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:18.678254 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3ad42-ed38-46b0-afce-fcc57b3711f4 None admin] PATH_INFO: `/v3/users/3e16364861b54675955ca4da10f6c281` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:18.679819 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3ad42-ed38-46b0-afce-fcc57b3711f4 None admin] RBAC: Authorizing `identity:get_user(user_id=3e16364861b54675955ca4da10f6c281)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:18.682354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3ad42-ed38-46b0-afce-fcc57b3711f4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:18.684692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 57/108] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:18 2022] GET /identity/v3/users/3e16364861b54675955ca4da10f6c281 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:18.685996 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3ad42-ed38-46b0-afce-fcc57b3711f4 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:18.693640 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8155bc-d9d9-428d-af0c-e3f5306e9f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:18.694278 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8155bc-d9d9-428d-af0c-e3f5306e9f43 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:18.694560 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8155bc-d9d9-428d-af0c-e3f5306e9f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:18.694837 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8155bc-d9d9-428d-af0c-e3f5306e9f43 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:18.708977 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8155bc-d9d9-428d-af0c-e3f5306e9f43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:18.717075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-eb8155bc-d9d9-428d-af0c-e3f5306e9f43 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 16:16:18.717075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:18.717075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:18.717075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:18.717075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:18.717075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:18.717075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:18.717075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:18.717075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:18.717075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:18.717075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:18.717075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:18.717075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:18.717075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:18.717075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:18.717075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:18.718536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:18.718536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:18.718536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:18.718536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:18.718536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:18.718536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:18.718536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:18.718536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:18.718536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:18.718536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:18.718536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:18.718536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:18.718536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:18.718536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:18.718536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:18.718536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:18.719291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:18.719291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:18.719291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:18.719291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:18.719291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:18.719291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:18.719291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:18.719291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:18.719291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:18.719291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:18.719291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 16:16:18.719291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:18.723716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 52/109] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:16:18.724598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8155bc-d9d9-428d-af0c-e3f5306e9f43 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:18.770468 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:18.818130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3ad42-ed38-46b0-afce-fcc57b3711f4 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:18.848195 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8155bc-d9d9-428d-af0c-e3f5306e9f43 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:18.855441 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ff8fa-b4c6-44e1-95ae-662754fc4c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:18.856275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ff8fa-b4c6-44e1-95ae-662754fc4c25 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:18.856594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ff8fa-b4c6-44e1-95ae-662754fc4c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:18.856875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ff8fa-b4c6-44e1-95ae-662754fc4c25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:18.867493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ff8fa-b4c6-44e1-95ae-662754fc4c25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:18.872458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-ac7ff8fa-b4c6-44e1-95ae-662754fc4c25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:18.872458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:18.872458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:18.872458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:18.872458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:18.872458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:18.872458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:18.872458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:18.872458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:18.872458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:18.872458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:18.872458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:18.872458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:18.872458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:18.872458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:18.872458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:18.873522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:18.873522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:18.873522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:18.873522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:18.873522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:18.873522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:18.873522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:18.873522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:18.873522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:18.873522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:18.873522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:18.873522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:18.873522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:18.873522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:18.873522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:18.873522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:18.874333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:18.874333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:18.874333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:18.874333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:18.874333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:18.874333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:18.874333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:18.874333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:18.874333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:18.874333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:18.874333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:18.874333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:18.874333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 58/110] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:18.875057 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ff8fa-b4c6-44e1-95ae-662754fc4c25 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:18.887085 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54452ad1-7431-4972-ac91-5db5ba99c08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:18.887807 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54452ad1-7431-4972-ac91-5db5ba99c08d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:18.888103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54452ad1-7431-4972-ac91-5db5ba99c08d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:18.888409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54452ad1-7431-4972-ac91-5db5ba99c08d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:18.889532 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54452ad1-7431-4972-ac91-5db5ba99c08d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:18.891534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54452ad1-7431-4972-ac91-5db5ba99c08d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:18.893143 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 53/111] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:16:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:18.893975 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54452ad1-7431-4972-ac91-5db5ba99c08d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:18.902672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:18.976091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ff8fa-b4c6-44e1-95ae-662754fc4c25 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:18.992602 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54452ad1-7431-4972-ac91-5db5ba99c08d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:18.998147 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:19.009440 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3907e-d03c-4eed-9673-a7db8b1da933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:19.010067 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3907e-d03c-4eed-9673-a7db8b1da933 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:19.010346 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3907e-d03c-4eed-9673-a7db8b1da933 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:19.010620 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3907e-d03c-4eed-9673-a7db8b1da933 None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:19.012538 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3907e-d03c-4eed-9673-a7db8b1da933 None admin] RBAC: Authorizing `identity:get_project(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:19.013342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3907e-d03c-4eed-9673-a7db8b1da933 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:19.015482 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 59/112] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:18 2022] GET /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:19.016602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f97e2-3a26-4df0-87ce-f23b20cffd86 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:19.016882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f97e2-3a26-4df0-87ce-f23b20cffd86 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:19.017154 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f97e2-3a26-4df0-87ce-f23b20cffd86 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:19.018342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 60/113] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:19.019341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78795b78-3239-40eb-871f-9ecb66d11be3 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:19.019623 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78795b78-3239-40eb-871f-9ecb66d11be3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:19.019927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78795b78-3239-40eb-871f-9ecb66d11be3 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:19.021326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 61/114] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:19.021938 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78795b78-3239-40eb-871f-9ecb66d11be3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:19.033803 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c04ab7-8bca-4a3c-aa17-ecfee7e7b1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:19.034416 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c04ab7-8bca-4a3c-aa17-ecfee7e7b1fd None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:19.034700 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c04ab7-8bca-4a3c-aa17-ecfee7e7b1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:19.034979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c04ab7-8bca-4a3c-aa17-ecfee7e7b1fd None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:19.035646 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c04ab7-8bca-4a3c-aa17-ecfee7e7b1fd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:19.035953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c04ab7-8bca-4a3c-aa17-ecfee7e7b1fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:19.037364 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c04ab7-8bca-4a3c-aa17-ecfee7e7b1fd None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:19.045683 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 54/115] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:19.046474 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c04ab7-8bca-4a3c-aa17-ecfee7e7b1fd None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:19.110799 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:19.127220 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78795b78-3239-40eb-871f-9ecb66d11be3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:19.143010 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c04ab7-8bca-4a3c-aa17-ecfee7e7b1fd None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:19.160038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07904726-a085-4d4c-bb5e-956453e5efca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:19.160699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07904726-a085-4d4c-bb5e-956453e5efca None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:19.160986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07904726-a085-4d4c-bb5e-956453e5efca None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:19.161269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07904726-a085-4d4c-bb5e-956453e5efca None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:19.161923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07904726-a085-4d4c-bb5e-956453e5efca None admin] RBAC: Adding query filter params (name=member) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:19.162229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07904726-a085-4d4c-bb5e-956453e5efca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:19.163618 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07904726-a085-4d4c-bb5e-956453e5efca None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:19.172631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 62/116] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:19.173395 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07904726-a085-4d4c-bb5e-956453e5efca None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:19.180248 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8857ce-9bc8-47e9-a7bd-fd1fa6330d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:19.180903 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8857ce-9bc8-47e9-a7bd-fd1fa6330d12 None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:19.181189 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8857ce-9bc8-47e9-a7bd-fd1fa6330d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:19.181471 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8857ce-9bc8-47e9-a7bd-fd1fa6330d12 None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:19.182129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8857ce-9bc8-47e9-a7bd-fd1fa6330d12 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:19.183586 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8857ce-9bc8-47e9-a7bd-fd1fa6330d12 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:19.226814 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:19.264901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 55/117] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 27 16:16:19 2022] POST /identity/v3/projects => generated 302 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:16:19.272627 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07904726-a085-4d4c-bb5e-956453e5efca None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:19.274343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc82ae1-d0bd-45c8-bb39-933bb2ab2780 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:19.274760 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc82ae1-d0bd-45c8-bb39-933bb2ab2780 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:19.275045 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc82ae1-d0bd-45c8-bb39-933bb2ab2780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:19.294452 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-adc82ae1-d0bd-45c8-bb39-933bb2ab2780 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:19.295724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-adc82ae1-d0bd-45c8-bb39-933bb2ab2780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:19.315019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16b0aa-f212-4812-bf91-c3563fc8172e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:19.316455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16b0aa-f212-4812-bf91-c3563fc8172e None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:19.316928 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16b0aa-f212-4812-bf91-c3563fc8172e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:19.317385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16b0aa-f212-4812-bf91-c3563fc8172e None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9/users/3e16364861b54675955ca4da10f6c281/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:19.320850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16b0aa-f212-4812-bf91-c3563fc8172e None admin] RBAC: Authorizing `identity:create_grant(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9, user_id=3e16364861b54675955ca4da10f6c281, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:19.323145 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16b0aa-f212-4812-bf91-c3563fc8172e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:19.369832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 56/118] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:19.371184 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c1e46-eed5-45ac-a646-69e14f137c84 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:19.371474 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c1e46-eed5-45ac-a646-69e14f137c84 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:19.371750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c1e46-eed5-45ac-a646-69e14f137c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:19.391453 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-612c1e46-eed5-45ac-a646-69e14f137c84 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:19.392787 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-612c1e46-eed5-45ac-a646-69e14f137c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:19.428317 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 63/119] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:16:19 2022] PUT /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9/users/3e16364861b54675955ca4da10f6c281/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:16:19.428999 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16b0aa-f212-4812-bf91-c3563fc8172e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:19.467357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:19.504000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 57/120] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:19.505133 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c1e46-eed5-45ac-a646-69e14f137c84 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:19.579334 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16b0aa-f212-4812-bf91-c3563fc8172e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:19.596465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:19.619413 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951b6e6-990a-4695-bb82-c8eae6adbbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:19.620918 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951b6e6-990a-4695-bb82-c8eae6adbbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:19.621403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951b6e6-990a-4695-bb82-c8eae6adbbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:19.621874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951b6e6-990a-4695-bb82-c8eae6adbbf1 None admin] PATH_INFO: `/v3/users/3660243f97a04ba387d32da12494d2b3` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:19.637199 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951b6e6-990a-4695-bb82-c8eae6adbbf1 None admin] RBAC: Authorizing `identity:get_user(user_id=3660243f97a04ba387d32da12494d2b3)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:19.640574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951b6e6-990a-4695-bb82-c8eae6adbbf1 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:19.642770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 64/121] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:19 2022] GET /identity/v3/users/3660243f97a04ba387d32da12494d2b3 => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:19.649307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951b6e6-990a-4695-bb82-c8eae6adbbf1 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:19.658930 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c1e46-eed5-45ac-a646-69e14f137c84 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:19.707948 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f699e10-8b6e-4547-8efd-1134389b1aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:19.708945 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f699e10-8b6e-4547-8efd-1134389b1aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:19.709233 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f699e10-8b6e-4547-8efd-1134389b1aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:19.709528 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f699e10-8b6e-4547-8efd-1134389b1aa1 None admin] PATH_INFO: `/v3/users/3e16364861b54675955ca4da10f6c281` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:19.712045 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f699e10-8b6e-4547-8efd-1134389b1aa1 None admin] RBAC: Authorizing `identity:get_user(user_id=3e16364861b54675955ca4da10f6c281)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:19.713665 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f699e10-8b6e-4547-8efd-1134389b1aa1 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:19.716264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 58/122] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:19 2022] GET /identity/v3/users/3e16364861b54675955ca4da10f6c281 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:19.722673 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f699e10-8b6e-4547-8efd-1134389b1aa1 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:19.805399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:19.809382 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951b6e6-990a-4695-bb82-c8eae6adbbf1 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:19.883453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06a19c-9326-4fe2-b742-cb62db378dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:19.884086 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06a19c-9326-4fe2-b742-cb62db378dec None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:19.884397 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06a19c-9326-4fe2-b742-cb62db378dec None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:19.884682 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06a19c-9326-4fe2-b742-cb62db378dec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:19.910029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f699e10-8b6e-4547-8efd-1134389b1aa1 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:19.941025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:19.945905 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae4fc2-6c4c-43a1-83e3-fbdc965fb7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:19.946552 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae4fc2-6c4c-43a1-83e3-fbdc965fb7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:19.946894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae4fc2-6c4c-43a1-83e3-fbdc965fb7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:19.947172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae4fc2-6c4c-43a1-83e3-fbdc965fb7b8 None admin] PATH_INFO: `/v3/projects/1a2f99d80a494b2da5a4f132e65decfa` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:19.948440 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae4fc2-6c4c-43a1-83e3-fbdc965fb7b8 None admin] RBAC: Authorizing `identity:get_project(project_id=1a2f99d80a494b2da5a4f132e65decfa)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:19.955108 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae4fc2-6c4c-43a1-83e3-fbdc965fb7b8 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:19.955108 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 59/123] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:19 2022] GET /identity/v3/projects/1a2f99d80a494b2da5a4f132e65decfa => generated 312 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:19.958270 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae4fc2-6c4c-43a1-83e3-fbdc965fb7b8 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:19.972722 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06a19c-9326-4fe2-b742-cb62db378dec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:19.974954 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06a19c-9326-4fe2-b742-cb62db378dec None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:20.062183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae4fc2-6c4c-43a1-83e3-fbdc965fb7b8 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:20.080180 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:20.099153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2607347-aa9c-47d8-8d18-e0717b17ae5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:20.099810 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2607347-aa9c-47d8-8d18-e0717b17ae5e None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:20.100231 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2607347-aa9c-47d8-8d18-e0717b17ae5e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:20.100556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2607347-aa9c-47d8-8d18-e0717b17ae5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:20.105782 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 65/124] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:20.106650 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06a19c-9326-4fe2-b742-cb62db378dec None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:20.116413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2607347-aa9c-47d8-8d18-e0717b17ae5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:20.122021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-a2607347-aa9c-47d8-8d18-e0717b17ae5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:16:20.122021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:20.122021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:20.122021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:20.122021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:20.122021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:20.122021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:20.122021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:20.122021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:20.122021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:20.122021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:20.122021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:20.122021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:20.122021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:20.122021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:20.122021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:20.122896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:20.122896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:20.122896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:20.122896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:20.122896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:20.122896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:20.122896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:20.122896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:20.122896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:20.122896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:20.122896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:20.122896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:20.122896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:20.122896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:20.122896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:20.122896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:20.125026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:20.125026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:20.125026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:20.125026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:20.125026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:20.125026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:20.125026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:20.125026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:20.125026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:20.125026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:20.125026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:16:20.125026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:20.125026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 60/125] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:16:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:20.125026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2607347-aa9c-47d8-8d18-e0717b17ae5e None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:20.195668 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:20.228730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2607347-aa9c-47d8-8d18-e0717b17ae5e None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:20.232689 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06a19c-9326-4fe2-b742-cb62db378dec None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:20.265311 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b021cf0-9d40-42dc-9e34-8a8b4be8e6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:20.265769 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b021cf0-9d40-42dc-9e34-8a8b4be8e6d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:20.266049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b021cf0-9d40-42dc-9e34-8a8b4be8e6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:20.266324 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b021cf0-9d40-42dc-9e34-8a8b4be8e6d9 None admin] PATH_INFO: `/v3/projects/1a2f99d80a494b2da5a4f132e65decfa/users/3e16364861b54675955ca4da10f6c281/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:20.268328 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b021cf0-9d40-42dc-9e34-8a8b4be8e6d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a2f99d80a494b2da5a4f132e65decfa, user_id=3e16364861b54675955ca4da10f6c281, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:20.269841 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b021cf0-9d40-42dc-9e34-8a8b4be8e6d9 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:20.275112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa1295-8be7-4c68-8440-fc420d237c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:20.275753 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa1295-8be7-4c68-8440-fc420d237c9b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:20.276039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa1295-8be7-4c68-8440-fc420d237c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:20.276321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa1295-8be7-4c68-8440-fc420d237c9b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:20.286754 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa1295-8be7-4c68-8440-fc420d237c9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:20.291763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-66aa1295-8be7-4c68-8440-fc420d237c9b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:20.291763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:20.291763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:20.291763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:20.291763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:20.291763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:20.291763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:20.291763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:20.291763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:20.291763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:20.291763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:20.291763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:20.291763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:20.291763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:20.291763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:20.291763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:20.294556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:20.294556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:20.294556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:20.294556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:20.294556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:20.294556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:20.294556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:20.294556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:20.294556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:20.294556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:20.294556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:20.294556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:20.294556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:20.294556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:20.294556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:20.294556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:20.297029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:20.297029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:20.297029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:20.297029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:20.297029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:20.297029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:20.297029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:20.297029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:20.297029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:20.297029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:20.297029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:20.297029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:20.297029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 66/126] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:16:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:20.297029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa1295-8be7-4c68-8440-fc420d237c9b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:20.378681 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 61/127] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:16:20 2022] PUT /identity/v3/projects/1a2f99d80a494b2da5a4f132e65decfa/users/3e16364861b54675955ca4da10f6c281/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:16:20.380114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b021cf0-9d40-42dc-9e34-8a8b4be8e6d9 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:20.409560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa1295-8be7-4c68-8440-fc420d237c9b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:20.432655 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:20.448925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:20.456068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24715060-5a13-4880-b0ef-02d47fb54af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:20.457034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24715060-5a13-4880-b0ef-02d47fb54af5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:20.457572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24715060-5a13-4880-b0ef-02d47fb54af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:20.458126 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24715060-5a13-4880-b0ef-02d47fb54af5 None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:20.459513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24715060-5a13-4880-b0ef-02d47fb54af5 None admin] RBAC: Authorizing `identity:get_project(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:20.461340 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24715060-5a13-4880-b0ef-02d47fb54af5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:20.463713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 67/128] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:20 2022] GET /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:20.464726 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24715060-5a13-4880-b0ef-02d47fb54af5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:20.577631 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b021cf0-9d40-42dc-9e34-8a8b4be8e6d9 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:20.638562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214bb60-ced8-4ce9-8cf9-4c2fd4541ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:20.639105 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214bb60-ced8-4ce9-8cf9-4c2fd4541ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:20.639394 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214bb60-ced8-4ce9-8cf9-4c2fd4541ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:20.639756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214bb60-ced8-4ce9-8cf9-4c2fd4541ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:20.640952 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214bb60-ced8-4ce9-8cf9-4c2fd4541ea1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:20.641265 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214bb60-ced8-4ce9-8cf9-4c2fd4541ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:20.643597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214bb60-ced8-4ce9-8cf9-4c2fd4541ea1 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:20.652362 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 62/129] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:20.653187 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214bb60-ced8-4ce9-8cf9-4c2fd4541ea1 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:20.661861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24715060-5a13-4880-b0ef-02d47fb54af5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:20.700737 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bce5e9-3c0e-4000-a382-407f2c634e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:20.701778 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bce5e9-3c0e-4000-a382-407f2c634e04 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:20.702818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bce5e9-3c0e-4000-a382-407f2c634e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:20.703294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bce5e9-3c0e-4000-a382-407f2c634e04 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:20.704377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bce5e9-3c0e-4000-a382-407f2c634e04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:20.704902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bce5e9-3c0e-4000-a382-407f2c634e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:20.706596 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bce5e9-3c0e-4000-a382-407f2c634e04 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:20.715831 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 68/130] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:16:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:20.717035 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bce5e9-3c0e-4000-a382-407f2c634e04 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:20.762947 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:20.767197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214bb60-ced8-4ce9-8cf9-4c2fd4541ea1 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:20.783769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:20.814297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d7c09-a83b-4cfc-8b98-7b07b71d8b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:20.814939 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d7c09-a83b-4cfc-8b98-7b07b71d8b5c None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:20.815313 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d7c09-a83b-4cfc-8b98-7b07b71d8b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:20.815571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d7c09-a83b-4cfc-8b98-7b07b71d8b5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:20.816319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d7c09-a83b-4cfc-8b98-7b07b71d8b5c None admin] RBAC: Adding query filter params (role.id=018bcecca3d84d2d990678f3d1d53886, scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9, user.id=3660243f97a04ba387d32da12494d2b3) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:20.816676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d7c09-a83b-4cfc-8b98-7b07b71d8b5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:20.818156 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d7c09-a83b-4cfc-8b98-7b07b71d8b5c None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:20.828103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 63/131] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:16:20 2022] GET /identity/v3/role_assignments?user.id=3660243f97a04ba387d32da12494d2b3&scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9&role.id=018bcecca3d84d2d990678f3d1d53886 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:20.829104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d7c09-a83b-4cfc-8b98-7b07b71d8b5c None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:20.832446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bce5e9-3c0e-4000-a382-407f2c634e04 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:20.872391 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95a016-75b2-475b-8a94-a1adf80d06ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:20.873833 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95a016-75b2-475b-8a94-a1adf80d06ac None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:20.873833 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95a016-75b2-475b-8a94-a1adf80d06ac None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:20.874618 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95a016-75b2-475b-8a94-a1adf80d06ac None admin] PATH_INFO: `/v3/users/09247daecb7c4c7e95eb12e5544033af` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:20.875978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95a016-75b2-475b-8a94-a1adf80d06ac None admin] RBAC: Authorizing `identity:get_user(user_id=09247daecb7c4c7e95eb12e5544033af)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:20.878639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95a016-75b2-475b-8a94-a1adf80d06ac None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:20.879582 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 69/132] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:20 2022] GET /identity/v3/users/09247daecb7c4c7e95eb12e5544033af => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:20.885287 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95a016-75b2-475b-8a94-a1adf80d06ac None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:21.004362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95a016-75b2-475b-8a94-a1adf80d06ac None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:21.007975 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d7c09-a83b-4cfc-8b98-7b07b71d8b5c None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:21.031420 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:21.040957 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb456ea-9626-4985-8458-da5c6d5cf321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:21.044232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb456ea-9626-4985-8458-da5c6d5cf321 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:21.044232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb456ea-9626-4985-8458-da5c6d5cf321 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:21.044232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb456ea-9626-4985-8458-da5c6d5cf321 None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:21.044232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb456ea-9626-4985-8458-da5c6d5cf321 None admin] RBAC: Authorizing `identity:get_project(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:21.046196 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb456ea-9626-4985-8458-da5c6d5cf321 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:21.046831 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8092851-da7d-4f3b-a2b6-e7fadd27f5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:21.047648 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8092851-da7d-4f3b-a2b6-e7fadd27f5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:21.048079 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8092851-da7d-4f3b-a2b6-e7fadd27f5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:21.048361 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 70/133] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:20 2022] GET /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:21.048710 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8092851-da7d-4f3b-a2b6-e7fadd27f5f6 None admin] PATH_INFO: `/v3/users/3e16364861b54675955ca4da10f6c281` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:21.054877 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb456ea-9626-4985-8458-da5c6d5cf321 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:21.055944 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8092851-da7d-4f3b-a2b6-e7fadd27f5f6 None admin] RBAC: Authorizing `identity:get_user(user_id=3e16364861b54675955ca4da10f6c281)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:21.057647 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8092851-da7d-4f3b-a2b6-e7fadd27f5f6 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:21.059519 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 64/134] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:20 2022] GET /identity/v3/users/3e16364861b54675955ca4da10f6c281 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:21.065233 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8092851-da7d-4f3b-a2b6-e7fadd27f5f6 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:21.119114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:21.172125 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb456ea-9626-4985-8458-da5c6d5cf321 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:21.208783 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427510e4-e4f9-4b77-a7d8-6a3050e81bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:21.209825 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427510e4-e4f9-4b77-a7d8-6a3050e81bd3 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:21.210309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427510e4-e4f9-4b77-a7d8-6a3050e81bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:21.210813 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427510e4-e4f9-4b77-a7d8-6a3050e81bd3 None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9/users/09247daecb7c4c7e95eb12e5544033af/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:21.213200 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427510e4-e4f9-4b77-a7d8-6a3050e81bd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9, user_id=09247daecb7c4c7e95eb12e5544033af, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:21.214988 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427510e4-e4f9-4b77-a7d8-6a3050e81bd3 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:21.260180 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8092851-da7d-4f3b-a2b6-e7fadd27f5f6 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:21.287108 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 71/135] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:16:21 2022] PUT /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9/users/09247daecb7c4c7e95eb12e5544033af/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:16:21.326493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a15123-e8aa-43dd-b1e2-92fc1c384175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:21.327175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a15123-e8aa-43dd-b1e2-92fc1c384175 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:21.327458 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a15123-e8aa-43dd-b1e2-92fc1c384175 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:21.327734 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a15123-e8aa-43dd-b1e2-92fc1c384175 None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:21.328986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a15123-e8aa-43dd-b1e2-92fc1c384175 None admin] RBAC: Authorizing `identity:get_project(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:21.330488 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a15123-e8aa-43dd-b1e2-92fc1c384175 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:21.332126 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 65/136] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:21 2022] GET /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:21.338782 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427510e4-e4f9-4b77-a7d8-6a3050e81bd3 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:21.447197 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:21.512370 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427510e4-e4f9-4b77-a7d8-6a3050e81bd3 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:21.558445 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c4c9e-b8c6-4a6f-8629-e8904e49fac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:21.559492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c4c9e-b8c6-4a6f-8629-e8904e49fac6 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:21.560023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c4c9e-b8c6-4a6f-8629-e8904e49fac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:21.560520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c4c9e-b8c6-4a6f-8629-e8904e49fac6 None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9/users/3e16364861b54675955ca4da10f6c281/roles/f60b6d7b309a4537a233198456c7aa34` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:21.563453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c4c9e-b8c6-4a6f-8629-e8904e49fac6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9, user_id=3e16364861b54675955ca4da10f6c281, role_id=f60b6d7b309a4537a233198456c7aa34)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:21.565220 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c4c9e-b8c6-4a6f-8629-e8904e49fac6 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:21.631723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 72/137] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:16:21 2022] PUT /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9/users/3e16364861b54675955ca4da10f6c281/roles/f60b6d7b309a4537a233198456c7aa34 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:16:21.849113 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44697ae-0f29-42dc-9604-ae7a62716ee0 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:21.849635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44697ae-0f29-42dc-9604-ae7a62716ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:21.849737 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44697ae-0f29-42dc-9604-ae7a62716ee0 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:21.851276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 66/138] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:21.866265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a49bde-d116-44c7-8ecc-cd3279ec19c4 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:21.867326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a49bde-d116-44c7-8ecc-cd3279ec19c4 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:21.867808 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a49bde-d116-44c7-8ecc-cd3279ec19c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:21.892510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-82a49bde-d116-44c7-8ecc-cd3279ec19c4 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:21.894087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-82a49bde-d116-44c7-8ecc-cd3279ec19c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:21.970683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 73/139] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:22.363725 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b82ea-978c-43b6-bd7d-818a7855ad98 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:22.364097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b82ea-978c-43b6-bd7d-818a7855ad98 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:22.364297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b82ea-978c-43b6-bd7d-818a7855ad98 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:22.365652 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 67/140] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:22.371018 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59760ae7-eceb-4523-b88c-fbdc1d57506d None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:22.371537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59760ae7-eceb-4523-b88c-fbdc1d57506d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:22.372014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59760ae7-eceb-4523-b88c-fbdc1d57506d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:22.396223 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-59760ae7-eceb-4523-b88c-fbdc1d57506d None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:22.397880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-59760ae7-eceb-4523-b88c-fbdc1d57506d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:22.422460 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b82ea-978c-43b6-bd7d-818a7855ad98 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:22.459497 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:22.515443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 74/141] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:22.604518 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:22.609255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b82ea-978c-43b6-bd7d-818a7855ad98 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:22.658059 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ad1fd-2326-4ad7-bc84-cf5b8a4ff294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:22.659050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ad1fd-2326-4ad7-bc84-cf5b8a4ff294 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:22.659582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ad1fd-2326-4ad7-bc84-cf5b8a4ff294 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:22.660056 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ad1fd-2326-4ad7-bc84-cf5b8a4ff294 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:22.661466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ad1fd-2326-4ad7-bc84-cf5b8a4ff294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:22.663413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ad1fd-2326-4ad7-bc84-cf5b8a4ff294 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:22.665296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 68/142] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:16:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:22.671572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59760ae7-eceb-4523-b88c-fbdc1d57506d None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:22.822962 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59760ae7-eceb-4523-b88c-fbdc1d57506d None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:22.857658 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3180a0-0d66-4b26-8672-9336bea5cc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:22.859034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3180a0-0d66-4b26-8672-9336bea5cc61 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:22.859453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3180a0-0d66-4b26-8672-9336bea5cc61 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:22.859860 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3180a0-0d66-4b26-8672-9336bea5cc61 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:22.860705 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3180a0-0d66-4b26-8672-9336bea5cc61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:22.862277 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3180a0-0d66-4b26-8672-9336bea5cc61 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:22.894103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ad1fd-2326-4ad7-bc84-cf5b8a4ff294 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:23.029516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ad1fd-2326-4ad7-bc84-cf5b8a4ff294 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:23.031448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 75/143] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 27 16:16:22 2022] POST /identity/v3/users => generated 283 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:16:23.076802 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2783b7-9352-41fb-a986-2503d0ac14ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:23.077506 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2783b7-9352-41fb-a986-2503d0ac14ab None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:23.077850 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2783b7-9352-41fb-a986-2503d0ac14ab None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:23.078128 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2783b7-9352-41fb-a986-2503d0ac14ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:23.097393 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2783b7-9352-41fb-a986-2503d0ac14ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:23.102287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-6b2783b7-9352-41fb-a986-2503d0ac14ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:23.102287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:23.102287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:23.102287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:23.102287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:23.102287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:23.102287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:23.102287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:23.102287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:23.102287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:23.102287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:23.102287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:23.102287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:23.102287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:23.102287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:23.102287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:23.103130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:23.103130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:23.103130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:23.103130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:23.103130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:23.103130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:23.103130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:23.103130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:23.103130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:23.103130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:23.103130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:23.103130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:23.103130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:23.103130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:23.103130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:23.103130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:23.103885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:23.103885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:23.103885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:23.103885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:23.103885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:23.103885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:23.103885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:23.103885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:23.103885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:23.103885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:23.103885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:23.103885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:23.103885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 69/144] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:23.109534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3180a0-0d66-4b26-8672-9336bea5cc61 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:23.164155 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:23.246277 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3180a0-0d66-4b26-8672-9336bea5cc61 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:23.295469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9ea6f-dc02-4aee-b417-f212921b17a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:23.297020 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9ea6f-dc02-4aee-b417-f212921b17a3 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:23.297531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9ea6f-dc02-4aee-b417-f212921b17a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:23.298002 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9ea6f-dc02-4aee-b417-f212921b17a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:23.298987 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9ea6f-dc02-4aee-b417-f212921b17a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:23.299548 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9ea6f-dc02-4aee-b417-f212921b17a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:23.301244 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9ea6f-dc02-4aee-b417-f212921b17a3 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:23.315784 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 76/145] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:23.321865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2783b7-9352-41fb-a986-2503d0ac14ab None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:23.369275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:23.464202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2783b7-9352-41fb-a986-2503d0ac14ab None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:23.510124 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba7c38-1163-4972-be6f-5477ed8e386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:23.510770 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba7c38-1163-4972-be6f-5477ed8e386a None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:23.511051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba7c38-1163-4972-be6f-5477ed8e386a None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:23.511324 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba7c38-1163-4972-be6f-5477ed8e386a None admin] PATH_INFO: `/v3/users/3e16364861b54675955ca4da10f6c281` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:23.512490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba7c38-1163-4972-be6f-5477ed8e386a None admin] RBAC: Authorizing `identity:get_user(user_id=3e16364861b54675955ca4da10f6c281)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:23.513953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba7c38-1163-4972-be6f-5477ed8e386a None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:23.515734 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 70/146] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:23 2022] GET /identity/v3/users/3e16364861b54675955ca4da10f6c281 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:23.521474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9ea6f-dc02-4aee-b417-f212921b17a3 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:23.642302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:23.649306 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9ea6f-dc02-4aee-b417-f212921b17a3 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:23.690685 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274bf37-77a3-4023-a577-182f671d125b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:23.691291 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274bf37-77a3-4023-a577-182f671d125b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:23.691568 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274bf37-77a3-4023-a577-182f671d125b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:23.691840 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274bf37-77a3-4023-a577-182f671d125b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:23.776164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274bf37-77a3-4023-a577-182f671d125b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:23.777716 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274bf37-77a3-4023-a577-182f671d125b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:23.900057 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:23.910580 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 77/147] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:23.916624 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba7c38-1163-4972-be6f-5477ed8e386a None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:24.032300 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:24.039378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba7c38-1163-4972-be6f-5477ed8e386a None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:24.054482 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974037d-b174-4a14-928c-1e8082babc92 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:24.054987 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974037d-b174-4a14-928c-1e8082babc92 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:24.055068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974037d-b174-4a14-928c-1e8082babc92 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:24.056385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 78/148] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:16:24.071090 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf641a8-aca4-4505-99dd-7f0077df45c3 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:24.071635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf641a8-aca4-4505-99dd-7f0077df45c3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:24.072250 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf641a8-aca4-4505-99dd-7f0077df45c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:24.098756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f127f6-dd4c-4f47-b905-137c86d07be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:24.099419 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f127f6-dd4c-4f47-b905-137c86d07be0 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:24.099697 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f127f6-dd4c-4f47-b905-137c86d07be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:24.099973 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f127f6-dd4c-4f47-b905-137c86d07be0 None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:24.101228 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f127f6-dd4c-4f47-b905-137c86d07be0 None admin] RBAC: Authorizing `identity:get_project(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:24.102741 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f127f6-dd4c-4f47-b905-137c86d07be0 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:24.106710 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 71/149] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:23 2022] GET /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:24.110862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f127f6-dd4c-4f47-b905-137c86d07be0 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:24.116189 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-bbf641a8-aca4-4505-99dd-7f0077df45c3 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:24.117418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-bbf641a8-aca4-4505-99dd-7f0077df45c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:24.266419 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 79/150] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:24.267704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f1a9e-e234-459b-849d-8d39d7edb9d1 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:24.267999 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f1a9e-e234-459b-849d-8d39d7edb9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:24.268279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f1a9e-e234-459b-849d-8d39d7edb9d1 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:24.269579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 80/151] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:24.280722 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093411b5-cd30-481a-b4f9-9ed6a0d5f91e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:24.281013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093411b5-cd30-481a-b4f9-9ed6a0d5f91e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:24.281805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093411b5-cd30-481a-b4f9-9ed6a0d5f91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:24.302470 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f127f6-dd4c-4f47-b905-137c86d07be0 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:24.313469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-093411b5-cd30-481a-b4f9-9ed6a0d5f91e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:24.318702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-093411b5-cd30-481a-b4f9-9ed6a0d5f91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:24.389695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1d158-29a3-424d-8d88-8a3a31af0b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:24.390319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1d158-29a3-424d-8d88-8a3a31af0b93 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:24.390600 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1d158-29a3-424d-8d88-8a3a31af0b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:24.390872 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1d158-29a3-424d-8d88-8a3a31af0b93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:24.391601 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1d158-29a3-424d-8d88-8a3a31af0b93 None admin] RBAC: Adding query filter params (role.id=e7e5b03d7a3d404f841a8341244d5d78, scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9, user.id=3e16364861b54675955ca4da10f6c281) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:24.391908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1d158-29a3-424d-8d88-8a3a31af0b93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:24.393381 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1d158-29a3-424d-8d88-8a3a31af0b93 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:24.399732 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 81/152] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:16:24.410495 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 72/153] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:16:24 2022] GET /identity/v3/role_assignments?user.id=3e16364861b54675955ca4da10f6c281&scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9&role.id=e7e5b03d7a3d404f841a8341244d5d78 => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:24.630302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093411b5-cd30-481a-b4f9-9ed6a0d5f91e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:24.711115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:24.769525 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093411b5-cd30-481a-b4f9-9ed6a0d5f91e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:24.794170 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb73cb4-b36b-4284-ae3d-abaf550409e3 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:24.794487 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb73cb4-b36b-4284-ae3d-abaf550409e3 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:24.794730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb73cb4-b36b-4284-ae3d-abaf550409e3 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:24.796642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 73/154] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:24.805653 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c2a36-cde5-422b-8c42-f5f4e8caa54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:24.805845 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab651e3e-a9a6-477a-82b5-d6e1a502e37a None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:24.806057 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab651e3e-a9a6-477a-82b5-d6e1a502e37a None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:24.806293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c2a36-cde5-422b-8c42-f5f4e8caa54b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:24.806407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab651e3e-a9a6-477a-82b5-d6e1a502e37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:24.806574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c2a36-cde5-422b-8c42-f5f4e8caa54b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:24.806849 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c2a36-cde5-422b-8c42-f5f4e8caa54b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:24.818790 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c2a36-cde5-422b-8c42-f5f4e8caa54b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:24.825374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-d49c2a36-cde5-422b-8c42-f5f4e8caa54b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:24.825374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:24.825374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:24.825374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:24.825374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:24.825374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:24.825374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:24.825374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:24.825374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:24.825374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:24.825374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:24.825374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:24.825374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:24.825374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:24.825374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:24.825374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:24.826302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:24.826302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:24.826302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:24.826302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:24.826302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:24.826302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:24.826302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:24.826302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:24.826302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:24.826302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:24.826302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:24.826302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:24.826302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:24.826302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:24.826302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:24.826302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:24.828492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:24.828492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:24.828492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:24.828492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:24.828492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:24.828492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:24.828492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:24.828492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:24.828492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:24.828492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:24.828492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:24.828492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:24.828492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 82/155] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:24.833127 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c2a36-cde5-422b-8c42-f5f4e8caa54b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:24.838542 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-ab651e3e-a9a6-477a-82b5-d6e1a502e37a None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:24.839771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ab651e3e-a9a6-477a-82b5-d6e1a502e37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:24.881581 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:24.951225 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c2a36-cde5-422b-8c42-f5f4e8caa54b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:24.970490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 74/156] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:24.971144 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab651e3e-a9a6-477a-82b5-d6e1a502e37a None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:24.979255 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:24.988373 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca603454-4243-4ec0-883f-b97e8285596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:24.988981 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca603454-4243-4ec0-883f-b97e8285596e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:24.989273 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca603454-4243-4ec0-883f-b97e8285596e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:24.989561 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca603454-4243-4ec0-883f-b97e8285596e None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:24.990279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca603454-4243-4ec0-883f-b97e8285596e None admin] RBAC: Adding query filter params (name=member) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:24.990592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca603454-4243-4ec0-883f-b97e8285596e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:24.991999 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca603454-4243-4ec0-883f-b97e8285596e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:25.001037 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 83/157] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:25.006813 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca603454-4243-4ec0-883f-b97e8285596e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:25.108715 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab651e3e-a9a6-477a-82b5-d6e1a502e37a None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:25.127139 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca603454-4243-4ec0-883f-b97e8285596e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:25.146322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523ad00-6747-46d5-9057-54f9b71097a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:25.146892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523ad00-6747-46d5-9057-54f9b71097a3 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:25.147174 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523ad00-6747-46d5-9057-54f9b71097a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:25.147448 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523ad00-6747-46d5-9057-54f9b71097a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:25.159235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523ad00-6747-46d5-9057-54f9b71097a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:25.166597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-a523ad00-6747-46d5-9057-54f9b71097a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 16:16:25.166597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:25.166597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:25.166597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:25.166597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:25.166597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:25.166597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:25.166597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:25.166597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:25.166597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:25.166597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:25.166597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:25.166597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:25.166597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:25.166597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:25.166597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:25.167484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:25.167484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:25.167484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:25.167484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:25.167484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:25.167484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:25.167484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:25.167484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:25.167484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:25.167484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:25.167484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:25.167484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:25.167484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:25.167484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:25.167484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:25.167484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:25.168280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:25.168280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:25.168280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:25.168280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:25.168280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:25.168280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:25.168280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:25.168280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:25.168280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:25.168280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:25.168280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 16:16:25.168280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:25.169289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e2308-cfd4-4642-9517-0b8c4f9510e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:25.169385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 75/158] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:25.169457 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e2308-cfd4-4642-9517-0b8c4f9510e7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:25.169457 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e2308-cfd4-4642-9517-0b8c4f9510e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:25.169457 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e2308-cfd4-4642-9517-0b8c4f9510e7 None admin] PATH_INFO: `/v3/users/3e16364861b54675955ca4da10f6c281` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:25.173122 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e2308-cfd4-4642-9517-0b8c4f9510e7 None admin] RBAC: Authorizing `identity:get_user(user_id=3e16364861b54675955ca4da10f6c281)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:25.173787 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523ad00-6747-46d5-9057-54f9b71097a3 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:25.174595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e2308-cfd4-4642-9517-0b8c4f9510e7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:25.176384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 84/159] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:25 2022] GET /identity/v3/users/3e16364861b54675955ca4da10f6c281 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:25.181597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e2308-cfd4-4642-9517-0b8c4f9510e7 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:25.195282 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:25.252213 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:25.279709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523ad00-6747-46d5-9057-54f9b71097a3 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:25.315621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470d230-44cf-42c2-89f1-4b4027a9728a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:25.316391 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470d230-44cf-42c2-89f1-4b4027a9728a None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:25.316802 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470d230-44cf-42c2-89f1-4b4027a9728a None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:25.317063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470d230-44cf-42c2-89f1-4b4027a9728a None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:25.317790 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470d230-44cf-42c2-89f1-4b4027a9728a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:25.318158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470d230-44cf-42c2-89f1-4b4027a9728a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:25.319617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470d230-44cf-42c2-89f1-4b4027a9728a None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:25.329293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 76/160] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:25.334850 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470d230-44cf-42c2-89f1-4b4027a9728a None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:25.334993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e2308-cfd4-4642-9517-0b8c4f9510e7 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:25.371328 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ff3a6-1af9-42b1-bfcd-dd5973a66c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:25.371950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ff3a6-1af9-42b1-bfcd-dd5973a66c4c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:25.372236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ff3a6-1af9-42b1-bfcd-dd5973a66c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:25.372570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ff3a6-1af9-42b1-bfcd-dd5973a66c4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:25.450150 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ff3a6-1af9-42b1-bfcd-dd5973a66c4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:25.451730 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ff3a6-1af9-42b1-bfcd-dd5973a66c4c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:25.479495 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:25.504644 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:25.562965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470d230-44cf-42c2-89f1-4b4027a9728a None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:25.566040 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 85/161] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 16:16:25.567798 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a487787-2c2d-4d48-aed6-47185cd3d7c1 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:25.568246 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a487787-2c2d-4d48-aed6-47185cd3d7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:25.568697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a487787-2c2d-4d48-aed6-47185cd3d7c1 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:25.570110 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 86/162] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:25.570958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a487787-2c2d-4d48-aed6-47185cd3d7c1 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:25.667081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add41c07-11d5-4903-a3c8-158b884942e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:25.667833 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add41c07-11d5-4903-a3c8-158b884942e9 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:25.668007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add41c07-11d5-4903-a3c8-158b884942e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:25.668283 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add41c07-11d5-4903-a3c8-158b884942e9 None admin] PATH_INFO: `/v3/users/3660243f97a04ba387d32da12494d2b3` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:25.669710 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add41c07-11d5-4903-a3c8-158b884942e9 None admin] RBAC: Authorizing `identity:get_user(user_id=3660243f97a04ba387d32da12494d2b3)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:25.671700 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add41c07-11d5-4903-a3c8-158b884942e9 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:25.679826 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a487787-2c2d-4d48-aed6-47185cd3d7c1 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:25.680273 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 77/163] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:25 2022] GET /identity/v3/users/3660243f97a04ba387d32da12494d2b3 => generated 289 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:25.681172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add41c07-11d5-4903-a3c8-158b884942e9 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:25.715891 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e2809-7f9c-4274-b2f8-e6b8cba4b9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:25.717137 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e2809-7f9c-4274-b2f8-e6b8cba4b9ce None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:25.717637 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e2809-7f9c-4274-b2f8-e6b8cba4b9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:25.718073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e2809-7f9c-4274-b2f8-e6b8cba4b9ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:25.728864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e2809-7f9c-4274-b2f8-e6b8cba4b9ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:25.734811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-883e2809-7f9c-4274-b2f8-e6b8cba4b9ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:16:25.734811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:25.734811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:25.734811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:25.734811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:25.734811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:25.734811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:25.734811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:25.734811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:25.734811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:25.734811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:25.734811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:25.734811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:25.734811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:25.734811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:25.734811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:25.735968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:25.735968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:25.735968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:25.735968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:25.735968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:25.735968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:25.735968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:25.735968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:25.735968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:25.735968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:25.735968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:25.735968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:25.735968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:25.735968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:25.735968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:25.735968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:25.736978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:25.736978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:25.736978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:25.736978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:25.736978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:25.736978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:25.736978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:25.736978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:25.736978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:25.736978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:25.736978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:16:25.736978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:25.739197 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 87/164] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:16:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:25.740586 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d6f29-8dd7-4e45-85ad-ba9c2e70752c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:25.741166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d6f29-8dd7-4e45-85ad-ba9c2e70752c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:25.741605 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d6f29-8dd7-4e45-85ad-ba9c2e70752c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:25.756709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:25.765448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6e7d6f29-8dd7-4e45-85ad-ba9c2e70752c None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:25.767522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6e7d6f29-8dd7-4e45-85ad-ba9c2e70752c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:25.844816 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 88/165] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:25.846157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d6f29-8dd7-4e45-85ad-ba9c2e70752c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:25.991637 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d6f29-8dd7-4e45-85ad-ba9c2e70752c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:26.001858 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add41c07-11d5-4903-a3c8-158b884942e9 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:26.048243 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6385f-300d-4f45-9c8c-4d398afdab6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:26.049227 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6385f-300d-4f45-9c8c-4d398afdab6a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:26.049667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6385f-300d-4f45-9c8c-4d398afdab6a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:26.050154 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6385f-300d-4f45-9c8c-4d398afdab6a None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:26.053378 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6385f-300d-4f45-9c8c-4d398afdab6a None admin] RBAC: Authorizing `identity:get_project(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:26.055003 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6385f-300d-4f45-9c8c-4d398afdab6a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:26.057018 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 89/166] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:25 2022] GET /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:26.057934 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6385f-300d-4f45-9c8c-4d398afdab6a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:26.062457 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:26.095764 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8916d0-66d4-474f-837e-3d8a8d9a4551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:26.096433 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8916d0-66d4-474f-837e-3d8a8d9a4551 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:26.096717 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8916d0-66d4-474f-837e-3d8a8d9a4551 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:26.096992 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8916d0-66d4-474f-837e-3d8a8d9a4551 None admin] PATH_INFO: `/v3/projects/1a2f99d80a494b2da5a4f132e65decfa` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:26.098126 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8916d0-66d4-474f-837e-3d8a8d9a4551 None admin] RBAC: Authorizing `identity:get_project(project_id=1a2f99d80a494b2da5a4f132e65decfa)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:26.099575 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8916d0-66d4-474f-837e-3d8a8d9a4551 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:26.101569 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 78/167] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:25 2022] GET /identity/v3/projects/1a2f99d80a494b2da5a4f132e65decfa => generated 312 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:26.102330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8916d0-66d4-474f-837e-3d8a8d9a4551 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:26.157411 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:26.208838 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6385f-300d-4f45-9c8c-4d398afdab6a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:26.244628 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337f64d-afcc-4516-b4ce-866c16e3615f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:26.245275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337f64d-afcc-4516-b4ce-866c16e3615f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:26.245568 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337f64d-afcc-4516-b4ce-866c16e3615f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:26.245852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337f64d-afcc-4516-b4ce-866c16e3615f None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:26.246529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337f64d-afcc-4516-b4ce-866c16e3615f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:26.246839 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337f64d-afcc-4516-b4ce-866c16e3615f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:26.248246 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337f64d-afcc-4516-b4ce-866c16e3615f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:26.257184 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 90/168] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:26.257847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337f64d-afcc-4516-b4ce-866c16e3615f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:26.311159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8916d0-66d4-474f-837e-3d8a8d9a4551 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:26.347932 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1452f-0311-46e7-a801-4f84e28ac6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:26.348633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1452f-0311-46e7-a801-4f84e28ac6ee None admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:26.348915 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1452f-0311-46e7-a801-4f84e28ac6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:26.349192 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1452f-0311-46e7-a801-4f84e28ac6ee None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9/users/3660243f97a04ba387d32da12494d2b3/roles/018bcecca3d84d2d990678f3d1d53886` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:26.351111 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1452f-0311-46e7-a801-4f84e28ac6ee None admin] RBAC: Authorizing `identity:create_grant(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9, user_id=3660243f97a04ba387d32da12494d2b3, role_id=018bcecca3d84d2d990678f3d1d53886)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:26.351625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:26.352602 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1452f-0311-46e7-a801-4f84e28ac6ee None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:26.383132 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337f64d-afcc-4516-b4ce-866c16e3615f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:26.422119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae22fa-76ad-4532-956e-5ec9be5d7538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:26.422741 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae22fa-76ad-4532-956e-5ec9be5d7538 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:26.423776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae22fa-76ad-4532-956e-5ec9be5d7538 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:26.424058 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae22fa-76ad-4532-956e-5ec9be5d7538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:26.424915 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae22fa-76ad-4532-956e-5ec9be5d7538 None admin] RBAC: Adding query filter params (role.id=e7e5b03d7a3d404f841a8341244d5d78, scope.project.id=1a2f99d80a494b2da5a4f132e65decfa, user.id=3e16364861b54675955ca4da10f6c281) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:26.425232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae22fa-76ad-4532-956e-5ec9be5d7538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:26.426736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae22fa-76ad-4532-956e-5ec9be5d7538 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:26.433456 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 91/169] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:16:26 2022] GET /identity/v3/role_assignments?user.id=3e16364861b54675955ca4da10f6c281&scope.project.id=1a2f99d80a494b2da5a4f132e65decfa&role.id=e7e5b03d7a3d404f841a8341244d5d78 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:26.434043 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae22fa-76ad-4532-956e-5ec9be5d7538 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:26.462427 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 79/170] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:16:26 2022] PUT /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9/users/3660243f97a04ba387d32da12494d2b3/roles/018bcecca3d84d2d990678f3d1d53886 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:16:26.469267 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1452f-0311-46e7-a801-4f84e28ac6ee None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:26.555034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae22fa-76ad-4532-956e-5ec9be5d7538 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:26.584906 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:26.600899 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb070d8-3018-44ef-8e7f-39f21252ebae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:26.601639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb070d8-3018-44ef-8e7f-39f21252ebae None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:26.601925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb070d8-3018-44ef-8e7f-39f21252ebae None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:26.602207 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb070d8-3018-44ef-8e7f-39f21252ebae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:26.603749 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:26.626118 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb070d8-3018-44ef-8e7f-39f21252ebae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:26.631589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-2cb070d8-3018-44ef-8e7f-39f21252ebae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:26.631589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:26.631589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:26.631589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:26.631589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:26.631589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:26.631589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:26.631589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:26.631589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:26.631589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:26.631589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:26.631589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:26.631589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:26.631589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:26.631589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:26.631589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:26.632585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:26.632585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:26.632585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:26.632585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:26.632585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:26.632585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:26.632585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:26.632585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:26.632585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:26.632585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:26.632585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:26.632585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:26.632585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:26.632585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:26.632585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:26.632585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:26.633451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:26.633451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:26.633451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:26.633451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:26.633451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:26.633451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:26.633451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:26.633451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:26.633451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:26.633451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:26.633451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:26.633451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:26.633451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 92/171] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:16:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:26.640947 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb070d8-3018-44ef-8e7f-39f21252ebae None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:26.655377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1452f-0311-46e7-a801-4f84e28ac6ee None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:26.726034 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcf5b5-1afb-425f-a70a-de1e25b44b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:26.726709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcf5b5-1afb-425f-a70a-de1e25b44b13 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:26.726996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcf5b5-1afb-425f-a70a-de1e25b44b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:26.727268 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcf5b5-1afb-425f-a70a-de1e25b44b13 None admin] PATH_INFO: `/v3/users/09247daecb7c4c7e95eb12e5544033af` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:26.728645 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcf5b5-1afb-425f-a70a-de1e25b44b13 None admin] RBAC: Authorizing `identity:get_user(user_id=09247daecb7c4c7e95eb12e5544033af)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:26.730146 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcf5b5-1afb-425f-a70a-de1e25b44b13 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:26.732035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 80/172] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:26 2022] GET /identity/v3/users/09247daecb7c4c7e95eb12e5544033af => generated 247 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:26.737538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcf5b5-1afb-425f-a70a-de1e25b44b13 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:26.790089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb070d8-3018-44ef-8e7f-39f21252ebae None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:26.831688 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007ea2e-1fcc-47ee-8ce4-146ad7dd9cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:26.832316 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007ea2e-1fcc-47ee-8ce4-146ad7dd9cef None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:26.832732 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007ea2e-1fcc-47ee-8ce4-146ad7dd9cef None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:26.833013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007ea2e-1fcc-47ee-8ce4-146ad7dd9cef None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:26.833688 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007ea2e-1fcc-47ee-8ce4-146ad7dd9cef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:26.833990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007ea2e-1fcc-47ee-8ce4-146ad7dd9cef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:26.835389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007ea2e-1fcc-47ee-8ce4-146ad7dd9cef None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:26.845647 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 93/173] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:16:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:26.851606 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007ea2e-1fcc-47ee-8ce4-146ad7dd9cef None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:26.901397 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcf5b5-1afb-425f-a70a-de1e25b44b13 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:26.940703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:26.954208 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18048cbd-2c4a-48ac-81ee-dd81b919c5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:26.954839 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18048cbd-2c4a-48ac-81ee-dd81b919c5fe None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:26.955123 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18048cbd-2c4a-48ac-81ee-dd81b919c5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:26.955395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18048cbd-2c4a-48ac-81ee-dd81b919c5fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:26.964226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007ea2e-1fcc-47ee-8ce4-146ad7dd9cef None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:26.976059 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:27.003790 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b37d2-7dfe-46f7-aa8a-ed1e0dd21233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:27.004464 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b37d2-7dfe-46f7-aa8a-ed1e0dd21233 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:27.004753 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b37d2-7dfe-46f7-aa8a-ed1e0dd21233 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:27.005038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b37d2-7dfe-46f7-aa8a-ed1e0dd21233 None admin] PATH_INFO: `/v3/users/3e16364861b54675955ca4da10f6c281` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:27.006308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b37d2-7dfe-46f7-aa8a-ed1e0dd21233 None admin] RBAC: Authorizing `identity:get_user(user_id=3e16364861b54675955ca4da10f6c281)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:27.007855 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b37d2-7dfe-46f7-aa8a-ed1e0dd21233 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:27.009991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 94/174] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:26 2022] GET /identity/v3/users/3e16364861b54675955ca4da10f6c281 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:27.016325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b37d2-7dfe-46f7-aa8a-ed1e0dd21233 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:27.103184 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18048cbd-2c4a-48ac-81ee-dd81b919c5fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:27.104640 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18048cbd-2c4a-48ac-81ee-dd81b919c5fe None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:27.135195 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b37d2-7dfe-46f7-aa8a-ed1e0dd21233 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:27.160694 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:27.179142 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a89ba-c01f-41d2-b957-0aee0ebfb01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:27.179733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a89ba-c01f-41d2-b957-0aee0ebfb01d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:27.180011 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a89ba-c01f-41d2-b957-0aee0ebfb01d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:27.180949 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a89ba-c01f-41d2-b957-0aee0ebfb01d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:27.271739 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a89ba-c01f-41d2-b957-0aee0ebfb01d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:27.277635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a89ba-c01f-41d2-b957-0aee0ebfb01d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:27.283270 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 81/175] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:27.288684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18048cbd-2c4a-48ac-81ee-dd81b919c5fe None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:27.384504 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:27.410902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 95/176] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 16:16:27.418660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def34715-5ea8-4eed-8544-381c3f498c3b None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:27.419207 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def34715-5ea8-4eed-8544-381c3f498c3b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:27.419490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def34715-5ea8-4eed-8544-381c3f498c3b None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:27.421806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 96/177] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:27.423830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def34715-5ea8-4eed-8544-381c3f498c3b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:27.444720 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:27.554164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def34715-5ea8-4eed-8544-381c3f498c3b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:27.586173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18048cbd-2c4a-48ac-81ee-dd81b919c5fe None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:27.592061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e76b1b-373a-4586-8402-ca441d2e1287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:27.593268 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e76b1b-373a-4586-8402-ca441d2e1287 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:27.593554 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e76b1b-373a-4586-8402-ca441d2e1287 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:27.593832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e76b1b-373a-4586-8402-ca441d2e1287 None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:27.601406 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e76b1b-373a-4586-8402-ca441d2e1287 None admin] RBAC: Authorizing `identity:get_project(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:27.602944 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e76b1b-373a-4586-8402-ca441d2e1287 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:27.604806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 97/178] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:27 2022] GET /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:27.613715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e3f5f-a4ad-4c65-aab9-ae838cb13645 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:27.614083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e3f5f-a4ad-4c65-aab9-ae838cb13645 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:27.614233 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e3f5f-a4ad-4c65-aab9-ae838cb13645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:27.653760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9f6e3f5f-a4ad-4c65-aab9-ae838cb13645 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:27.655588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9f6e3f5f-a4ad-4c65-aab9-ae838cb13645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:27.685190 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c7c91-4064-4213-9b7d-5850a014b7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:27.685882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c7c91-4064-4213-9b7d-5850a014b7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:27.686160 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c7c91-4064-4213-9b7d-5850a014b7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:27.686482 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c7c91-4064-4213-9b7d-5850a014b7a8 None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:27.688461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c7c91-4064-4213-9b7d-5850a014b7a8 None admin] RBAC: Authorizing `identity:get_project(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:27.690502 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c7c91-4064-4213-9b7d-5850a014b7a8 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:27.696470 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 82/179] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:27 2022] GET /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9 => generated 298 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:27.702509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c7c91-4064-4213-9b7d-5850a014b7a8 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:27.811423 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 98/180] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:27.812875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e3f5f-a4ad-4c65-aab9-ae838cb13645 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:27.846416 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:27.969622 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c7c91-4064-4213-9b7d-5850a014b7a8 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:27.992882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:28.029651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e3f5f-a4ad-4c65-aab9-ae838cb13645 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:28.030729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d701be-7ddc-46d8-b8dd-bc4fee11733a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:28.031445 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d701be-7ddc-46d8-b8dd-bc4fee11733a None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:28.031726 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d701be-7ddc-46d8-b8dd-bc4fee11733a None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:28.031996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d701be-7ddc-46d8-b8dd-bc4fee11733a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:28.032751 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d701be-7ddc-46d8-b8dd-bc4fee11733a None admin] RBAC: Adding query filter params (role.id=f60b6d7b309a4537a233198456c7aa34, scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9, user.id=3e16364861b54675955ca4da10f6c281) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:28.033060 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d701be-7ddc-46d8-b8dd-bc4fee11733a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:28.034781 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d701be-7ddc-46d8-b8dd-bc4fee11733a None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:28.045435 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 83/181] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:16:27 2022] GET /identity/v3/role_assignments?user.id=3e16364861b54675955ca4da10f6c281&scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9&role.id=f60b6d7b309a4537a233198456c7aa34 => generated 608 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:28.086007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc730b-5c6d-4f70-9fb8-723dcb9a9dd2 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:28.086365 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc730b-5c6d-4f70-9fb8-723dcb9a9dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:28.086689 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc730b-5c6d-4f70-9fb8-723dcb9a9dd2 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:28.088032 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 84/182] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:28.094362 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fac88-c1de-4afc-a6ef-da017c4d3603 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:28.094639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fac88-c1de-4afc-a6ef-da017c4d3603 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:28.094908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fac88-c1de-4afc-a6ef-da017c4d3603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:28.099402 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745316a-4a9a-489f-9e8a-d0e21a6b57dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:28.100194 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745316a-4a9a-489f-9e8a-d0e21a6b57dc None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:28.100654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745316a-4a9a-489f-9e8a-d0e21a6b57dc None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:28.101070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745316a-4a9a-489f-9e8a-d0e21a6b57dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:28.101984 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745316a-4a9a-489f-9e8a-d0e21a6b57dc None admin] RBAC: Adding query filter params (role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9, user.id=09247daecb7c4c7e95eb12e5544033af) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:28.102455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745316a-4a9a-489f-9e8a-d0e21a6b57dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:28.104039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745316a-4a9a-489f-9e8a-d0e21a6b57dc None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:28.111489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 99/183] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:16:27 2022] GET /identity/v3/role_assignments?user.id=09247daecb7c4c7e95eb12e5544033af&scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:28.149661 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-dc1fac88-c1de-4afc-a6ef-da017c4d3603 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:28.150910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-dc1fac88-c1de-4afc-a6ef-da017c4d3603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:28.262106 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 85/184] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:28.286206 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745316a-4a9a-489f-9e8a-d0e21a6b57dc None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:28.401436 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745316a-4a9a-489f-9e8a-d0e21a6b57dc None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:28.403405 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:28.438787 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22559279-effa-497a-b468-da065147ed03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:28.439517 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22559279-effa-497a-b468-da065147ed03 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:28.439807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22559279-effa-497a-b468-da065147ed03 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:28.440085 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22559279-effa-497a-b468-da065147ed03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:28.452171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22559279-effa-497a-b468-da065147ed03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:28.458289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-22559279-effa-497a-b468-da065147ed03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:16:28.458289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:28.458289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:28.458289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:28.458289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:28.458289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:28.458289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:28.458289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:28.458289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:28.458289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:28.458289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:28.458289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:28.458289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:28.458289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:28.458289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:28.458289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:28.459226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:28.459226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:28.459226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:28.459226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:28.459226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:28.459226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:28.459226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:28.459226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:28.459226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:28.459226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:28.459226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:28.459226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:28.459226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:28.459226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:28.459226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:28.459226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:28.460055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:28.460055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:28.460055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:28.460055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:28.460055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:28.460055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:28.460055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:28.460055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:28.460055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:28.460055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:28.460055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:16:28.460055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:28.460055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 100/185] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:16:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:28.465399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fac88-c1de-4afc-a6ef-da017c4d3603 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:28.475996 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970100d-24c7-472c-901c-7ab0ddfe5d54 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:28.476305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970100d-24c7-472c-901c-7ab0ddfe5d54 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:28.476603 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970100d-24c7-472c-901c-7ab0ddfe5d54 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:28.477929 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 101/186] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:28.485200 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ef48c-395f-44e8-a132-6f18a3edd163 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:28.485668 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ef48c-395f-44e8-a132-6f18a3edd163 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:28.486084 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ef48c-395f-44e8-a132-6f18a3edd163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:28.513584 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-520ef48c-395f-44e8-a132-6f18a3edd163 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:28.515698 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-520ef48c-395f-44e8-a132-6f18a3edd163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:28.617630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 102/187] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:16:28.626287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fac88-c1de-4afc-a6ef-da017c4d3603 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:28.628825 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:28.650960 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ef48c-395f-44e8-a132-6f18a3edd163 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:28.666874 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700edc7-cd5c-4256-9097-19611a2143e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:28.667546 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700edc7-cd5c-4256-9097-19611a2143e2 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:28.668194 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700edc7-cd5c-4256-9097-19611a2143e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:28.668544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700edc7-cd5c-4256-9097-19611a2143e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:28.669479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700edc7-cd5c-4256-9097-19611a2143e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:28.669786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700edc7-cd5c-4256-9097-19611a2143e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:28.671792 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700edc7-cd5c-4256-9097-19611a2143e2 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:28.684110 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 86/188] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:28.691355 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700edc7-cd5c-4256-9097-19611a2143e2 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:28.742609 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:28.792800 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ef48c-395f-44e8-a132-6f18a3edd163 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:28.816198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700edc7-cd5c-4256-9097-19611a2143e2 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:28.836316 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0aecd5-3826-4670-a590-7743a9049f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:28.836997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aecd5-3826-4670-a590-7743a9049f3e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:28.837277 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aecd5-3826-4670-a590-7743a9049f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:28.837556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aecd5-3826-4670-a590-7743a9049f3e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:28.851683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0aecd5-3826-4670-a590-7743a9049f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:28.854349 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3a8d2-b53f-499c-a46d-d58308d4b8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:28.854986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3a8d2-b53f-499c-a46d-d58308d4b8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:28.855264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3a8d2-b53f-499c-a46d-d58308d4b8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:28.855535 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3a8d2-b53f-499c-a46d-d58308d4b8c5 None admin] PATH_INFO: `/v3/users/2ad3fc7febe547c88a265690826f965c` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:28.856681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-af0aecd5-3826-4670-a590-7743a9049f3e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:28.856681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:28.856681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:28.856681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:28.856681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:28.856681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:28.856681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:28.856681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:28.856681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:28.856681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:28.856681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:28.856681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:28.856681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:28.856681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:28.856681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:28.856681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:28.857560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:28.857560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:28.857560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:28.857560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:28.857560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:28.857560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:28.857560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:28.857560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:28.857560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:28.857560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:28.857560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:28.857560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:28.857560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:28.857560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:28.857560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:28.857560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:28.858953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:28.858953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:28.858953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:28.858953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:28.858953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:28.858953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:28.858953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:28.858953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:28.858953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:28.858953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:28.858953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:28.858953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:28.858953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 103/189] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:16:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:16:28.865693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0aecd5-3826-4670-a590-7743a9049f3e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:28.874540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3a8d2-b53f-499c-a46d-d58308d4b8c5 None admin] RBAC: Authorizing `identity:get_user(user_id=2ad3fc7febe547c88a265690826f965c)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:28.876952 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3a8d2-b53f-499c-a46d-d58308d4b8c5 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:28.879449 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 87/190] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:28 2022] GET /identity/v3/users/2ad3fc7febe547c88a265690826f965c => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:28.886262 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3a8d2-b53f-499c-a46d-d58308d4b8c5 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:28.915137 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:28.978622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0aecd5-3826-4670-a590-7743a9049f3e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:28.995917 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3a8d2-b53f-499c-a46d-d58308d4b8c5 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:29.011794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:29.018431 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a3b0d-d554-453e-a2ab-1cdca37c5c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:29.024467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a3b0d-d554-453e-a2ab-1cdca37c5c5d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:29.024467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a3b0d-d554-453e-a2ab-1cdca37c5c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:29.024467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a3b0d-d554-453e-a2ab-1cdca37c5c5d None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:29.024467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a3b0d-d554-453e-a2ab-1cdca37c5c5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:29.024467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a3b0d-d554-453e-a2ab-1cdca37c5c5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:29.024467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a3b0d-d554-453e-a2ab-1cdca37c5c5d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:29.030807 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889a0e1-2310-4987-b110-4d9f4ce1c99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:29.031449 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889a0e1-2310-4987-b110-4d9f4ce1c99c None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:29.031727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889a0e1-2310-4987-b110-4d9f4ce1c99c None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:29.032002 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889a0e1-2310-4987-b110-4d9f4ce1c99c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:29.033697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 104/191] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:16:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:29.034763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a3b0d-d554-453e-a2ab-1cdca37c5c5d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:29.109351 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889a0e1-2310-4987-b110-4d9f4ce1c99c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:29.111376 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889a0e1-2310-4987-b110-4d9f4ce1c99c None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:29.135142 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:29.143628 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a3b0d-d554-453e-a2ab-1cdca37c5c5d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:29.178541 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daf6ab-9cb1-49b9-a6f5-c0324cf23781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:29.179166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daf6ab-9cb1-49b9-a6f5-c0324cf23781 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:29.179453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daf6ab-9cb1-49b9-a6f5-c0324cf23781 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:29.179726 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daf6ab-9cb1-49b9-a6f5-c0324cf23781 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:29.180996 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78daf6ab-9cb1-49b9-a6f5-c0324cf23781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:29.183230 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78daf6ab-9cb1-49b9-a6f5-c0324cf23781 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:29.185006 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 105/192] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:16:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:29.185609 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daf6ab-9cb1-49b9-a6f5-c0324cf23781 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:29.217783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 88/193] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:29.218617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889a0e1-2310-4987-b110-4d9f4ce1c99c None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:29.251674 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:29.296869 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daf6ab-9cb1-49b9-a6f5-c0324cf23781 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:29.330351 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889a0e1-2310-4987-b110-4d9f4ce1c99c None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:29.333557 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49298a9f-b88f-4bff-9042-47b89f28ccba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:29.334188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49298a9f-b88f-4bff-9042-47b89f28ccba None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:29.334471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49298a9f-b88f-4bff-9042-47b89f28ccba None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:29.334736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49298a9f-b88f-4bff-9042-47b89f28ccba None admin] PATH_INFO: `/v3/users/2ad3fc7febe547c88a265690826f965c` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:29.335879 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49298a9f-b88f-4bff-9042-47b89f28ccba None admin] RBAC: Authorizing `identity:get_user(user_id=2ad3fc7febe547c88a265690826f965c)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:29.337375 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49298a9f-b88f-4bff-9042-47b89f28ccba None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:29.339209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 106/194] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:29 2022] GET /identity/v3/users/2ad3fc7febe547c88a265690826f965c => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:29.339894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49298a9f-b88f-4bff-9042-47b89f28ccba None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:29.366054 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:29.378368 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c08008-30cc-4b40-aefc-0ece64b88911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:29.378993 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c08008-30cc-4b40-aefc-0ece64b88911 None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:29.379270 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c08008-30cc-4b40-aefc-0ece64b88911 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:29.379541 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c08008-30cc-4b40-aefc-0ece64b88911 None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:29.380217 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c08008-30cc-4b40-aefc-0ece64b88911 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:29.381809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c08008-30cc-4b40-aefc-0ece64b88911 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:29.447170 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49298a9f-b88f-4bff-9042-47b89f28ccba None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:29.472485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:29.480083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e7301-e0dc-4fc4-b108-7c6d65d52239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:29.480755 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e7301-e0dc-4fc4-b108-7c6d65d52239 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:29.481036 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e7301-e0dc-4fc4-b108-7c6d65d52239 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:29.481307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e7301-e0dc-4fc4-b108-7c6d65d52239 None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:29.482417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e7301-e0dc-4fc4-b108-7c6d65d52239 None admin] RBAC: Authorizing `identity:get_project(project_id=05e8dee797fd40d4bab1c7dd5c687e36)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:29.484382 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e7301-e0dc-4fc4-b108-7c6d65d52239 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:29.484486 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 89/195] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 27 16:16:29 2022] POST /identity/v3/users => generated 297 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:16:29.485285 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c08008-30cc-4b40-aefc-0ece64b88911 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:29.485990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 107/196] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:29 2022] GET /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:29.487118 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c4b3b-f9a7-43a2-844e-40e002d17b52 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:29.487399 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c4b3b-f9a7-43a2-844e-40e002d17b52 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:29.487801 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c4b3b-f9a7-43a2-844e-40e002d17b52 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:29.489261 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 108/197] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:29.491838 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c4b3b-f9a7-43a2-844e-40e002d17b52 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:29.607845 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c08008-30cc-4b40-aefc-0ece64b88911 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:29.609426 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c4b3b-f9a7-43a2-844e-40e002d17b52 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:29.648605 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940917d0-7a7e-4e99-9930-33e4cb1cf773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:29.649122 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940917d0-7a7e-4e99-9930-33e4cb1cf773 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:29.649399 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940917d0-7a7e-4e99-9930-33e4cb1cf773 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:29.649664 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940917d0-7a7e-4e99-9930-33e4cb1cf773 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:29.650385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940917d0-7a7e-4e99-9930-33e4cb1cf773 None admin] RBAC: Adding query filter params (role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36, user.id=2ad3fc7febe547c88a265690826f965c) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:29.650550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa63b0-a05c-46bf-b003-d2c64225fbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:29.650728 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940917d0-7a7e-4e99-9930-33e4cb1cf773 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:29.651138 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa63b0-a05c-46bf-b003-d2c64225fbb6 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:29.651421 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa63b0-a05c-46bf-b003-d2c64225fbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:29.651697 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa63b0-a05c-46bf-b003-d2c64225fbb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:29.652124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940917d0-7a7e-4e99-9930-33e4cb1cf773 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:29.660682 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 109/198] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:16:29 2022] GET /identity/v3/role_assignments?user.id=2ad3fc7febe547c88a265690826f965c&scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:29.661898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae7267-0ab4-4ee4-ab19-2d4bbdea8b42 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:29.663799 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae7267-0ab4-4ee4-ab19-2d4bbdea8b42 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:29.664078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae7267-0ab4-4ee4-ab19-2d4bbdea8b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:29.693719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-80ae7267-0ab4-4ee4-ab19-2d4bbdea8b42 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:29.695696 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-80ae7267-0ab4-4ee4-ab19-2d4bbdea8b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:29.718043 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:29.745977 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa63b0-a05c-46bf-b003-d2c64225fbb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:29.747475 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa63b0-a05c-46bf-b003-d2c64225fbb6 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:29.787119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:29.805491 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 110/199] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:29.875420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 90/200] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:29.883595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae7267-0ab4-4ee4-ab19-2d4bbdea8b42 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:29.995388 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae7267-0ab4-4ee4-ab19-2d4bbdea8b42 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:30.035621 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba7570-4dc8-465b-baa4-d86d14859a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:30.036259 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba7570-4dc8-465b-baa4-d86d14859a56 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:30.036581 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba7570-4dc8-465b-baa4-d86d14859a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:30.036854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba7570-4dc8-465b-baa4-d86d14859a56 None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:30.037978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba7570-4dc8-465b-baa4-d86d14859a56 None admin] RBAC: Authorizing `identity:get_project(project_id=05e8dee797fd40d4bab1c7dd5c687e36)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:30.039535 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba7570-4dc8-465b-baa4-d86d14859a56 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:30.041348 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 111/201] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:29 2022] GET /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:30.047680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa63b0-a05c-46bf-b003-d2c64225fbb6 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:30.114591 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba7570-4dc8-465b-baa4-d86d14859a56 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:30.148631 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:30.182371 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa63b0-a05c-46bf-b003-d2c64225fbb6 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:30.229296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745e07d-14c7-48d0-a0c2-65bdc15a40df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:30.230219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:30.231169 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745e07d-14c7-48d0-a0c2-65bdc15a40df None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:30.231455 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745e07d-14c7-48d0-a0c2-65bdc15a40df None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:30.231727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745e07d-14c7-48d0-a0c2-65bdc15a40df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:30.232502 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745e07d-14c7-48d0-a0c2-65bdc15a40df None admin] RBAC: Adding query filter params (role.id=f60b6d7b309a4537a233198456c7aa34, scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36, user.id=2ad3fc7febe547c88a265690826f965c) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:30.232815 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745e07d-14c7-48d0-a0c2-65bdc15a40df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:30.235391 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745e07d-14c7-48d0-a0c2-65bdc15a40df None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:30.242204 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 91/202] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:16:30 2022] GET /identity/v3/role_assignments?user.id=2ad3fc7febe547c88a265690826f965c&scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36&role.id=f60b6d7b309a4537a233198456c7aa34 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:30.294904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba7570-4dc8-465b-baa4-d86d14859a56 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:30.334533 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b42525-04d1-4bdc-9aa7-d56cbc8c15dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:30.335258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b42525-04d1-4bdc-9aa7-d56cbc8c15dd None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:30.335500 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b42525-04d1-4bdc-9aa7-d56cbc8c15dd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:30.335777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b42525-04d1-4bdc-9aa7-d56cbc8c15dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:30.348464 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b42525-04d1-4bdc-9aa7-d56cbc8c15dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:30.353425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-f2b42525-04d1-4bdc-9aa7-d56cbc8c15dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 16:16:30.353425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:30.353425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:30.353425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:30.353425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:30.353425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:30.353425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:30.353425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:30.353425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:30.353425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:30.353425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:30.353425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:30.353425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:30.353425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:30.353425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:30.353425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:30.354309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:30.354309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:30.354309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:30.354309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:30.354309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:30.354309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:30.354309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:30.354309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:30.354309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:30.354309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:30.354309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:30.354309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:30.354309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:30.354309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:30.354309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:30.354309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:30.355124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:30.355124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:30.355124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:30.355124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:30.355124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:30.355124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:30.355124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:30.355124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:30.355124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:30.355124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:30.355124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 16:16:30.355124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:30.355124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 112/203] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:16:30.361981 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745e07d-14c7-48d0-a0c2-65bdc15a40df None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:30.500033 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745e07d-14c7-48d0-a0c2-65bdc15a40df None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:30.550739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69a48f-6d7f-4618-b038-e9b55dfb6c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:30.551281 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69a48f-6d7f-4618-b038-e9b55dfb6c67 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:30.551565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69a48f-6d7f-4618-b038-e9b55dfb6c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:30.551844 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69a48f-6d7f-4618-b038-e9b55dfb6c67 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:30.552546 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69a48f-6d7f-4618-b038-e9b55dfb6c67 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:30.552855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69a48f-6d7f-4618-b038-e9b55dfb6c67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:30.554287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69a48f-6d7f-4618-b038-e9b55dfb6c67 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:30.568873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 92/204] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:30.574569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b42525-04d1-4bdc-9aa7-d56cbc8c15dd None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:30.706494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b42525-04d1-4bdc-9aa7-d56cbc8c15dd None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:30.726030 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:30.744632 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255f9a2-d2c0-4b23-80d0-2a283be61d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:30.745287 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255f9a2-d2c0-4b23-80d0-2a283be61d3c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:30.745568 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255f9a2-d2c0-4b23-80d0-2a283be61d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:30.745846 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255f9a2-d2c0-4b23-80d0-2a283be61d3c None admin] PATH_INFO: `/v3/users/3660243f97a04ba387d32da12494d2b3` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:30.747082 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255f9a2-d2c0-4b23-80d0-2a283be61d3c None admin] RBAC: Authorizing `identity:get_user(user_id=3660243f97a04ba387d32da12494d2b3)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:30.748628 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255f9a2-d2c0-4b23-80d0-2a283be61d3c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:30.750348 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 113/205] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:30 2022] GET /identity/v3/users/3660243f97a04ba387d32da12494d2b3 => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:30.756222 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69a48f-6d7f-4618-b038-e9b55dfb6c67 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:30.765809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:30.912088 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69a48f-6d7f-4618-b038-e9b55dfb6c67 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:30.957827 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6e3b2-223b-4ce3-83a5-aae70f463fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:30.958453 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6e3b2-223b-4ce3-83a5-aae70f463fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:30.958737 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6e3b2-223b-4ce3-83a5-aae70f463fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:30.959014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6e3b2-223b-4ce3-83a5-aae70f463fd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:31.056821 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6e3b2-223b-4ce3-83a5-aae70f463fd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:31.058312 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6e3b2-223b-4ce3-83a5-aae70f463fd9 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:31.067296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:31.175067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 93/206] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:31.180843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255f9a2-d2c0-4b23-80d0-2a283be61d3c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:31.303482 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255f9a2-d2c0-4b23-80d0-2a283be61d3c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:31.344856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37a333-634c-430b-8a8b-ec160a7b48f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:31.345582 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37a333-634c-430b-8a8b-ec160a7b48f5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:31.345741 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37a333-634c-430b-8a8b-ec160a7b48f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:31.346015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37a333-634c-430b-8a8b-ec160a7b48f5 None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:31.347152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37a333-634c-430b-8a8b-ec160a7b48f5 None admin] RBAC: Authorizing `identity:get_project(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:31.348637 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37a333-634c-430b-8a8b-ec160a7b48f5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:31.350263 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 114/207] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:31 2022] GET /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:31.356452 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6e3b2-223b-4ce3-83a5-aae70f463fd9 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:31.501101 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6e3b2-223b-4ce3-83a5-aae70f463fd9 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:31.515207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:31.551020 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99a6d1-d89e-4429-9f05-26e1666ef9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:31.551735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99a6d1-d89e-4429-9f05-26e1666ef9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:31.552421 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99a6d1-d89e-4429-9f05-26e1666ef9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:31.552717 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99a6d1-d89e-4429-9f05-26e1666ef9c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:31.553468 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99a6d1-d89e-4429-9f05-26e1666ef9c7 None admin] RBAC: Adding query filter params (role.id=018bcecca3d84d2d990678f3d1d53886, scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9, user.id=3660243f97a04ba387d32da12494d2b3) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:31.553770 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99a6d1-d89e-4429-9f05-26e1666ef9c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:31.555216 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99a6d1-d89e-4429-9f05-26e1666ef9c7 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:31.565231 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 94/208] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:16:31 2022] GET /identity/v3/role_assignments?user.id=3660243f97a04ba387d32da12494d2b3&scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9&role.id=018bcecca3d84d2d990678f3d1d53886 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:32.161893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b31897-ae5d-416b-b5cb-e284848b800c None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:32.162407 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b31897-ae5d-416b-b5cb-e284848b800c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:32.162846 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b31897-ae5d-416b-b5cb-e284848b800c None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:32.164360 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 115/209] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:32.169964 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94a862-a56f-4b06-aec0-c414873e298b None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:32.171164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94a862-a56f-4b06-aec0-c414873e298b None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:32.171795 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94a862-a56f-4b06-aec0-c414873e298b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:32.196734 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-4e94a862-a56f-4b06-aec0-c414873e298b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:32.198246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4e94a862-a56f-4b06-aec0-c414873e298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:32.200975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85bdae-1a3e-437d-99ef-237d04ca83d6 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:32.201260 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85bdae-1a3e-437d-99ef-237d04ca83d6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:32.201533 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85bdae-1a3e-437d-99ef-237d04ca83d6 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:32.203523 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 116/210] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:32.209027 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90d024-b817-4bcd-8663-286e53443ee4 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:32.209303 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90d024-b817-4bcd-8663-286e53443ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:32.209810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90d024-b817-4bcd-8663-286e53443ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:32.229499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4f90d024-b817-4bcd-8663-286e53443ee4 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:32.231040 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4f90d024-b817-4bcd-8663-286e53443ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:32.276089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 95/211] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:32.286056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:32.304487 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 117/212] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:16:32.543473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94a862-a56f-4b06-aec0-c414873e298b None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:32.585860 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90d024-b817-4bcd-8663-286e53443ee4 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:32.646941 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94a862-a56f-4b06-aec0-c414873e298b None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:32.649589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:32.685037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f730362-cfaf-405b-8ccc-862e99a224bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:32.686716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f730362-cfaf-405b-8ccc-862e99a224bb None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:32.687002 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f730362-cfaf-405b-8ccc-862e99a224bb None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:32.687287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f730362-cfaf-405b-8ccc-862e99a224bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:32.697843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f730362-cfaf-405b-8ccc-862e99a224bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:32.703446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-4f730362-cfaf-405b-8ccc-862e99a224bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:16:32.703446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:32.703446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:32.703446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:32.703446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:32.703446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:32.703446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:32.703446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:32.703446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:32.703446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:32.703446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:32.703446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:32.703446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:32.703446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:32.703446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:32.703446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:32.704322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:32.704322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:32.704322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:32.704322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:32.704322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:32.704322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:32.704322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:32.704322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:32.704322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:32.704322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:32.704322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:32.704322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:32.704322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:32.704322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:32.704322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:32.704322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:32.705148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:32.705148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:32.705148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:32.705148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:32.705148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:32.705148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:32.705148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:32.705148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:32.705148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:32.705148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:32.705148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:16:32.705148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:32.705749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90d024-b817-4bcd-8663-286e53443ee4 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:32.705821 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 96/213] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:16:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:32.711312 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29466739-0bad-4cde-b3d9-52cbd1ab0249 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:32.711604 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29466739-0bad-4cde-b3d9-52cbd1ab0249 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:32.711886 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29466739-0bad-4cde-b3d9-52cbd1ab0249 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:32.716815 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 97/214] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:32.716815 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29466739-0bad-4cde-b3d9-52cbd1ab0249 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:32.743288 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5866617-13ea-4dc4-a7ec-035ee71e91aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:32.744126 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5866617-13ea-4dc4-a7ec-035ee71e91aa None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:32.744595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5866617-13ea-4dc4-a7ec-035ee71e91aa None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:32.744962 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5866617-13ea-4dc4-a7ec-035ee71e91aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:32.755550 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5866617-13ea-4dc4-a7ec-035ee71e91aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:32.760363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-f5866617-13ea-4dc4-a7ec-035ee71e91aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:32.760363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:32.760363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:32.760363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:32.760363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:32.760363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:32.760363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:32.760363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:32.760363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:32.760363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:32.760363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:32.760363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:32.760363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:32.760363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:32.760363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:32.760363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:32.761272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:32.761272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:32.761272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:32.761272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:32.761272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:32.761272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:32.761272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:32.761272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:32.761272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:32.761272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:32.761272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:32.761272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:32.761272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:32.761272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:32.761272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:32.761272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:32.762152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:32.762152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:32.762152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:32.762152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:32.762152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:32.762152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:32.762152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:32.762152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:32.762152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:32.762152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:32.762152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:32.762152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:32.762152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 118/215] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:16:32.765596 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ca073-133a-40f9-a0eb-c0fbcd48ca10 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:32.765881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ca073-133a-40f9-a0eb-c0fbcd48ca10 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:32.766159 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ca073-133a-40f9-a0eb-c0fbcd48ca10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:32.785762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-eb9ca073-133a-40f9-a0eb-c0fbcd48ca10 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:32.786957 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-eb9ca073-133a-40f9-a0eb-c0fbcd48ca10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:32.830189 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:32.832471 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29466739-0bad-4cde-b3d9-52cbd1ab0249 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:32.858666 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 119/216] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:32.859901 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ca073-133a-40f9-a0eb-c0fbcd48ca10 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:32.878591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2b3ea-89ed-44ae-a03d-62fe67b8b0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:32.879385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2b3ea-89ed-44ae-a03d-62fe67b8b0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:32.879668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2b3ea-89ed-44ae-a03d-62fe67b8b0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:32.879949 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2b3ea-89ed-44ae-a03d-62fe67b8b0f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:32.881100 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2b3ea-89ed-44ae-a03d-62fe67b8b0f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:32.881412 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2b3ea-89ed-44ae-a03d-62fe67b8b0f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:32.882805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2b3ea-89ed-44ae-a03d-62fe67b8b0f9 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:32.895118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 98/217] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:32.901643 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2b3ea-89ed-44ae-a03d-62fe67b8b0f9 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:32.963065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:32.982536 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ca073-133a-40f9-a0eb-c0fbcd48ca10 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:33.025463 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2b3ea-89ed-44ae-a03d-62fe67b8b0f9 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:33.025871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929ba8b-458d-4ac0-8b3c-c11117172b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:33.026489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929ba8b-458d-4ac0-8b3c-c11117172b87 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:33.026770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929ba8b-458d-4ac0-8b3c-c11117172b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:33.027049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929ba8b-458d-4ac0-8b3c-c11117172b87 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:33.027718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929ba8b-458d-4ac0-8b3c-c11117172b87 None admin] RBAC: Adding query filter params (name=member) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:33.028023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929ba8b-458d-4ac0-8b3c-c11117172b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:33.029628 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929ba8b-458d-4ac0-8b3c-c11117172b87 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:33.039659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 120/218] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:33.045171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96434d8-4e40-483a-a59e-5b57bc862e26 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:33.045594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96434d8-4e40-483a-a59e-5b57bc862e26 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:33.045871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96434d8-4e40-483a-a59e-5b57bc862e26 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:33.047131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 121/219] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:33.047871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96434d8-4e40-483a-a59e-5b57bc862e26 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:33.066856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e99d5e-4d59-4dc3-9a75-b2bccf14e78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:33.067907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99d5e-4d59-4dc3-9a75-b2bccf14e78e None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:33.068192 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99d5e-4d59-4dc3-9a75-b2bccf14e78e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:33.068631 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99d5e-4d59-4dc3-9a75-b2bccf14e78e None admin] PATH_INFO: `/v3/users/2ad3fc7febe547c88a265690826f965c` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:33.069812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e99d5e-4d59-4dc3-9a75-b2bccf14e78e None admin] RBAC: Authorizing `identity:get_user(user_id=2ad3fc7febe547c88a265690826f965c)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:33.071312 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e99d5e-4d59-4dc3-9a75-b2bccf14e78e None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:33.078049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 99/220] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:32 2022] GET /identity/v3/users/2ad3fc7febe547c88a265690826f965c => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:33.078049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6a78f-4598-424c-9183-912462804e49 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:33.078049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6a78f-4598-424c-9183-912462804e49 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:33.078049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6a78f-4598-424c-9183-912462804e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:33.093388 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:33.095564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-ffa6a78f-4598-424c-9183-912462804e49 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:33.096772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ffa6a78f-4598-424c-9183-912462804e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:33.162467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96434d8-4e40-483a-a59e-5b57bc862e26 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:33.164929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 100/221] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:33.165831 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6a78f-4598-424c-9183-912462804e49 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:33.187088 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:33.197829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf21f3-9845-427f-9b04-9e43fc26e414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:33.198391 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf21f3-9845-427f-9b04-9e43fc26e414 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:33.198599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf21f3-9845-427f-9b04-9e43fc26e414 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:33.198873 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf21f3-9845-427f-9b04-9e43fc26e414 None admin] PATH_INFO: `/v3/users/915426f1e0fa4608858a9667e6c75faa` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:33.213297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf21f3-9845-427f-9b04-9e43fc26e414 None admin] RBAC: Authorizing `identity:get_user(user_id=915426f1e0fa4608858a9667e6c75faa)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:33.215123 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf21f3-9845-427f-9b04-9e43fc26e414 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:33.216980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 122/222] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:33 2022] GET /identity/v3/users/915426f1e0fa4608858a9667e6c75faa => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:33.221106 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf21f3-9845-427f-9b04-9e43fc26e414 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:33.270045 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6a78f-4598-424c-9183-912462804e49 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:33.303953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91810b8f-2d51-4243-93f7-d140d4e4ebf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:33.304818 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91810b8f-2d51-4243-93f7-d140d4e4ebf0 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:33.305242 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91810b8f-2d51-4243-93f7-d140d4e4ebf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:33.305688 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91810b8f-2d51-4243-93f7-d140d4e4ebf0 None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:33.306949 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91810b8f-2d51-4243-93f7-d140d4e4ebf0 None admin] RBAC: Authorizing `identity:get_project(project_id=05e8dee797fd40d4bab1c7dd5c687e36)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:33.308419 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91810b8f-2d51-4243-93f7-d140d4e4ebf0 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:33.310192 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 101/223] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:33 2022] GET /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:33.311116 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91810b8f-2d51-4243-93f7-d140d4e4ebf0 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:33.324933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:33.331609 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf21f3-9845-427f-9b04-9e43fc26e414 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:33.368563 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bd845-2af4-42b2-8c41-862d12986cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:33.369193 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bd845-2af4-42b2-8c41-862d12986cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:33.369470 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bd845-2af4-42b2-8c41-862d12986cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:33.369769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bd845-2af4-42b2-8c41-862d12986cb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:33.371075 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bd845-2af4-42b2-8c41-862d12986cb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:33.372571 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bd845-2af4-42b2-8c41-862d12986cb1 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:33.374587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 123/224] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:16:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:33.379601 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bd845-2af4-42b2-8c41-862d12986cb1 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:33.401564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:33.413897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91810b8f-2d51-4243-93f7-d140d4e4ebf0 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:33.449072 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415fc97-ecbf-436d-bf9f-7e3a85e4ea0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:33.449658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415fc97-ecbf-436d-bf9f-7e3a85e4ea0b None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:33.449933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415fc97-ecbf-436d-bf9f-7e3a85e4ea0b None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:33.450202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415fc97-ecbf-436d-bf9f-7e3a85e4ea0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:33.481729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bd845-2af4-42b2-8c41-862d12986cb1 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:33.514430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92889a4-1459-42be-a223-834d275c6985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:33.514934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415fc97-ecbf-436d-bf9f-7e3a85e4ea0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:33.515076 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92889a4-1459-42be-a223-834d275c6985 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:33.515353 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92889a4-1459-42be-a223-834d275c6985 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:33.515627 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92889a4-1459-42be-a223-834d275c6985 None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36/users/2ad3fc7febe547c88a265690826f965c/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:33.516439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415fc97-ecbf-436d-bf9f-7e3a85e4ea0b None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:33.517507 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92889a4-1459-42be-a223-834d275c6985 None admin] RBAC: Authorizing `identity:create_grant(project_id=05e8dee797fd40d4bab1c7dd5c687e36, user_id=2ad3fc7febe547c88a265690826f965c, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:33.518912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92889a4-1459-42be-a223-834d275c6985 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:33.599696 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:33.604072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 124/225] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:16:33 2022] PUT /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36/users/2ad3fc7febe547c88a265690826f965c/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:16:33.614170 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92889a4-1459-42be-a223-834d275c6985 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:33.614262 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 102/226] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:33.614262 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415fc97-ecbf-436d-bf9f-7e3a85e4ea0b None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:33.649384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:33.730822 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92889a4-1459-42be-a223-834d275c6985 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:33.737176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415fc97-ecbf-436d-bf9f-7e3a85e4ea0b None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:33.770932 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cf20a-d5b2-4e1c-8802-ddda33fc89b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:33.772428 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cf20a-d5b2-4e1c-8802-ddda33fc89b9 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:33.772771 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cf20a-d5b2-4e1c-8802-ddda33fc89b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:33.773042 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cf20a-d5b2-4e1c-8802-ddda33fc89b9 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:33.773705 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cf20a-d5b2-4e1c-8802-ddda33fc89b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:33.775195 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cf20a-d5b2-4e1c-8802-ddda33fc89b9 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:33.777343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b954923-1233-498e-8a9f-139f9e326dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:33.778143 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b954923-1233-498e-8a9f-139f9e326dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:33.778432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b954923-1233-498e-8a9f-139f9e326dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:33.778705 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b954923-1233-498e-8a9f-139f9e326dc1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:33.795701 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b954923-1233-498e-8a9f-139f9e326dc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:33.800703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-7b954923-1233-498e-8a9f-139f9e326dc1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:33.800703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:33.800703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:33.800703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:33.800703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:33.800703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:33.800703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:33.800703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:33.800703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:33.800703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:33.800703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:33.800703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:33.800703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:33.800703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:33.800703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:33.800703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:33.804755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:33.804755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:33.804755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:33.804755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:33.804755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:33.804755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:33.804755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:33.804755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:33.804755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:33.804755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:33.804755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:33.804755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:33.804755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:33.804755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:33.804755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:33.804755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:33.805555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:33.805555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:33.805555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:33.805555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:33.805555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:33.805555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:33.805555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:33.805555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:33.805555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:33.805555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:33.805555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:33.805555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:33.805555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 103/227] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:16:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:33.805555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b954923-1233-498e-8a9f-139f9e326dc1 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:33.852353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:33.887438 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 125/228] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 27 16:16:33 2022] POST /identity/v3/users => generated 297 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:16:33.893460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cf20a-d5b2-4e1c-8802-ddda33fc89b9 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:33.901856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b954923-1233-498e-8a9f-139f9e326dc1 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:33.943438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46502138-e7cf-46d9-af3c-99dcc99f68c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:33.945307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46502138-e7cf-46d9-af3c-99dcc99f68c9 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:33.945983 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46502138-e7cf-46d9-af3c-99dcc99f68c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:33.946566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46502138-e7cf-46d9-af3c-99dcc99f68c9 None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:33.948246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46502138-e7cf-46d9-af3c-99dcc99f68c9 None admin] RBAC: Authorizing `identity:get_project(project_id=05e8dee797fd40d4bab1c7dd5c687e36)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:33.951145 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46502138-e7cf-46d9-af3c-99dcc99f68c9 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:33.960238 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 104/229] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:33 2022] GET /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:33.962621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46502138-e7cf-46d9-af3c-99dcc99f68c9 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:34.021752 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:34.049942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cf20a-d5b2-4e1c-8802-ddda33fc89b9 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:34.094631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab429a3-2b36-476a-9f18-c5af81ee6844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:34.095625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab429a3-2b36-476a-9f18-c5af81ee6844 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:34.095906 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab429a3-2b36-476a-9f18-c5af81ee6844 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:34.096181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab429a3-2b36-476a-9f18-c5af81ee6844 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:34.096873 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab429a3-2b36-476a-9f18-c5af81ee6844 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:34.097179 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab429a3-2b36-476a-9f18-c5af81ee6844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:34.098569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab429a3-2b36-476a-9f18-c5af81ee6844 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:34.104616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46502138-e7cf-46d9-af3c-99dcc99f68c9 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:34.108473 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 126/230] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:16:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:34.113991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab429a3-2b36-476a-9f18-c5af81ee6844 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:34.124728 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:34.147579 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e90c2b-0772-48e7-b510-c8a48e8509ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:34.148561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e90c2b-0772-48e7-b510-c8a48e8509ce None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:34.148946 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e90c2b-0772-48e7-b510-c8a48e8509ce None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:34.149339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e90c2b-0772-48e7-b510-c8a48e8509ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:34.150600 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e90c2b-0772-48e7-b510-c8a48e8509ce None admin] RBAC: Adding query filter params (role.id=e7e5b03d7a3d404f841a8341244d5d78, scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36, user.id=915426f1e0fa4608858a9667e6c75faa) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:34.150923 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e90c2b-0772-48e7-b510-c8a48e8509ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:34.153638 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e90c2b-0772-48e7-b510-c8a48e8509ce None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:34.161446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 105/231] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:16:33 2022] GET /identity/v3/role_assignments?user.id=915426f1e0fa4608858a9667e6c75faa&scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36&role.id=e7e5b03d7a3d404f841a8341244d5d78 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:34.243602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab429a3-2b36-476a-9f18-c5af81ee6844 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:34.283065 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d000a0-5d55-476e-b4c7-b942389e77af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:34.283718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d000a0-5d55-476e-b4c7-b942389e77af None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:34.283997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d000a0-5d55-476e-b4c7-b942389e77af None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:34.284279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d000a0-5d55-476e-b4c7-b942389e77af None admin] PATH_INFO: `/v3/users/2ad3fc7febe547c88a265690826f965c` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:34.285625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d000a0-5d55-476e-b4c7-b942389e77af None admin] RBAC: Authorizing `identity:get_user(user_id=2ad3fc7febe547c88a265690826f965c)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:34.287175 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d000a0-5d55-476e-b4c7-b942389e77af None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:34.289191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 127/232] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:34 2022] GET /identity/v3/users/2ad3fc7febe547c88a265690826f965c => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:34.295050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e90c2b-0772-48e7-b510-c8a48e8509ce None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:34.421024 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e90c2b-0772-48e7-b510-c8a48e8509ce None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:34.467574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea434d0-3a1b-44b8-b86a-422dbd60dc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:34.468616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea434d0-3a1b-44b8-b86a-422dbd60dc99 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:34.469094 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea434d0-3a1b-44b8-b86a-422dbd60dc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:34.469558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea434d0-3a1b-44b8-b86a-422dbd60dc99 None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:34.470891 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea434d0-3a1b-44b8-b86a-422dbd60dc99 None admin] RBAC: Authorizing `identity:get_project(project_id=05e8dee797fd40d4bab1c7dd5c687e36)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:34.472577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea434d0-3a1b-44b8-b86a-422dbd60dc99 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:34.474401 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 106/233] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:34 2022] GET /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:34.480263 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d000a0-5d55-476e-b4c7-b942389e77af None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:34.498891 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:34.626079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d000a0-5d55-476e-b4c7-b942389e77af None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:34.690986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e74f6d-d606-4cb2-a70c-986eff3246c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:34.691630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e74f6d-d606-4cb2-a70c-986eff3246c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:34.691915 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e74f6d-d606-4cb2-a70c-986eff3246c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:34.692185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e74f6d-d606-4cb2-a70c-986eff3246c8 None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36/users/2ad3fc7febe547c88a265690826f965c/roles/f60b6d7b309a4537a233198456c7aa34` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:34.694438 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e74f6d-d606-4cb2-a70c-986eff3246c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=05e8dee797fd40d4bab1c7dd5c687e36, user_id=2ad3fc7febe547c88a265690826f965c, role_id=f60b6d7b309a4537a233198456c7aa34)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:34.695878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e74f6d-d606-4cb2-a70c-986eff3246c8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:34.770618 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 128/234] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:16:34 2022] PUT /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36/users/2ad3fc7febe547c88a265690826f965c/roles/f60b6d7b309a4537a233198456c7aa34 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:16:35.878789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa21e0-0615-4f90-9dff-1ac37b59d1f9 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:35.879317 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa21e0-0615-4f90-9dff-1ac37b59d1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:35.879317 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa21e0-0615-4f90-9dff-1ac37b59d1f9 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:35.880957 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 107/235] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:35.886013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60bc75-8c54-4402-95c3-610365ccee1e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:35.886843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60bc75-8c54-4402-95c3-610365ccee1e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:35.887348 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60bc75-8c54-4402-95c3-610365ccee1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:35.906431 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4e60bc75-8c54-4402-95c3-610365ccee1e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:35.907939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4e60bc75-8c54-4402-95c3-610365ccee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:35.989883 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:35.996368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 129/236] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:36.445229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa21e0-0615-4f90-9dff-1ac37b59d1f9 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:36.508816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:36.567144 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa21e0-0615-4f90-9dff-1ac37b59d1f9 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:36.602716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80840b-b3be-4ebe-9105-edecfb64ade3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:36.603626 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80840b-b3be-4ebe-9105-edecfb64ade3 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:36.604056 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80840b-b3be-4ebe-9105-edecfb64ade3 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:36.604538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80840b-b3be-4ebe-9105-edecfb64ade3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:36.616216 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80840b-b3be-4ebe-9105-edecfb64ade3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:36.621240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-5d80840b-b3be-4ebe-9105-edecfb64ade3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:16:36.621240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:36.621240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:36.621240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:36.621240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:36.621240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:36.621240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:36.621240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:36.621240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:36.621240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:36.621240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:36.621240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:36.621240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:36.621240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:36.621240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:36.621240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:36.622307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:36.622307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:36.622307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:36.622307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:36.622307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:36.622307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:36.622307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:36.622307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:36.622307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:36.622307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:36.622307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:36.622307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:36.622307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:36.622307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:36.622307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:36.622307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:36.623325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:36.623325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:36.623325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:36.623325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:36.623325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:36.623325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:36.623325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:36.623325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:36.623325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:36.623325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:36.623325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:16:36.623325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:36.625721 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 108/237] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:16:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:36.631292 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60bc75-8c54-4402-95c3-610365ccee1e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:36.758023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60bc75-8c54-4402-95c3-610365ccee1e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:36.806699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70181334-8cdd-43f4-8ed7-1f262e07224a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:36.807343 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70181334-8cdd-43f4-8ed7-1f262e07224a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:36.807622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70181334-8cdd-43f4-8ed7-1f262e07224a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:36.807895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70181334-8cdd-43f4-8ed7-1f262e07224a None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:36.808673 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70181334-8cdd-43f4-8ed7-1f262e07224a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:36.808979 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70181334-8cdd-43f4-8ed7-1f262e07224a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:36.810430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70181334-8cdd-43f4-8ed7-1f262e07224a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:36.824828 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 130/238] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:36.831183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80840b-b3be-4ebe-9105-edecfb64ade3 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:36.931558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50014d-3537-4e41-a78e-1e1aa98b81b4 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:36.932562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50014d-3537-4e41-a78e-1e1aa98b81b4 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:36.933046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50014d-3537-4e41-a78e-1e1aa98b81b4 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:36.935202 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 131/239] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:16:36.945676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f882386-5b1a-4b21-8039-3bd14c9b2a0e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:36.946239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f882386-5b1a-4b21-8039-3bd14c9b2a0e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:36.946728 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f882386-5b1a-4b21-8039-3bd14c9b2a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:36.957992 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80840b-b3be-4ebe-9105-edecfb64ade3 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:36.967433 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:36.971044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9f882386-5b1a-4b21-8039-3bd14c9b2a0e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:36.972438 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9f882386-5b1a-4b21-8039-3bd14c9b2a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:36.995322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69535e3-fc85-4b43-8cf5-81a664a50d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:36.996423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69535e3-fc85-4b43-8cf5-81a664a50d91 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:36.997144 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69535e3-fc85-4b43-8cf5-81a664a50d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:36.997598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69535e3-fc85-4b43-8cf5-81a664a50d91 None admin] PATH_INFO: `/v3/users/2ad3fc7febe547c88a265690826f965c` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:36.999567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69535e3-fc85-4b43-8cf5-81a664a50d91 None admin] RBAC: Authorizing `identity:get_user(user_id=2ad3fc7febe547c88a265690826f965c)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:37.001792 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69535e3-fc85-4b43-8cf5-81a664a50d91 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:37.004676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 109/240] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:36 2022] GET /identity/v3/users/2ad3fc7febe547c88a265690826f965c => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:37.006629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee7499-d8c8-480e-aa4e-c36a0efc1a10 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:37.007180 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee7499-d8c8-480e-aa4e-c36a0efc1a10 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:37.007610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee7499-d8c8-480e-aa4e-c36a0efc1a10 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:37.013193 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 110/241] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:37.013341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee7499-d8c8-480e-aa4e-c36a0efc1a10 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:37.044302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:37.060135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 132/242] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:37.065873 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41271b64-cd5a-40c1-b9f6-ff682915c1bd None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:37.068278 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41271b64-cd5a-40c1-b9f6-ff682915c1bd None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:37.068723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41271b64-cd5a-40c1-b9f6-ff682915c1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:37.098978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-41271b64-cd5a-40c1-b9f6-ff682915c1bd None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:37.100998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-41271b64-cd5a-40c1-b9f6-ff682915c1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:37.178104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee7499-d8c8-480e-aa4e-c36a0efc1a10 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:37.195836 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 133/243] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:37.197388 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5fb89-c9af-4436-8e3f-c3ab769f9cd7 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:37.197684 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5fb89-c9af-4436-8e3f-c3ab769f9cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:37.197959 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5fb89-c9af-4436-8e3f-c3ab769f9cd7 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:37.199201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 134/244] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:37.204906 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ba4b3-583a-444f-9254-caf65fde8790 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:37.205354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ba4b3-583a-444f-9254-caf65fde8790 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:37.205769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ba4b3-583a-444f-9254-caf65fde8790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:37.218448 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f986d54-e614-43c6-b586-9d3d311a1ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:37.219319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f986d54-e614-43c6-b586-9d3d311a1ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:37.219743 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f986d54-e614-43c6-b586-9d3d311a1ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:37.220159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f986d54-e614-43c6-b586-9d3d311a1ca5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:37.225143 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-0f2ba4b3-583a-444f-9254-caf65fde8790 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:37.226544 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0f2ba4b3-583a-444f-9254-caf65fde8790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:37.310903 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:37.350931 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f986d54-e614-43c6-b586-9d3d311a1ca5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:37.353646 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f986d54-e614-43c6-b586-9d3d311a1ca5 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:37.364038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 135/245] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:16:37.407840 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182d20d-c690-48cf-b856-c2934082f945 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:37.408371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182d20d-c690-48cf-b856-c2934082f945 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:37.408826 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182d20d-c690-48cf-b856-c2934082f945 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:37.410380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 136/246] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:16:37.415431 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef872069-16e8-4993-9064-72aa547d1496 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:37.415962 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef872069-16e8-4993-9064-72aa547d1496 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:37.416409 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef872069-16e8-4993-9064-72aa547d1496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:37.435931 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ef872069-16e8-4993-9064-72aa547d1496 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:37.438056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ef872069-16e8-4993-9064-72aa547d1496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:37.462922 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 111/247] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:37.463935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f986d54-e614-43c6-b586-9d3d311a1ca5 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:37.499380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:37.526119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 137/248] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:16:37.533341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef872069-16e8-4993-9064-72aa547d1496 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:37.554403 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:37.582958 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f986d54-e614-43c6-b586-9d3d311a1ca5 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:37.626847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f951c6-0968-4fba-a52f-73ebb8e58cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:37.627681 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f951c6-0968-4fba-a52f-73ebb8e58cdb None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:37.627955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f951c6-0968-4fba-a52f-73ebb8e58cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:37.628221 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f951c6-0968-4fba-a52f-73ebb8e58cdb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:37.643322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f951c6-0968-4fba-a52f-73ebb8e58cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:37.646038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef872069-16e8-4993-9064-72aa547d1496 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:37.649444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-c7f951c6-0968-4fba-a52f-73ebb8e58cdb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 16:16:37.649444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:37.649444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:37.649444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:37.649444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:37.649444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:37.649444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:37.649444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:37.649444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:37.649444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:37.649444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:37.649444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:37.649444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:37.649444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:37.649444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:37.649444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:37.650343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:37.650343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:37.650343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:37.650343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:37.650343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:37.650343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:37.650343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:37.650343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:37.650343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:37.650343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:37.650343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:37.650343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:37.650343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:37.650343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:37.650343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:37.650343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:37.651147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:37.651147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:37.651147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:37.651147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:37.651147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:37.651147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:37.651147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:37.651147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:37.651147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:37.651147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:37.651147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 16:16:37.651147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:37.651147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 112/249] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:37.651797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f951c6-0968-4fba-a52f-73ebb8e58cdb None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:37.685831 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770b93f-4494-418d-8cda-228d86a1395f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:37.687351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770b93f-4494-418d-8cda-228d86a1395f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:37.687834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770b93f-4494-418d-8cda-228d86a1395f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:37.688293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770b93f-4494-418d-8cda-228d86a1395f None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:37.689715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770b93f-4494-418d-8cda-228d86a1395f None admin] RBAC: Authorizing `identity:get_project(project_id=05e8dee797fd40d4bab1c7dd5c687e36)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:37.691466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770b93f-4494-418d-8cda-228d86a1395f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:37.693305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 138/250] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:37 2022] GET /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:37.694241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770b93f-4494-418d-8cda-228d86a1395f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:37.751148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:37.757095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f951c6-0968-4fba-a52f-73ebb8e58cdb None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:37.797638 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9544c-779d-405c-96c8-52b78c257d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:37.798692 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9544c-779d-405c-96c8-52b78c257d71 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:37.798692 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9544c-779d-405c-96c8-52b78c257d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:37.799141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9544c-779d-405c-96c8-52b78c257d71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:37.802230 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:37.810128 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9544c-779d-405c-96c8-52b78c257d71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:37.812124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770b93f-4494-418d-8cda-228d86a1395f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:37.815000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-4fb9544c-779d-405c-96c8-52b78c257d71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:37.815000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:37.815000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:37.815000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:37.815000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:37.815000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:37.815000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:37.815000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:37.815000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:37.815000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:37.815000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:37.815000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:37.815000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:37.815000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:37.815000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:37.815000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:37.815894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:37.815894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:37.815894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:37.815894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:37.815894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:37.815894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:37.815894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:37.815894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:37.815894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:37.815894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:37.815894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:37.815894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:37.815894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:37.815894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:37.815894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:37.815894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:37.821165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:37.821165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:37.821165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:37.821165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:37.821165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:37.821165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:37.821165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:37.821165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:37.821165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:37.821165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:37.821165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:37.821165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:37.821165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 113/251] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:37.821165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9544c-779d-405c-96c8-52b78c257d71 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:37.850085 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c32a6f-71d9-4cac-b09c-3e581566d3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:37.850621 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c32a6f-71d9-4cac-b09c-3e581566d3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:37.850901 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c32a6f-71d9-4cac-b09c-3e581566d3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:37.851176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c32a6f-71d9-4cac-b09c-3e581566d3a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:37.851833 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c32a6f-71d9-4cac-b09c-3e581566d3a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:37.852135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c32a6f-71d9-4cac-b09c-3e581566d3a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:37.853551 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c32a6f-71d9-4cac-b09c-3e581566d3a2 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:37.862172 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 139/252] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:37.862956 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c32a6f-71d9-4cac-b09c-3e581566d3a2 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:37.916190 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9544c-779d-405c-96c8-52b78c257d71 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:37.949326 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ed4f0-fd5c-43b1-8e5f-1be0c651d0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:37.949953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ed4f0-fd5c-43b1-8e5f-1be0c651d0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:37.950229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ed4f0-fd5c-43b1-8e5f-1be0c651d0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:37.950503 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ed4f0-fd5c-43b1-8e5f-1be0c651d0b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:37.951608 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ed4f0-fd5c-43b1-8e5f-1be0c651d0b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:37.953097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ed4f0-fd5c-43b1-8e5f-1be0c651d0b6 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:37.954647 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 114/253] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:16:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:37.956622 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ed4f0-fd5c-43b1-8e5f-1be0c651d0b6 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:37.960477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c32a6f-71d9-4cac-b09c-3e581566d3a2 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:37.971155 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:37.994375 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205edc99-ce64-44b9-9dfd-3b7b5785f126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:37.994973 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205edc99-ce64-44b9-9dfd-3b7b5785f126 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:37.995252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205edc99-ce64-44b9-9dfd-3b7b5785f126 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:37.995526 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205edc99-ce64-44b9-9dfd-3b7b5785f126 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:37.996237 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205edc99-ce64-44b9-9dfd-3b7b5785f126 None admin] RBAC: Adding query filter params (role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36, user.id=2ad3fc7febe547c88a265690826f965c) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:37.996592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205edc99-ce64-44b9-9dfd-3b7b5785f126 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:37.998072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205edc99-ce64-44b9-9dfd-3b7b5785f126 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:38.003962 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 140/254] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:16:37 2022] GET /identity/v3/role_assignments?user.id=2ad3fc7febe547c88a265690826f965c&scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:38.004787 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205edc99-ce64-44b9-9dfd-3b7b5785f126 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:38.019411 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:38.062170 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ed4f0-fd5c-43b1-8e5f-1be0c651d0b6 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:38.100259 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0401c2-2271-40cf-a243-8c809fe22772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:38.100855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0401c2-2271-40cf-a243-8c809fe22772 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:38.101129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0401c2-2271-40cf-a243-8c809fe22772 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:38.101422 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0401c2-2271-40cf-a243-8c809fe22772 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:38.113095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0401c2-2271-40cf-a243-8c809fe22772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:38.118011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-ea0401c2-2271-40cf-a243-8c809fe22772 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:38.118011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:38.118011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:38.118011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:38.118011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:38.118011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:38.118011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:38.118011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:38.118011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:38.118011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:38.118011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:38.118011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:38.118011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:38.118011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:38.118011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:38.118011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:38.118970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:38.118970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:38.118970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:38.118970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:38.118970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:38.118970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:38.118970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:38.118970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:38.118970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:38.118970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:38.118970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:38.118970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:38.118970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:38.118970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:38.118970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:38.118970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:38.119789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:38.119789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:38.119789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:38.119789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:38.119789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:38.119789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:38.119789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:38.119789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:38.119789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:38.119789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:38.119789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:38.119789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:38.119789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 115/255] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:16:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:38.120833 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0401c2-2271-40cf-a243-8c809fe22772 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:38.135269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205edc99-ce64-44b9-9dfd-3b7b5785f126 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:38.174749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff314a5e-dab3-43a1-b052-bd86ce57f038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:38.175375 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff314a5e-dab3-43a1-b052-bd86ce57f038 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:38.175655 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff314a5e-dab3-43a1-b052-bd86ce57f038 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:38.175933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff314a5e-dab3-43a1-b052-bd86ce57f038 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:38.176662 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff314a5e-dab3-43a1-b052-bd86ce57f038 None admin] RBAC: Adding query filter params (name=member) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:38.176975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff314a5e-dab3-43a1-b052-bd86ce57f038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:38.178364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff314a5e-dab3-43a1-b052-bd86ce57f038 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:38.189117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 141/256] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:38.189925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff314a5e-dab3-43a1-b052-bd86ce57f038 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:38.229352 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0401c2-2271-40cf-a243-8c809fe22772 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:38.234578 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:38.260180 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:38.272614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76875187-3fef-4fa3-8417-d17005296d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:38.273254 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76875187-3fef-4fa3-8417-d17005296d4c None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:38.273536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76875187-3fef-4fa3-8417-d17005296d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:38.273815 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76875187-3fef-4fa3-8417-d17005296d4c None admin] PATH_INFO: `/v3/users/febd7f39fbfc4f5c85afca27b3ceb8db` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:38.287300 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76875187-3fef-4fa3-8417-d17005296d4c None admin] RBAC: Authorizing `identity:get_user(user_id=febd7f39fbfc4f5c85afca27b3ceb8db)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:38.288871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76875187-3fef-4fa3-8417-d17005296d4c None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:38.290917 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 116/257] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:38 2022] GET /identity/v3/users/febd7f39fbfc4f5c85afca27b3ceb8db => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:38.291818 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76875187-3fef-4fa3-8417-d17005296d4c None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:38.304935 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff314a5e-dab3-43a1-b052-bd86ce57f038 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:38.338466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746e994-6cae-42e1-9234-05e6640578e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:38.339066 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746e994-6cae-42e1-9234-05e6640578e2 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:38.339347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746e994-6cae-42e1-9234-05e6640578e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:38.339621 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746e994-6cae-42e1-9234-05e6640578e2 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:38.340269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746e994-6cae-42e1-9234-05e6640578e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:38.341731 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746e994-6cae-42e1-9234-05e6640578e2 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:38.387714 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76875187-3fef-4fa3-8417-d17005296d4c None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:38.420687 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d694ef4-903f-4208-acb7-c45634d895d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:38.421286 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d694ef4-903f-4208-acb7-c45634d895d5 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:38.421566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d694ef4-903f-4208-acb7-c45634d895d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:38.421837 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d694ef4-903f-4208-acb7-c45634d895d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:38.422488 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d694ef4-903f-4208-acb7-c45634d895d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:38.422790 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d694ef4-903f-4208-acb7-c45634d895d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:38.424164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d694ef4-903f-4208-acb7-c45634d895d5 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:38.431709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 117/258] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:16:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:38.432588 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d694ef4-903f-4208-acb7-c45634d895d5 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:38.460788 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 142/259] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 27 16:16:38 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:16:38.461623 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746e994-6cae-42e1-9234-05e6640578e2 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:38.491037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:38.553264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d694ef4-903f-4208-acb7-c45634d895d5 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:38.566999 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:38.577541 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746e994-6cae-42e1-9234-05e6640578e2 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:38.591313 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5a0dc-2c67-42b0-a11e-efbf91db0d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:38.591971 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5a0dc-2c67-42b0-a11e-efbf91db0d0a None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:38.592284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5a0dc-2c67-42b0-a11e-efbf91db0d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:38.592688 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5a0dc-2c67-42b0-a11e-efbf91db0d0a None admin] PATH_INFO: `/v3/users/915426f1e0fa4608858a9667e6c75faa` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:38.593875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5a0dc-2c67-42b0-a11e-efbf91db0d0a None admin] RBAC: Authorizing `identity:get_user(user_id=915426f1e0fa4608858a9667e6c75faa)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:38.595381 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5a0dc-2c67-42b0-a11e-efbf91db0d0a None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:38.601686 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 118/260] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:38 2022] GET /identity/v3/users/915426f1e0fa4608858a9667e6c75faa => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:38.601686 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5a0dc-2c67-42b0-a11e-efbf91db0d0a None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:38.620732 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddde30-5664-4159-a32a-58af3d7d8c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:38.621466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddde30-5664-4159-a32a-58af3d7d8c0e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:38.621822 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddde30-5664-4159-a32a-58af3d7d8c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:38.622167 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddde30-5664-4159-a32a-58af3d7d8c0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:38.714271 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddde30-5664-4159-a32a-58af3d7d8c0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:38.715177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5a0dc-2c67-42b0-a11e-efbf91db0d0a None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:38.715892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddde30-5664-4159-a32a-58af3d7d8c0e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:38.732843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:38.759056 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62327a9-b8d9-47e9-aef0-5d01441af7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:38.759878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62327a9-b8d9-47e9-aef0-5d01441af7dd None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:38.759987 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62327a9-b8d9-47e9-aef0-5d01441af7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:38.760237 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62327a9-b8d9-47e9-aef0-5d01441af7dd None admin] PATH_INFO: `/v3/users/2ad3fc7febe547c88a265690826f965c` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:38.763467 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62327a9-b8d9-47e9-aef0-5d01441af7dd None admin] RBAC: Authorizing `identity:get_user(user_id=2ad3fc7febe547c88a265690826f965c)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:38.765574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62327a9-b8d9-47e9-aef0-5d01441af7dd None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:38.768456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 119/261] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:38 2022] GET /identity/v3/users/2ad3fc7febe547c88a265690826f965c => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:38.769272 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62327a9-b8d9-47e9-aef0-5d01441af7dd None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:38.830350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:38.844387 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 143/262] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:38.845200 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddde30-5664-4159-a32a-58af3d7d8c0e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:38.895347 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62327a9-b8d9-47e9-aef0-5d01441af7dd None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:38.931472 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50f522-4cc9-4545-80fd-d8933ed1853b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:38.932214 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50f522-4cc9-4545-80fd-d8933ed1853b None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:38.932543 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50f522-4cc9-4545-80fd-d8933ed1853b None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:38.932819 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50f522-4cc9-4545-80fd-d8933ed1853b None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:38.933961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50f522-4cc9-4545-80fd-d8933ed1853b None admin] RBAC: Authorizing `identity:get_project(project_id=05e8dee797fd40d4bab1c7dd5c687e36)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:38.935432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50f522-4cc9-4545-80fd-d8933ed1853b None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:38.937554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 120/263] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:38 2022] GET /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:38.938349 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50f522-4cc9-4545-80fd-d8933ed1853b None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:38.966921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddde30-5664-4159-a32a-58af3d7d8c0e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:38.996564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:39.011470 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58a7d4-cf32-4f6b-87f2-d33be684cf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:39.012089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58a7d4-cf32-4f6b-87f2-d33be684cf00 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:39.012404 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58a7d4-cf32-4f6b-87f2-d33be684cf00 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:39.012681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58a7d4-cf32-4f6b-87f2-d33be684cf00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:39.059360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50f522-4cc9-4545-80fd-d8933ed1853b None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:39.083484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:39.093491 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58a7d4-cf32-4f6b-87f2-d33be684cf00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:39.094979 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58a7d4-cf32-4f6b-87f2-d33be684cf00 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:39.097878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d2cdc-942e-49ab-9f0c-c81cdd9aeaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:39.098692 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d2cdc-942e-49ab-9f0c-c81cdd9aeaaf None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:39.099119 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d2cdc-942e-49ab-9f0c-c81cdd9aeaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:39.099564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d2cdc-942e-49ab-9f0c-c81cdd9aeaaf None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:39.100882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d2cdc-942e-49ab-9f0c-c81cdd9aeaaf None admin] RBAC: Authorizing `identity:get_project(project_id=05e8dee797fd40d4bab1c7dd5c687e36)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:39.102478 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d2cdc-942e-49ab-9f0c-c81cdd9aeaaf None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:39.104278 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 121/264] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:38 2022] GET /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:39.105291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d2cdc-942e-49ab-9f0c-c81cdd9aeaaf None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:39.199672 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 144/265] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:39.200325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58a7d4-cf32-4f6b-87f2-d33be684cf00 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:39.215260 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d2cdc-942e-49ab-9f0c-c81cdd9aeaaf None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:39.232629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:39.251155 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa1a4a-357e-4daa-bc69-08c5827a6df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:39.252158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa1a4a-357e-4daa-bc69-08c5827a6df9 None admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:39.252724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa1a4a-357e-4daa-bc69-08c5827a6df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:39.253196 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa1a4a-357e-4daa-bc69-08c5827a6df9 None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36/users/915426f1e0fa4608858a9667e6c75faa/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:39.255358 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa1a4a-357e-4daa-bc69-08c5827a6df9 None admin] RBAC: Authorizing `identity:create_grant(project_id=05e8dee797fd40d4bab1c7dd5c687e36, user_id=915426f1e0fa4608858a9667e6c75faa, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:39.257070 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa1a4a-357e-4daa-bc69-08c5827a6df9 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:39.294777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:39.304267 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58a7d4-cf32-4f6b-87f2-d33be684cf00 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:39.334941 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 122/266] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:16:39 2022] PUT /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36/users/915426f1e0fa4608858a9667e6c75faa/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:16:39.336904 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa1a4a-357e-4daa-bc69-08c5827a6df9 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:39.351136 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54918517-ae70-42f0-902a-278895739f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:39.353748 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54918517-ae70-42f0-902a-278895739f43 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:39.355830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54918517-ae70-42f0-902a-278895739f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:39.356428 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54918517-ae70-42f0-902a-278895739f43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:39.357498 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54918517-ae70-42f0-902a-278895739f43 None admin] RBAC: Adding query filter params (role.id=018bcecca3d84d2d990678f3d1d53886, scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36, user.id=febd7f39fbfc4f5c85afca27b3ceb8db) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:39.358953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54918517-ae70-42f0-902a-278895739f43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:39.364040 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54918517-ae70-42f0-902a-278895739f43 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:39.376256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 145/267] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:16:39 2022] GET /identity/v3/role_assignments?user.id=febd7f39fbfc4f5c85afca27b3ceb8db&scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36&role.id=018bcecca3d84d2d990678f3d1d53886 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:39.487821 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa1a4a-357e-4daa-bc69-08c5827a6df9 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:39.546463 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a47a5-b3b7-46e3-98bd-eb097fd071db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:39.547578 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a47a5-b3b7-46e3-98bd-eb097fd071db None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:39.548078 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a47a5-b3b7-46e3-98bd-eb097fd071db None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:39.548650 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a47a5-b3b7-46e3-98bd-eb097fd071db None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:39.550126 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a47a5-b3b7-46e3-98bd-eb097fd071db None admin] RBAC: Authorizing `identity:get_project(project_id=05e8dee797fd40d4bab1c7dd5c687e36)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:39.551858 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a47a5-b3b7-46e3-98bd-eb097fd071db None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:39.554031 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 123/268] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:39 2022] GET /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:39.560299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54918517-ae70-42f0-902a-278895739f43 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:39.679799 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54918517-ae70-42f0-902a-278895739f43 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:39.719744 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da94469-2200-48da-8309-d6d174852ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:39.720381 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da94469-2200-48da-8309-d6d174852ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:39.720655 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da94469-2200-48da-8309-d6d174852ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:39.720927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da94469-2200-48da-8309-d6d174852ac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:39.721651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da94469-2200-48da-8309-d6d174852ac4 None admin] RBAC: Adding query filter params (role.id=f60b6d7b309a4537a233198456c7aa34, scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36, user.id=2ad3fc7febe547c88a265690826f965c) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:39.721957 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da94469-2200-48da-8309-d6d174852ac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:39.723404 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da94469-2200-48da-8309-d6d174852ac4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:39.729989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 146/269] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:16:39 2022] GET /identity/v3/role_assignments?user.id=2ad3fc7febe547c88a265690826f965c&scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36&role.id=f60b6d7b309a4537a233198456c7aa34 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:40.935719 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fb553-5b16-42fe-9377-4693459547aa None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:40.937297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fb553-5b16-42fe-9377-4693459547aa None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:40.937777 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fb553-5b16-42fe-9377-4693459547aa None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:40.939324 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 124/270] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:40.944770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87743a33-ef04-4607-a8df-6866dd7065b0 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:40.945563 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87743a33-ef04-4607-a8df-6866dd7065b0 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:40.946036 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87743a33-ef04-4607-a8df-6866dd7065b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:40.964504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-87743a33-ef04-4607-a8df-6866dd7065b0 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:40.965953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-87743a33-ef04-4607-a8df-6866dd7065b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:40.980248 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:41.033993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 147/271] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:41.040409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e06a2-35da-47cf-957d-4855ee8603a8 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:41.040409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e06a2-35da-47cf-957d-4855ee8603a8 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:41.040409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e06a2-35da-47cf-957d-4855ee8603a8 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:41.040409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 125/272] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:41.043530 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db023146-acf5-41b2-850c-6d55edf9b38d None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:41.043823 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db023146-acf5-41b2-850c-6d55edf9b38d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:41.044364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db023146-acf5-41b2-850c-6d55edf9b38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:41.062715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-db023146-acf5-41b2-850c-6d55edf9b38d None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:41.063818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-db023146-acf5-41b2-850c-6d55edf9b38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:41.130675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 148/273] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:41.308946 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e06a2-35da-47cf-957d-4855ee8603a8 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:41.357244 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:41.398948 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db023146-acf5-41b2-850c-6d55edf9b38d None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:41.423680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e06a2-35da-47cf-957d-4855ee8603a8 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:41.473670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d913f4c-d8df-412f-83e8-366298aad823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:41.475154 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d913f4c-d8df-412f-83e8-366298aad823 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:41.475906 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d913f4c-d8df-412f-83e8-366298aad823 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:41.476534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d913f4c-d8df-412f-83e8-366298aad823 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:41.491118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d913f4c-d8df-412f-83e8-366298aad823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:41.498183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-3d913f4c-d8df-412f-83e8-366298aad823 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:41.498183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:41.498183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:41.498183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:41.498183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:41.498183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:41.498183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:41.498183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:41.498183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:41.498183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:41.498183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:41.498183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:41.498183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:41.498183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:41.498183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:41.498183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:41.499055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:41.499055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:41.499055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:41.499055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:41.499055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:41.499055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:41.499055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:41.499055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:41.499055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:41.499055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:41.499055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:41.499055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:41.499055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:41.499055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:41.499055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:41.499055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:41.499856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:41.499856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:41.499856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:41.499856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:41.499856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:41.499856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:41.499856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:41.499856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:41.499856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:41.499856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:41.499856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:41.499856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:41.501783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 126/274] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:41.507544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d913f4c-d8df-412f-83e8-366298aad823 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:41.510997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:41.531548 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db023146-acf5-41b2-850c-6d55edf9b38d None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:41.567719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69205567-2d70-46cc-b753-d89234812a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:41.568754 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69205567-2d70-46cc-b753-d89234812a83 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:41.569234 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69205567-2d70-46cc-b753-d89234812a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:41.569741 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69205567-2d70-46cc-b753-d89234812a83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:41.571438 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69205567-2d70-46cc-b753-d89234812a83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:41.573259 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69205567-2d70-46cc-b753-d89234812a83 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:41.580060 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 149/275] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:16:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:41.581489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69205567-2d70-46cc-b753-d89234812a83 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:41.621423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d913f4c-d8df-412f-83e8-366298aad823 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:41.624205 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:41.659023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9794f-d824-4fb3-a610-caa23e7911cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:41.659632 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9794f-d824-4fb3-a610-caa23e7911cd None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:41.659908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9794f-d824-4fb3-a610-caa23e7911cd None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:41.660181 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9794f-d824-4fb3-a610-caa23e7911cd None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:41.660866 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9794f-d824-4fb3-a610-caa23e7911cd None admin] RBAC: Adding query filter params (name=member) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:41.661166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9794f-d824-4fb3-a610-caa23e7911cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:41.662594 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9794f-d824-4fb3-a610-caa23e7911cd None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:41.671647 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 127/276] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:41.677436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9794f-d824-4fb3-a610-caa23e7911cd None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:41.692317 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69205567-2d70-46cc-b753-d89234812a83 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:41.729433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a659ac-6a13-41e7-b77e-e91dcc68cf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:41.730192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a659ac-6a13-41e7-b77e-e91dcc68cf73 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:41.730371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a659ac-6a13-41e7-b77e-e91dcc68cf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:41.730616 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a659ac-6a13-41e7-b77e-e91dcc68cf73 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:41.731290 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a659ac-6a13-41e7-b77e-e91dcc68cf73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:41.732878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a659ac-6a13-41e7-b77e-e91dcc68cf73 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:41.789023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9794f-d824-4fb3-a610-caa23e7911cd None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:41.813806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 150/277] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 27 16:16:41 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:16:41.814927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfac512-2091-4c46-a78f-92c111e127e6 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:41.815217 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfac512-2091-4c46-a78f-92c111e127e6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:41.815489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfac512-2091-4c46-a78f-92c111e127e6 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:41.820936 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 151/278] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:41.822393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e09d1-894f-4070-b623-e808639d9cc4 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:41.822952 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e09d1-894f-4070-b623-e808639d9cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:41.823229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e09d1-894f-4070-b623-e808639d9cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:41.831267 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:41.838439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ec6ba-88e0-450b-9ef3-57b6ec6832a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:41.839449 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ec6ba-88e0-450b-9ef3-57b6ec6832a1 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:41.839951 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ec6ba-88e0-450b-9ef3-57b6ec6832a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:41.840434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ec6ba-88e0-450b-9ef3-57b6ec6832a1 None admin] PATH_INFO: `/v3/users/2664fef8ce2d41e591b8e06b2d110514` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:41.845699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-275e09d1-894f-4070-b623-e808639d9cc4 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:41.846621 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-275e09d1-894f-4070-b623-e808639d9cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:41.858983 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ec6ba-88e0-450b-9ef3-57b6ec6832a1 None admin] RBAC: Authorizing `identity:get_user(user_id=2664fef8ce2d41e591b8e06b2d110514)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:41.860653 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ec6ba-88e0-450b-9ef3-57b6ec6832a1 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:41.863728 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 128/279] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:41 2022] GET /identity/v3/users/2664fef8ce2d41e591b8e06b2d110514 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:41.863728 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ca110-f900-4ac4-a652-9d2aa6187c2c None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:41.863997 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ca110-f900-4ac4-a652-9d2aa6187c2c None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:41.864278 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ca110-f900-4ac4-a652-9d2aa6187c2c None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:41.865557 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 129/280] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:41.868446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ca110-f900-4ac4-a652-9d2aa6187c2c None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:41.897092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:41.932293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 152/281] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:41.933592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a9b9-5a68-4971-9617-eefdf574e2d1 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:41.933872 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a9b9-5a68-4971-9617-eefdf574e2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:41.934137 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a9b9-5a68-4971-9617-eefdf574e2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:41.955351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-43e8a9b9-5a68-4971-9617-eefdf574e2d1 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:41.956650 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-43e8a9b9-5a68-4971-9617-eefdf574e2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:42.004511 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ca110-f900-4ac4-a652-9d2aa6187c2c None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:42.045977 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772a4d4-6098-410e-aeff-a32a6100c5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:42.046202 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 153/282] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:42.047023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772a4d4-6098-410e-aeff-a32a6100c5cb None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:42.047326 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772a4d4-6098-410e-aeff-a32a6100c5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:42.047574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772a4d4-6098-410e-aeff-a32a6100c5cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:42.048289 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772a4d4-6098-410e-aeff-a32a6100c5cb None admin] RBAC: Adding query filter params (role.id=e7e5b03d7a3d404f841a8341244d5d78, user.id=2664fef8ce2d41e591b8e06b2d110514, scope.system=all) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:42.048625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772a4d4-6098-410e-aeff-a32a6100c5cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:42.050416 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772a4d4-6098-410e-aeff-a32a6100c5cb None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:42.055268 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 130/283] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Sep 27 16:16:41 2022] GET /identity/v3/role_assignments?user.id=2664fef8ce2d41e591b8e06b2d110514&scope.system=all&role.id=e7e5b03d7a3d404f841a8341244d5d78 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:42.205189 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8a9b9-5a68-4971-9617-eefdf574e2d1 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:42.273850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:42.312087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8a9b9-5a68-4971-9617-eefdf574e2d1 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:42.319528 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772a4d4-6098-410e-aeff-a32a6100c5cb None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:42.370886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1a737-b17d-46e5-ab30-885cd640e2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:42.371536 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1a737-b17d-46e5-ab30-885cd640e2af None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:42.371812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1a737-b17d-46e5-ab30-885cd640e2af None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:42.372085 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1a737-b17d-46e5-ab30-885cd640e2af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:42.393622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1a737-b17d-46e5-ab30-885cd640e2af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:42.398520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-ade1a737-b17d-46e5-ab30-885cd640e2af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 16:16:42.398520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:42.398520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:42.398520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:42.398520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:42.398520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:42.398520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:42.398520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:42.398520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:42.398520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:42.398520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:42.398520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:42.398520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:42.398520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:42.398520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:42.398520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:42.399466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:42.399466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:42.399466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:42.399466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:42.399466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:42.399466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:42.399466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:42.399466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:42.399466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:42.399466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:42.399466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:42.399466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:42.399466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:42.399466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:42.399466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:42.399466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:42.400285 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:42.400285 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:42.400285 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:42.400285 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:42.400285 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:42.400285 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:42.400285 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:42.400285 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:42.400285 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:42.400285 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:42.400285 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 16:16:42.400285 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:42.400285 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 154/284] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:42.406738 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1a737-b17d-46e5-ab30-885cd640e2af None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:42.483587 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:42.505561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772a4d4-6098-410e-aeff-a32a6100c5cb None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:42.572783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c103da3-2e12-44fe-9d13-7acc2815ea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:42.574504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1a737-b17d-46e5-ab30-885cd640e2af None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:42.576156 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c103da3-2e12-44fe-9d13-7acc2815ea73 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:42.576534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c103da3-2e12-44fe-9d13-7acc2815ea73 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:42.577302 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c103da3-2e12-44fe-9d13-7acc2815ea73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:42.599181 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c103da3-2e12-44fe-9d13-7acc2815ea73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:42.604892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-0c103da3-2e12-44fe-9d13-7acc2815ea73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:42.604892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:42.604892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:42.604892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:42.604892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:42.604892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:42.604892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:42.604892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:42.604892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:42.604892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:42.604892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:42.604892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:42.604892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:42.604892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:42.604892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:42.604892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:42.605772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:42.605772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:42.605772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:42.605772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:42.605772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:42.605772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:42.605772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:42.605772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:42.605772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:42.605772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:42.605772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:42.605772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:42.605772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:42.605772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:42.605772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:42.605772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:42.606549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:42.606549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:42.606549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:42.606549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:42.606549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:42.606549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:42.606549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:42.606549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:42.606549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:42.606549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:42.606549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:42.606549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:42.606549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 131/285] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:42.612972 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c103da3-2e12-44fe-9d13-7acc2815ea73 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:42.621049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:42.660869 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477e51b-8738-4819-93f3-d0b96024abcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:42.661723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477e51b-8738-4819-93f3-d0b96024abcb None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:42.665179 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477e51b-8738-4819-93f3-d0b96024abcb None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:42.665633 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477e51b-8738-4819-93f3-d0b96024abcb None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:42.666445 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477e51b-8738-4819-93f3-d0b96024abcb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:42.666899 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477e51b-8738-4819-93f3-d0b96024abcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:42.668433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477e51b-8738-4819-93f3-d0b96024abcb None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:42.686970 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 155/286] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:42.692322 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477e51b-8738-4819-93f3-d0b96024abcb None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:42.780397 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c103da3-2e12-44fe-9d13-7acc2815ea73 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:42.852867 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34740e-b0a5-4662-bd76-d5b48d4244bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:42.853914 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34740e-b0a5-4662-bd76-d5b48d4244bc None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:42.854952 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34740e-b0a5-4662-bd76-d5b48d4244bc None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:42.855550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34740e-b0a5-4662-bd76-d5b48d4244bc None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:42.857386 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34740e-b0a5-4662-bd76-d5b48d4244bc None admin] RBAC: Adding query filter params (name=member) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:42.858554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34740e-b0a5-4662-bd76-d5b48d4244bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:42.860687 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34740e-b0a5-4662-bd76-d5b48d4244bc None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:42.871648 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477e51b-8738-4819-93f3-d0b96024abcb None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:42.878200 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 132/287] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:42.883886 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34740e-b0a5-4662-bd76-d5b48d4244bc None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:42.907193 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:42.944236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b3b23-58d6-4bd5-bdd7-63e5aa91c4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:42.945132 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b3b23-58d6-4bd5-bdd7-63e5aa91c4fd None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:42.946305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b3b23-58d6-4bd5-bdd7-63e5aa91c4fd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:42.947293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b3b23-58d6-4bd5-bdd7-63e5aa91c4fd None admin] PATH_INFO: `/v3/users/febd7f39fbfc4f5c85afca27b3ceb8db` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:42.951929 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b3b23-58d6-4bd5-bdd7-63e5aa91c4fd None admin] RBAC: Authorizing `identity:get_user(user_id=febd7f39fbfc4f5c85afca27b3ceb8db)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:42.953575 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b3b23-58d6-4bd5-bdd7-63e5aa91c4fd None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:42.958734 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 156/288] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:42 2022] GET /identity/v3/users/febd7f39fbfc4f5c85afca27b3ceb8db => generated 297 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:42.964044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b3b23-58d6-4bd5-bdd7-63e5aa91c4fd None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:43.055370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34740e-b0a5-4662-bd76-d5b48d4244bc None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:43.067724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:43.093340 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b8588-690a-4799-a133-a9094abe8a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:43.094355 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b8588-690a-4799-a133-a9094abe8a66 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:43.094863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b8588-690a-4799-a133-a9094abe8a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:43.095340 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b8588-690a-4799-a133-a9094abe8a66 None admin] PATH_INFO: `/v3/users/915426f1e0fa4608858a9667e6c75faa` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:43.096829 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b8588-690a-4799-a133-a9094abe8a66 None admin] RBAC: Authorizing `identity:get_user(user_id=915426f1e0fa4608858a9667e6c75faa)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:43.098633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b8588-690a-4799-a133-a9094abe8a66 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:43.100558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 133/289] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:42 2022] GET /identity/v3/users/915426f1e0fa4608858a9667e6c75faa => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:43.107575 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b8588-690a-4799-a133-a9094abe8a66 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:43.145445 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b3b23-58d6-4bd5-bdd7-63e5aa91c4fd None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:43.182424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5ce36-780e-47c0-89a9-c714e32c49cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:43.183357 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5ce36-780e-47c0-89a9-c714e32c49cf None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:43.183932 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5ce36-780e-47c0-89a9-c714e32c49cf None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:43.184465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5ce36-780e-47c0-89a9-c714e32c49cf None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:43.186581 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5ce36-780e-47c0-89a9-c714e32c49cf None admin] RBAC: Authorizing `identity:get_project(project_id=05e8dee797fd40d4bab1c7dd5c687e36)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:43.188286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5ce36-780e-47c0-89a9-c714e32c49cf None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:43.191041 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 157/290] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:42 2022] GET /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:43.196193 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5ce36-780e-47c0-89a9-c714e32c49cf None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:43.307035 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5ce36-780e-47c0-89a9-c714e32c49cf None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:43.332792 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:43.344939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad6792-028c-44d1-b84e-5ee754c8d6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:43.346490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad6792-028c-44d1-b84e-5ee754c8d6a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:43.346974 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad6792-028c-44d1-b84e-5ee754c8d6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:43.347468 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad6792-028c-44d1-b84e-5ee754c8d6a8 None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36/users/febd7f39fbfc4f5c85afca27b3ceb8db/roles/018bcecca3d84d2d990678f3d1d53886` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:43.349815 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad6792-028c-44d1-b84e-5ee754c8d6a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=05e8dee797fd40d4bab1c7dd5c687e36, user_id=febd7f39fbfc4f5c85afca27b3ceb8db, role_id=018bcecca3d84d2d990678f3d1d53886)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:43.351571 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad6792-028c-44d1-b84e-5ee754c8d6a8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:43.362085 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:43.386563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b8588-690a-4799-a133-a9094abe8a66 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:43.422485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b9624-39cc-49fe-8577-046ed33e2eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:43.423444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b9624-39cc-49fe-8577-046ed33e2eaa None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:43.423915 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b9624-39cc-49fe-8577-046ed33e2eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:43.424387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b9624-39cc-49fe-8577-046ed33e2eaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:43.458591 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 158/291] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:16:43 2022] PUT /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36/users/febd7f39fbfc4f5c85afca27b3ceb8db/roles/018bcecca3d84d2d990678f3d1d53886 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:16:43.506906 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b9624-39cc-49fe-8577-046ed33e2eaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:43.508745 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b9624-39cc-49fe-8577-046ed33e2eaa None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:43.596152 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:43.620181 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 134/292] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:43.626056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad6792-028c-44d1-b84e-5ee754c8d6a8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:43.744755 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad6792-028c-44d1-b84e-5ee754c8d6a8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:43.783375 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cf23f-0421-43a1-98ab-6660d2ff907b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:43.783375 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf23f-0421-43a1-98ab-6660d2ff907b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:43.783375 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf23f-0421-43a1-98ab-6660d2ff907b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:43.783375 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf23f-0421-43a1-98ab-6660d2ff907b None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:43.783721 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cf23f-0421-43a1-98ab-6660d2ff907b None admin] RBAC: Authorizing `identity:get_project(project_id=05e8dee797fd40d4bab1c7dd5c687e36)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:43.785165 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cf23f-0421-43a1-98ab-6660d2ff907b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:43.788400 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 159/293] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:43 2022] GET /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:43.796062 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b9624-39cc-49fe-8577-046ed33e2eaa None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:43.936307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b9624-39cc-49fe-8577-046ed33e2eaa None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:43.985774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6d219-318c-416b-9490-c9d3dfecdf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:43.986382 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6d219-318c-416b-9490-c9d3dfecdf2d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:43.986658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6d219-318c-416b-9490-c9d3dfecdf2d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:43.986929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6d219-318c-416b-9490-c9d3dfecdf2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:43.987655 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6d219-318c-416b-9490-c9d3dfecdf2d None admin] RBAC: Adding query filter params (role.id=e7e5b03d7a3d404f841a8341244d5d78, scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36, user.id=915426f1e0fa4608858a9667e6c75faa) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:43.987961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6d219-318c-416b-9490-c9d3dfecdf2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:43.989432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6d219-318c-416b-9490-c9d3dfecdf2d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:43.996368 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 135/294] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:16:43 2022] GET /identity/v3/role_assignments?user.id=915426f1e0fa4608858a9667e6c75faa&scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36&role.id=e7e5b03d7a3d404f841a8341244d5d78 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:44.423527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b02af-2af2-4aa5-ae08-00f587b4d376 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:44.424041 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b02af-2af2-4aa5-ae08-00f587b4d376 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:44.424151 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b02af-2af2-4aa5-ae08-00f587b4d376 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:44.425509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 160/295] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:44.431358 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a58152-27a5-4c1c-8981-d5ab681ce11e None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:44.432269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a58152-27a5-4c1c-8981-d5ab681ce11e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:44.432797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a58152-27a5-4c1c-8981-d5ab681ce11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:44.453678 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-66a58152-27a5-4c1c-8981-d5ab681ce11e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:44.455200 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-66a58152-27a5-4c1c-8981-d5ab681ce11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:44.492767 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:44.534384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08edb8c-9734-4b51-a32a-febdda6db21e None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:44.534742 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08edb8c-9734-4b51-a32a-febdda6db21e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:44.534934 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08edb8c-9734-4b51-a32a-febdda6db21e None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:44.536522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 161/296] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:16:44.542341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5f04a-79d7-4d27-b152-7830379e7f26 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:44.542642 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5f04a-79d7-4d27-b152-7830379e7f26 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:44.542967 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5f04a-79d7-4d27-b152-7830379e7f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:44.551162 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 136/297] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:16:44.563570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-71d5f04a-79d7-4d27-b152-7830379e7f26 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:44.564800 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-71d5f04a-79d7-4d27-b152-7830379e7f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:44.618876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:44.649616 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 162/298] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:16:44.650541 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58f6c6-69c3-4fd1-96da-b09e8405408e None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:44.651037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58f6c6-69c3-4fd1-96da-b09e8405408e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:44.651541 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58f6c6-69c3-4fd1-96da-b09e8405408e None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:44.653344 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 137/299] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:44.665190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a6665-fa24-457c-888d-9f203a23d1a2 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:44.665476 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a6665-fa24-457c-888d-9f203a23d1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:44.665756 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a6665-fa24-457c-888d-9f203a23d1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:44.686488 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-8b9a6665-fa24-457c-888d-9f203a23d1a2 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:44.687599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8b9a6665-fa24-457c-888d-9f203a23d1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:44.762876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 163/300] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:44.839695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58f6c6-69c3-4fd1-96da-b09e8405408e None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:44.936274 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a6665-fa24-457c-888d-9f203a23d1a2 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:44.947244 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58f6c6-69c3-4fd1-96da-b09e8405408e None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:44.982318 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d2a6b-5e77-499b-8e08-6f7913c9f02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:44.982976 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d2a6b-5e77-499b-8e08-6f7913c9f02d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:44.983254 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d2a6b-5e77-499b-8e08-6f7913c9f02d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:44.983525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d2a6b-5e77-499b-8e08-6f7913c9f02d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:44.996282 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d2a6b-5e77-499b-8e08-6f7913c9f02d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:45.003635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-1e3d2a6b-5e77-499b-8e08-6f7913c9f02d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 16:16:45.003635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:45.003635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:45.003635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:45.003635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:45.003635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:45.003635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:45.003635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:45.003635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:45.003635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:45.003635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:45.003635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:45.003635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:45.003635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:45.003635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:45.003635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:45.004547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:45.004547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:45.004547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:45.004547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:45.004547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:45.004547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:45.004547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:45.004547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:45.004547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:45.004547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:45.004547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:45.004547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:45.004547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:45.004547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:45.004547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:45.004547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:45.005341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:45.005341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:45.005341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:45.005341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:45.005341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:45.005341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:45.005341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:45.005341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:45.005341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:45.005341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:45.005341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 16:16:45.005341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:45.007832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 138/301] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:45.017799 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d2a6b-5e77-499b-8e08-6f7913c9f02d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:45.052804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a6665-fa24-457c-888d-9f203a23d1a2 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:45.053997 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:45.064596 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:45.089757 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caf5e0-baed-4546-b263-eed1e95b52fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:45.090386 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caf5e0-baed-4546-b263-eed1e95b52fa None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:45.090688 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caf5e0-baed-4546-b263-eed1e95b52fa None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:45.090940 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caf5e0-baed-4546-b263-eed1e95b52fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:45.102741 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caf5e0-baed-4546-b263-eed1e95b52fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:45.108050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-85caf5e0-baed-4546-b263-eed1e95b52fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:45.108050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:45.108050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:45.108050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:45.108050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:45.108050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:45.108050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:45.108050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:45.108050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:45.108050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:45.108050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:45.108050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:45.108050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:45.108050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:45.108050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:45.108050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:45.109109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:45.109109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:45.109109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:45.109109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:45.109109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:45.109109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:45.109109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:45.109109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:45.109109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:45.109109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:45.109109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:45.109109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:45.109109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:45.109109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:45.109109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:45.109109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:45.113574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:45.113574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:45.113574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:45.113574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:45.113574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:45.113574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:45.113574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:45.113574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:45.113574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:45.113574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:45.113574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:45.113574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:45.113574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 164/302] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:45.113574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caf5e0-baed-4546-b263-eed1e95b52fa None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:45.129207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d2a6b-5e77-499b-8e08-6f7913c9f02d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:45.165828 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a498021-e484-46f1-92a9-26711f56bf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:45.166430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a498021-e484-46f1-92a9-26711f56bf29 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:45.166705 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a498021-e484-46f1-92a9-26711f56bf29 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:45.166975 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a498021-e484-46f1-92a9-26711f56bf29 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:45.167630 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a498021-e484-46f1-92a9-26711f56bf29 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:45.167930 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a498021-e484-46f1-92a9-26711f56bf29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:45.169605 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a498021-e484-46f1-92a9-26711f56bf29 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:45.178563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 139/303] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:45.183660 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a498021-e484-46f1-92a9-26711f56bf29 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:45.217930 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caf5e0-baed-4546-b263-eed1e95b52fa None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:45.252444 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17816f64-d6ea-44f9-a5f0-a9e0e38586a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:45.253074 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17816f64-d6ea-44f9-a5f0-a9e0e38586a8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:45.253350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17816f64-d6ea-44f9-a5f0-a9e0e38586a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:45.253623 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17816f64-d6ea-44f9-a5f0-a9e0e38586a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:45.254723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17816f64-d6ea-44f9-a5f0-a9e0e38586a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:45.256172 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17816f64-d6ea-44f9-a5f0-a9e0e38586a8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:45.257787 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 165/304] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:16:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:45.258555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17816f64-d6ea-44f9-a5f0-a9e0e38586a8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:45.281627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:45.289174 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a498021-e484-46f1-92a9-26711f56bf29 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:45.301925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:45.324410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a042f-2d07-4e56-bf59-a44f468f6e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:45.325158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a042f-2d07-4e56-bf59-a44f468f6e0f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:45.325439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a042f-2d07-4e56-bf59-a44f468f6e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:45.325712 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a042f-2d07-4e56-bf59-a44f468f6e0f None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:45.326402 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a042f-2d07-4e56-bf59-a44f468f6e0f None admin] RBAC: Adding query filter params (name=member) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:45.327283 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a042f-2d07-4e56-bf59-a44f468f6e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:45.328717 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a042f-2d07-4e56-bf59-a44f468f6e0f None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:45.337028 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 140/305] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:45.337858 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a042f-2d07-4e56-bf59-a44f468f6e0f None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:45.366897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17816f64-d6ea-44f9-a5f0-a9e0e38586a8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:45.400920 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbed940-7ac3-41fa-989b-05bf94ef996d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:45.401542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbed940-7ac3-41fa-989b-05bf94ef996d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:45.401815 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbed940-7ac3-41fa-989b-05bf94ef996d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:45.402085 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbed940-7ac3-41fa-989b-05bf94ef996d None admin] PATH_INFO: `/v3/users/014b7ccdc7624fa2823092e6520795e6` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:45.414951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbed940-7ac3-41fa-989b-05bf94ef996d None admin] RBAC: Authorizing `identity:get_user(user_id=014b7ccdc7624fa2823092e6520795e6)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:45.416417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbed940-7ac3-41fa-989b-05bf94ef996d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:45.420372 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 166/306] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:45 2022] GET /identity/v3/users/014b7ccdc7624fa2823092e6520795e6 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:45.420372 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbed940-7ac3-41fa-989b-05bf94ef996d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:45.453791 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a042f-2d07-4e56-bf59-a44f468f6e0f None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:45.488083 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88a78e-56bf-499e-8995-3c1d0b2601dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:45.488765 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88a78e-56bf-499e-8995-3c1d0b2601dd None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:45.489051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88a78e-56bf-499e-8995-3c1d0b2601dd None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:45.489325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88a78e-56bf-499e-8995-3c1d0b2601dd None admin] PATH_INFO: `/v3/groups` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:45.489950 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88a78e-56bf-499e-8995-3c1d0b2601dd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:45.491539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88a78e-56bf-499e-8995-3c1d0b2601dd None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:45.509496 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:45.515564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbed940-7ac3-41fa-989b-05bf94ef996d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:45.547190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39360c8c-fa92-4678-8e05-144af87fb87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:45.547839 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39360c8c-fa92-4678-8e05-144af87fb87c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:45.548114 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39360c8c-fa92-4678-8e05-144af87fb87c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:45.548411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39360c8c-fa92-4678-8e05-144af87fb87c None admin] PATH_INFO: `/v3/users/2664fef8ce2d41e591b8e06b2d110514` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:45.549514 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39360c8c-fa92-4678-8e05-144af87fb87c None admin] RBAC: Authorizing `identity:get_user(user_id=2664fef8ce2d41e591b8e06b2d110514)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:45.550933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39360c8c-fa92-4678-8e05-144af87fb87c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:45.552519 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 167/307] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:45 2022] GET /identity/v3/users/2664fef8ce2d41e591b8e06b2d110514 => generated 293 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:45.553280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39360c8c-fa92-4678-8e05-144af87fb87c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:45.576400 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 141/308] 10.222.0.26 () {60 vars in 1134 bytes} [Tue Sep 27 16:16:45 2022] POST /identity/v3/groups => generated 229 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:16:45.576400 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88a78e-56bf-499e-8995-3c1d0b2601dd None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:45.611881 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:45.702383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39360c8c-fa92-4678-8e05-144af87fb87c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:45.734828 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88a78e-56bf-499e-8995-3c1d0b2601dd None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:45.746746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d5108-3448-4654-a3ac-a54cabd8e6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:45.747614 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d5108-3448-4654-a3ac-a54cabd8e6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:45.748062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d5108-3448-4654-a3ac-a54cabd8e6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:45.749081 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d5108-3448-4654-a3ac-a54cabd8e6f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:45.750228 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d5108-3448-4654-a3ac-a54cabd8e6f7 None admin] RBAC: Adding query filter params (role.id=018bcecca3d84d2d990678f3d1d53886, user.id=014b7ccdc7624fa2823092e6520795e6, scope.system=all) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:45.751197 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d5108-3448-4654-a3ac-a54cabd8e6f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:45.753010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d5108-3448-4654-a3ac-a54cabd8e6f7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:45.759145 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 168/309] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Sep 27 16:16:45 2022] GET /identity/v3/role_assignments?user.id=014b7ccdc7624fa2823092e6520795e6&scope.system=all&role.id=018bcecca3d84d2d990678f3d1d53886 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:45.778826 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1895d6-fc1d-4601-8a72-adde39b9a44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:45.779988 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1895d6-fc1d-4601-8a72-adde39b9a44a None admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:45.780674 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1895d6-fc1d-4601-8a72-adde39b9a44a None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:45.781187 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1895d6-fc1d-4601-8a72-adde39b9a44a None admin] PATH_INFO: `/v3/system/users/2664fef8ce2d41e591b8e06b2d110514/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:45.786345 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1895d6-fc1d-4601-8a72-adde39b9a44a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2664fef8ce2d41e591b8e06b2d110514, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:45.788142 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1895d6-fc1d-4601-8a72-adde39b9a44a None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:45.859228 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 142/310] 10.222.0.26 () {58 vars in 1334 bytes} [Tue Sep 27 16:16:45 2022] PUT /identity/v3/system/users/2664fef8ce2d41e591b8e06b2d110514/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:16:46.160716 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727308d-8819-4017-854b-db4c0150496a None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:46.161226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727308d-8819-4017-854b-db4c0150496a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:46.161642 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727308d-8819-4017-854b-db4c0150496a None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:46.163336 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 169/311] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:46.168800 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a652f-aa87-4815-ad0a-5081e425f22b None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:46.169590 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a652f-aa87-4815-ad0a-5081e425f22b None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:46.170060 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a652f-aa87-4815-ad0a-5081e425f22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:46.188970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-3f9a652f-aa87-4815-ad0a-5081e425f22b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:46.190475 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3f9a652f-aa87-4815-ad0a-5081e425f22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:46.259762 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 143/312] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:46.531244 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727308d-8819-4017-854b-db4c0150496a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:46.562652 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:46.637999 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727308d-8819-4017-854b-db4c0150496a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:46.675983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7559b-2d0f-45a4-9533-0a1300495f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:46.676655 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7559b-2d0f-45a4-9533-0a1300495f7c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:46.676932 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7559b-2d0f-45a4-9533-0a1300495f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:46.677205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7559b-2d0f-45a4-9533-0a1300495f7c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:46.688058 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7559b-2d0f-45a4-9533-0a1300495f7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:46.693205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-c3f7559b-2d0f-45a4-9533-0a1300495f7c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 16:16:46.693205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:46.693205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:46.693205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:46.693205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:46.693205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:46.693205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:46.693205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:46.693205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:46.693205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:46.693205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:46.693205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:46.693205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:46.693205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:46.693205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:46.693205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:46.694080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:46.694080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:46.694080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:46.694080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:46.694080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:46.694080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:46.694080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:46.694080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:46.694080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:46.694080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:46.694080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:46.694080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:46.694080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:46.694080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:46.694080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:46.694080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:46.695013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:46.695013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:46.695013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:46.695013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:46.695013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:46.695013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:46.695013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:46.695013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:46.695013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:46.695013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:46.695013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 16:16:46.695013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:46.695013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 170/313] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:46.700151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a652f-aa87-4815-ad0a-5081e425f22b None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:46.712724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:46.807032 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a652f-aa87-4815-ad0a-5081e425f22b None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:46.843556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4dc74-8bea-45fa-9aee-4be02d08f215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:46.844161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4dc74-8bea-45fa-9aee-4be02d08f215 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:46.844476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4dc74-8bea-45fa-9aee-4be02d08f215 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:46.844752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4dc74-8bea-45fa-9aee-4be02d08f215 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:46.845418 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4dc74-8bea-45fa-9aee-4be02d08f215 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:46.845721 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4dc74-8bea-45fa-9aee-4be02d08f215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:46.847100 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4dc74-8bea-45fa-9aee-4be02d08f215 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:46.855281 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 144/314] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:46.861013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7559b-2d0f-45a4-9533-0a1300495f7c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:46.952822 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:46.965163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7559b-2d0f-45a4-9533-0a1300495f7c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:47.000377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3f291-a211-4553-9780-d84d06a6e323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:47.001565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3f291-a211-4553-9780-d84d06a6e323 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:47.002201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3f291-a211-4553-9780-d84d06a6e323 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:47.002523 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3f291-a211-4553-9780-d84d06a6e323 None admin] PATH_INFO: `/v3/users/febd7f39fbfc4f5c85afca27b3ceb8db` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:47.004012 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3f291-a211-4553-9780-d84d06a6e323 None admin] RBAC: Authorizing `identity:get_user(user_id=febd7f39fbfc4f5c85afca27b3ceb8db)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:47.005505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3f291-a211-4553-9780-d84d06a6e323 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:47.007069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 171/315] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:46 2022] GET /identity/v3/users/febd7f39fbfc4f5c85afca27b3ceb8db => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:47.012614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4dc74-8bea-45fa-9aee-4be02d08f215 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:47.084423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:47.115284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4dc74-8bea-45fa-9aee-4be02d08f215 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:47.154398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efefd1-595c-472b-9399-351ec62fb038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:47.155530 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efefd1-595c-472b-9399-351ec62fb038 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:47.155807 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efefd1-595c-472b-9399-351ec62fb038 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:47.156078 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efefd1-595c-472b-9399-351ec62fb038 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:47.223482 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efefd1-595c-472b-9399-351ec62fb038 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:47.225035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efefd1-595c-472b-9399-351ec62fb038 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:47.293860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:47.324785 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 145/316] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:47.330960 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3f291-a211-4553-9780-d84d06a6e323 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:47.437430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3f291-a211-4553-9780-d84d06a6e323 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:47.472235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504c54b-1ff8-4045-b4ed-83682ef36569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:47.472887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504c54b-1ff8-4045-b4ed-83682ef36569 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:47.473165 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504c54b-1ff8-4045-b4ed-83682ef36569 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:47.473441 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504c54b-1ff8-4045-b4ed-83682ef36569 None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:47.474562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504c54b-1ff8-4045-b4ed-83682ef36569 None admin] RBAC: Authorizing `identity:get_project(project_id=05e8dee797fd40d4bab1c7dd5c687e36)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:47.475988 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504c54b-1ff8-4045-b4ed-83682ef36569 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:47.477946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 172/317] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:47 2022] GET /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:47.485743 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efefd1-595c-472b-9399-351ec62fb038 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:47.589636 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efefd1-595c-472b-9399-351ec62fb038 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:47.624945 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee18d40-74c0-459c-a59f-ac1044c2cc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:47.625550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee18d40-74c0-459c-a59f-ac1044c2cc86 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:47.625881 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee18d40-74c0-459c-a59f-ac1044c2cc86 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:47.626157 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee18d40-74c0-459c-a59f-ac1044c2cc86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:47.626882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee18d40-74c0-459c-a59f-ac1044c2cc86 None admin] RBAC: Adding query filter params (role.id=018bcecca3d84d2d990678f3d1d53886, scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36, user.id=febd7f39fbfc4f5c85afca27b3ceb8db) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:47.627188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee18d40-74c0-459c-a59f-ac1044c2cc86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:47.628649 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee18d40-74c0-459c-a59f-ac1044c2cc86 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:47.634681 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 146/318] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:16:47 2022] GET /identity/v3/role_assignments?user.id=febd7f39fbfc4f5c85afca27b3ceb8db&scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36&role.id=018bcecca3d84d2d990678f3d1d53886 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:47.889524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75490f89-3383-4d13-b9f9-2c2248c64fd6 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:47.890017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75490f89-3383-4d13-b9f9-2c2248c64fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:47.890092 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75490f89-3383-4d13-b9f9-2c2248c64fd6 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:47.891675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 173/319] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:47.897288 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b224d-5177-4a27-9efa-7bb42b7cb456 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:47.897731 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b224d-5177-4a27-9efa-7bb42b7cb456 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:47.897935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b224d-5177-4a27-9efa-7bb42b7cb456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:47.917757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-e77b224d-5177-4a27-9efa-7bb42b7cb456 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:47.919250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-e77b224d-5177-4a27-9efa-7bb42b7cb456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:47.952260 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:47.990025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 147/320] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:48.029976 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1833d-5022-4a25-bcf5-40e973700509 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:48.030267 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1833d-5022-4a25-bcf5-40e973700509 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:48.030525 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1833d-5022-4a25-bcf5-40e973700509 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:48.032006 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 174/321] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:48.036914 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240ec1b-6eca-43a3-aeec-f05505066ed8 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:48.037197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240ec1b-6eca-43a3-aeec-f05505066ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:48.037468 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240ec1b-6eca-43a3-aeec-f05505066ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:48.057269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-4240ec1b-6eca-43a3-aeec-f05505066ed8 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:48.058426 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4240ec1b-6eca-43a3-aeec-f05505066ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:48.127264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 148/322] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:48.173482 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cce27-358a-4e18-9824-c43ec7aa70ea None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:48.173771 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cce27-358a-4e18-9824-c43ec7aa70ea None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:48.174033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cce27-358a-4e18-9824-c43ec7aa70ea None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:48.175599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 175/323] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:48.180631 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184354d-2aa5-4a4f-a088-6cdf1d686f27 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:48.180910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184354d-2aa5-4a4f-a088-6cdf1d686f27 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:48.181182 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184354d-2aa5-4a4f-a088-6cdf1d686f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:48.198866 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-7184354d-2aa5-4a4f-a088-6cdf1d686f27 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:48.200041 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-7184354d-2aa5-4a4f-a088-6cdf1d686f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:48.259184 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cce27-358a-4e18-9824-c43ec7aa70ea None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:48.266713 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 149/324] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:48.288833 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:48.365511 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cce27-358a-4e18-9824-c43ec7aa70ea None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:48.391226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184354d-2aa5-4a4f-a088-6cdf1d686f27 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:48.401190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee1e14-de7e-4766-9df7-618cde453264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:48.402206 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee1e14-de7e-4766-9df7-618cde453264 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:48.402488 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee1e14-de7e-4766-9df7-618cde453264 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:48.403107 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee1e14-de7e-4766-9df7-618cde453264 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:48.404231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee1e14-de7e-4766-9df7-618cde453264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:48.405748 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee1e14-de7e-4766-9df7-618cde453264 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:48.407510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 176/325] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:16:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:48.412591 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee1e14-de7e-4766-9df7-618cde453264 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:48.418649 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:48.495043 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184354d-2aa5-4a4f-a088-6cdf1d686f27 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:48.515396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:48.524980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee1e14-de7e-4766-9df7-618cde453264 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:48.529173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4356b-1264-42ad-8af2-186286481e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:48.529837 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4356b-1264-42ad-8af2-186286481e0e None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:48.530116 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4356b-1264-42ad-8af2-186286481e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:48.530388 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4356b-1264-42ad-8af2-186286481e0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:48.541151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4356b-1264-42ad-8af2-186286481e0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:48.546378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-7be4356b-1264-42ad-8af2-186286481e0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 16:16:48.546378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:48.546378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:48.546378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:48.546378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:48.546378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:48.546378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:48.546378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:48.546378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:48.546378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:48.546378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:48.546378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:48.546378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:48.546378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:48.546378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:48.546378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:48.547309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:48.547309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:48.547309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:48.547309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:48.547309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:48.547309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:48.547309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:48.547309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:48.547309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:48.547309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:48.547309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:48.547309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:48.547309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:48.547309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:48.547309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:48.547309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:48.548103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:48.548103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:48.548103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:48.548103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:48.548103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:48.548103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:48.548103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:48.548103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:48.548103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:48.548103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:48.548103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 16:16:48.548103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:48.548103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 150/326] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:16:48.548804 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4356b-1264-42ad-8af2-186286481e0e None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:48.562510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905ddbb-80ff-421a-bc78-949e645f3abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:48.563110 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905ddbb-80ff-421a-bc78-949e645f3abd None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:48.563384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905ddbb-80ff-421a-bc78-949e645f3abd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:48.563651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905ddbb-80ff-421a-bc78-949e645f3abd None admin] PATH_INFO: `/v3/groups` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:48.564271 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905ddbb-80ff-421a-bc78-949e645f3abd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:48.565721 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905ddbb-80ff-421a-bc78-949e645f3abd None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:48.630492 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:48.644962 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4356b-1264-42ad-8af2-186286481e0e None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:48.652548 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 177/327] 10.222.0.26 () {60 vars in 1134 bytes} [Tue Sep 27 16:16:48 2022] POST /identity/v3/groups => generated 226 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:16:48.653501 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905ddbb-80ff-421a-bc78-949e645f3abd None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:48.684389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f651a5b-4c2e-48a4-b13c-949fc89029aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:48.685296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651a5b-4c2e-48a4-b13c-949fc89029aa None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:48.685579 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651a5b-4c2e-48a4-b13c-949fc89029aa None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:48.686694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651a5b-4c2e-48a4-b13c-949fc89029aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:48.698982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f651a5b-4c2e-48a4-b13c-949fc89029aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:48.704869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-0f651a5b-4c2e-48a4-b13c-949fc89029aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:48.704869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:48.704869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:48.704869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:48.704869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:48.704869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:48.704869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:48.704869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:48.704869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:48.704869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:48.704869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:48.704869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:48.704869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:48.704869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:48.704869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:48.704869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:48.705873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:48.705873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:48.705873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:48.705873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:48.705873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:48.705873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:48.705873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:48.705873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:48.705873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:48.705873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:48.705873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:48.705873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:48.705873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:48.705873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:48.705873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:48.705873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:48.706752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:48.706752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:48.706752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:48.706752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:48.706752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:48.706752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:48.706752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:48.706752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:48.706752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:48.706752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:48.706752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:48.706752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:48.706752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 151/328] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:48.712109 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f651a5b-4c2e-48a4-b13c-949fc89029aa None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:48.789016 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905ddbb-80ff-421a-bc78-949e645f3abd None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:48.826654 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f651a5b-4c2e-48a4-b13c-949fc89029aa None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:48.836901 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96bd2a-b7ca-4631-b56a-41d6f71b95c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:48.838282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96bd2a-b7ca-4631-b56a-41d6f71b95c0 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:48.838282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96bd2a-b7ca-4631-b56a-41d6f71b95c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:48.838282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96bd2a-b7ca-4631-b56a-41d6f71b95c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:48.838883 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96bd2a-b7ca-4631-b56a-41d6f71b95c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:48.839187 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96bd2a-b7ca-4631-b56a-41d6f71b95c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:48.840630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96bd2a-b7ca-4631-b56a-41d6f71b95c0 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:48.850604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 178/329] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:48.856509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96bd2a-b7ca-4631-b56a-41d6f71b95c0 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:48.871344 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfc3a0-42bb-430a-aab1-bc6269b837a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:48.871952 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfc3a0-42bb-430a-aab1-bc6269b837a5 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:48.872229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfc3a0-42bb-430a-aab1-bc6269b837a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:48.872524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfc3a0-42bb-430a-aab1-bc6269b837a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:48.873339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfc3a0-42bb-430a-aab1-bc6269b837a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:48.874066 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfc3a0-42bb-430a-aab1-bc6269b837a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:48.874814 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:48.875938 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfc3a0-42bb-430a-aab1-bc6269b837a5 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:48.890557 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 152/330] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:48.891709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfc3a0-42bb-430a-aab1-bc6269b837a5 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:48.903992 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:48.978667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96bd2a-b7ca-4631-b56a-41d6f71b95c0 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:49.015898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfc3a0-42bb-430a-aab1-bc6269b837a5 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:49.022262 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e89f65-1604-4248-9797-17b41ce00573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:49.023561 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e89f65-1604-4248-9797-17b41ce00573 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:49.024171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e89f65-1604-4248-9797-17b41ce00573 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:49.024652 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e89f65-1604-4248-9797-17b41ce00573 None admin] PATH_INFO: `/v3/users/014b7ccdc7624fa2823092e6520795e6` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:49.027300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e89f65-1604-4248-9797-17b41ce00573 None admin] RBAC: Authorizing `identity:get_user(user_id=014b7ccdc7624fa2823092e6520795e6)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:49.029313 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e89f65-1604-4248-9797-17b41ce00573 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:49.031362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 179/331] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:48 2022] GET /identity/v3/users/014b7ccdc7624fa2823092e6520795e6 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:49.037421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e89f65-1604-4248-9797-17b41ce00573 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:49.058661 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d8749-d1f2-4e88-9865-efcd517c94c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:49.058661 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d8749-d1f2-4e88-9865-efcd517c94c6 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:49.058925 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d8749-d1f2-4e88-9865-efcd517c94c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:49.059022 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d8749-d1f2-4e88-9865-efcd517c94c6 None admin] PATH_INFO: `/v3/users/2664fef8ce2d41e591b8e06b2d110514` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:49.060134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d8749-d1f2-4e88-9865-efcd517c94c6 None admin] RBAC: Authorizing `identity:get_user(user_id=2664fef8ce2d41e591b8e06b2d110514)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:49.062155 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d8749-d1f2-4e88-9865-efcd517c94c6 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:49.068446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 153/332] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:48 2022] GET /identity/v3/users/2664fef8ce2d41e591b8e06b2d110514 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:49.069985 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d8749-d1f2-4e88-9865-efcd517c94c6 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:49.149201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:49.161000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:49.178456 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e89f65-1604-4248-9797-17b41ce00573 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:49.203073 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d8749-d1f2-4e88-9865-efcd517c94c6 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:49.224906 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd937c9-031c-4550-8c2a-368ddfaf1f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:49.226235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd937c9-031c-4550-8c2a-368ddfaf1f15 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:49.226984 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd937c9-031c-4550-8c2a-368ddfaf1f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:49.227501 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd937c9-031c-4550-8c2a-368ddfaf1f15 None admin] PATH_INFO: `/v3/system/users/014b7ccdc7624fa2823092e6520795e6/roles/018bcecca3d84d2d990678f3d1d53886` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:49.229594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd937c9-031c-4550-8c2a-368ddfaf1f15 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=014b7ccdc7624fa2823092e6520795e6, role_id=018bcecca3d84d2d990678f3d1d53886)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:49.231832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd937c9-031c-4550-8c2a-368ddfaf1f15 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:49.251405 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70cd67-39c8-4dd6-bbcd-7290cf34c5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:49.252018 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70cd67-39c8-4dd6-bbcd-7290cf34c5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:49.252295 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70cd67-39c8-4dd6-bbcd-7290cf34c5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:49.252610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70cd67-39c8-4dd6-bbcd-7290cf34c5a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:49.253460 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70cd67-39c8-4dd6-bbcd-7290cf34c5a5 None admin] RBAC: Adding query filter params (role.id=e7e5b03d7a3d404f841a8341244d5d78, user.id=2664fef8ce2d41e591b8e06b2d110514, scope.system=all) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:49.253769 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70cd67-39c8-4dd6-bbcd-7290cf34c5a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:49.255196 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70cd67-39c8-4dd6-bbcd-7290cf34c5a5 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:49.268128 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 154/333] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Sep 27 16:16:49 2022] GET /identity/v3/role_assignments?user.id=2664fef8ce2d41e591b8e06b2d110514&scope.system=all&role.id=e7e5b03d7a3d404f841a8341244d5d78 => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:49.298842 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 180/334] 10.222.0.26 () {58 vars in 1334 bytes} [Tue Sep 27 16:16:49 2022] PUT /identity/v3/system/users/014b7ccdc7624fa2823092e6520795e6/roles/018bcecca3d84d2d990678f3d1d53886 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:16:51.349339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5461e4-beee-4ff0-b8cd-6b102d74ab75 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:51.349881 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5461e4-beee-4ff0-b8cd-6b102d74ab75 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:51.349881 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5461e4-beee-4ff0-b8cd-6b102d74ab75 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:51.351621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 155/335] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:51.357007 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb983b-da4b-4cec-82c2-985b6781f12d None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:51.357920 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb983b-da4b-4cec-82c2-985b6781f12d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:51.366448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb983b-da4b-4cec-82c2-985b6781f12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:51.382260 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-82eb983b-da4b-4cec-82c2-985b6781f12d None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:51.383745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-82eb983b-da4b-4cec-82c2-985b6781f12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:51.467919 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 181/336] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:51.751075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5461e4-beee-4ff0-b8cd-6b102d74ab75 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:51.876606 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5461e4-beee-4ff0-b8cd-6b102d74ab75 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:51.913412 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b397ef7-bfd1-4d84-91b4-796dc7692d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:51.914435 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b397ef7-bfd1-4d84-91b4-796dc7692d08 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:51.914916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b397ef7-bfd1-4d84-91b4-796dc7692d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:51.915405 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b397ef7-bfd1-4d84-91b4-796dc7692d08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:51.917713 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:51.929789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b397ef7-bfd1-4d84-91b4-796dc7692d08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:51.935158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-3b397ef7-bfd1-4d84-91b4-796dc7692d08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:51.935158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:51.935158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:51.935158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:51.935158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:51.935158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:51.935158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:51.935158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:51.935158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:51.935158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:51.935158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:51.935158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:51.935158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:51.935158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:51.935158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:51.935158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:51.936219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:51.936219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:51.936219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:51.936219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:51.936219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:51.936219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:51.936219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:51.936219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:51.936219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:51.936219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:51.936219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:51.936219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:51.936219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:51.936219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:51.936219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:51.936219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:51.937131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:51.937131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:51.937131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:51.937131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:51.937131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:51.937131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:51.937131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:51.937131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:51.937131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:51.937131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:51.937131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:51.937131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:51.939565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 156/337] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:51.945722 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb983b-da4b-4cec-82c2-985b6781f12d None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:52.037665 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:52.058819 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb983b-da4b-4cec-82c2-985b6781f12d None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:52.095858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b71ff-69bd-4493-b4fd-ae56951cf767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:52.096498 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b71ff-69bd-4493-b4fd-ae56951cf767 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:52.096779 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b71ff-69bd-4493-b4fd-ae56951cf767 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:52.097049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b71ff-69bd-4493-b4fd-ae56951cf767 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:52.097713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b71ff-69bd-4493-b4fd-ae56951cf767 None admin] RBAC: Adding query filter params (name=member) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:52.098020 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b71ff-69bd-4493-b4fd-ae56951cf767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:52.099379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b71ff-69bd-4493-b4fd-ae56951cf767 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:52.108288 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 182/338] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:52.114013 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b397ef7-bfd1-4d84-91b4-796dc7692d08 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:52.114604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114fd71-2f48-40ba-97b5-15702a75386d None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:52.114898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114fd71-2f48-40ba-97b5-15702a75386d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:52.115177 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114fd71-2f48-40ba-97b5-15702a75386d None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:52.116989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 183/339] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:52.122472 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88caf4f-35ab-4925-bc8c-6e8b0ff2da80 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:52.122859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88caf4f-35ab-4925-bc8c-6e8b0ff2da80 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:52.123677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88caf4f-35ab-4925-bc8c-6e8b0ff2da80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:52.161313 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c88caf4f-35ab-4925-bc8c-6e8b0ff2da80 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:52.162529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c88caf4f-35ab-4925-bc8c-6e8b0ff2da80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:52.304017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 184/340] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:16:52.305689 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3afac6-67cd-456b-8741-1f222515c1f7 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:52.305980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3afac6-67cd-456b-8741-1f222515c1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:52.306256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3afac6-67cd-456b-8741-1f222515c1f7 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:52.307793 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 185/341] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:52.318199 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5016e7b-e641-4a81-a6ae-3034ab07aef4 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:52.318487 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5016e7b-e641-4a81-a6ae-3034ab07aef4 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:52.318768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5016e7b-e641-4a81-a6ae-3034ab07aef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:52.320604 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b397ef7-bfd1-4d84-91b4-796dc7692d08 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:52.348600 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-f5016e7b-e641-4a81-a6ae-3034ab07aef4 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:52.351224 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f5016e7b-e641-4a81-a6ae-3034ab07aef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:52.369914 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2435e-5e2d-4df8-a9ad-6342c43ee4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:52.371403 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2435e-5e2d-4df8-a9ad-6342c43ee4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:52.371974 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2435e-5e2d-4df8-a9ad-6342c43ee4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:52.372506 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2435e-5e2d-4df8-a9ad-6342c43ee4c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:52.449370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:52.461739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2435e-5e2d-4df8-a9ad-6342c43ee4c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:52.464081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2435e-5e2d-4df8-a9ad-6342c43ee4c2 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:52.469765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:52.476783 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 186/342] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:16:52.480856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef6c2e-52c3-4df3-90bf-ffe20966f7d4 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:52.480856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef6c2e-52c3-4df3-90bf-ffe20966f7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:52.480856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef6c2e-52c3-4df3-90bf-ffe20966f7d4 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:52.480856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 187/343] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:52.485571 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4cd96-8317-4c6e-aabb-e073523bc15a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:52.485919 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4cd96-8317-4c6e-aabb-e073523bc15a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:52.486373 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4cd96-8317-4c6e-aabb-e073523bc15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:52.508582 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-93d4cd96-8317-4c6e-aabb-e073523bc15a None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:52.510076 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-93d4cd96-8317-4c6e-aabb-e073523bc15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:52.620288 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 188/344] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:16:52.637960 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 157/345] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:52.643736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4cd96-8317-4c6e-aabb-e073523bc15a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:52.762775 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4cd96-8317-4c6e-aabb-e073523bc15a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:52.808368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:52.816542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d1e6a-0f93-4d5d-a8b3-30466e52ddf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:52.817761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d1e6a-0f93-4d5d-a8b3-30466e52ddf6 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:52.825251 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d1e6a-0f93-4d5d-a8b3-30466e52ddf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:52.825251 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d1e6a-0f93-4d5d-a8b3-30466e52ddf6 None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:52.825251 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d1e6a-0f93-4d5d-a8b3-30466e52ddf6 None admin] RBAC: Authorizing `identity:get_project(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:52.827026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d1e6a-0f93-4d5d-a8b3-30466e52ddf6 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:52.828927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 189/346] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:52 2022] GET /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:52.834417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2435e-5e2d-4df8-a9ad-6342c43ee4c2 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:52.947206 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d1e6a-0f93-4d5d-a8b3-30466e52ddf6 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:52.977584 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:52.986873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2435e-5e2d-4df8-a9ad-6342c43ee4c2 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:53.031334 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb688487-7e2a-4cfb-844c-7e451e1f600f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:53.032246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb688487-7e2a-4cfb-844c-7e451e1f600f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:53.032860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb688487-7e2a-4cfb-844c-7e451e1f600f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:53.033259 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb688487-7e2a-4cfb-844c-7e451e1f600f None admin] PATH_INFO: `/v3/groups/7082146cd7c44f1baf48b10a98514519` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:53.042378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb688487-7e2a-4cfb-844c-7e451e1f600f None admin] RBAC: Authorizing `identity:get_group(group_id=7082146cd7c44f1baf48b10a98514519)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:53.044648 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb688487-7e2a-4cfb-844c-7e451e1f600f None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:53.048127 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 158/347] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 27 16:16:52 2022] GET /identity/v3/groups/7082146cd7c44f1baf48b10a98514519 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:53.049322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb688487-7e2a-4cfb-844c-7e451e1f600f None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:53.121178 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d1e6a-0f93-4d5d-a8b3-30466e52ddf6 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:53.170674 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d8bfa-dcbe-4a46-ad27-02c097a7db34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:53.171541 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d8bfa-dcbe-4a46-ad27-02c097a7db34 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:53.171984 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d8bfa-dcbe-4a46-ad27-02c097a7db34 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:53.172431 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d8bfa-dcbe-4a46-ad27-02c097a7db34 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:53.174118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb688487-7e2a-4cfb-844c-7e451e1f600f None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:53.187089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d8bfa-dcbe-4a46-ad27-02c097a7db34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:53.193078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-bd0d8bfa-dcbe-4a46-ad27-02c097a7db34 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:53.193078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:53.193078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:53.193078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:53.193078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:53.193078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:53.193078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:53.193078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:53.193078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:53.193078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:53.193078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:53.193078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:53.193078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:53.193078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:53.193078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:53.193078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:53.194052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:53.194052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:53.194052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:53.194052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:53.194052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:53.194052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:53.194052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:53.194052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:53.194052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:53.194052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:53.194052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:53.194052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:53.194052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:53.194052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:53.194052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:53.194052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:53.194854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:53.194854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:53.194854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:53.194854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:53.194854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:53.194854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:53.194854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:53.194854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:53.194854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:53.194854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:53.194854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:53.194854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:53.197008 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 190/348] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:16:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:16:53.198000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d8bfa-dcbe-4a46-ad27-02c097a7db34 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:53.213275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0e265-1cdd-4815-864e-1ff343c4b421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:53.213923 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0e265-1cdd-4815-864e-1ff343c4b421 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:53.214209 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0e265-1cdd-4815-864e-1ff343c4b421 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:53.215248 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0e265-1cdd-4815-864e-1ff343c4b421 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:53.227173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0e265-1cdd-4815-864e-1ff343c4b421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:53.232727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-add0e265-1cdd-4815-864e-1ff343c4b421 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:53.232727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:53.232727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:53.232727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:53.232727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:53.232727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:53.232727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:53.232727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:53.232727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:53.232727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:53.232727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:53.232727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:53.232727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:53.232727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:53.232727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:53.232727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:53.233694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:53.233694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:53.233694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:53.233694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:53.233694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:53.233694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:53.233694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:53.233694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:53.233694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:53.233694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:53.233694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:53.233694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:53.233694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:53.233694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:53.233694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:53.233694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:53.234516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:53.234516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:53.234516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:53.234516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:53.234516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:53.234516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:53.234516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:53.234516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:53.234516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:53.234516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:53.234516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:53.234516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:53.234516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 159/349] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:53.235200 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccefe4-ecd5-444a-9f4f-d0e19969795c None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:53.235272 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccefe4-ecd5-444a-9f4f-d0e19969795c None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:53.236146 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccefe4-ecd5-444a-9f4f-d0e19969795c None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:53.237644 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 160/350] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:53.238502 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccefe4-ecd5-444a-9f4f-d0e19969795c None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:53.258188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:53.269086 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:53.330043 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d8bfa-dcbe-4a46-ad27-02c097a7db34 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:53.366073 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccefe4-ecd5-444a-9f4f-d0e19969795c None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:53.376118 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f9e75-bdd2-4d75-83cd-c138334827ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:53.377070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f9e75-bdd2-4d75-83cd-c138334827ea None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:53.377684 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f9e75-bdd2-4d75-83cd-c138334827ea None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:53.378055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f9e75-bdd2-4d75-83cd-c138334827ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:53.378778 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f9e75-bdd2-4d75-83cd-c138334827ea None admin] RBAC: Adding query filter params (group.id=7082146cd7c44f1baf48b10a98514519, role.id=e7e5b03d7a3d404f841a8341244d5d78, scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:53.379214 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f9e75-bdd2-4d75-83cd-c138334827ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:53.381400 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f9e75-bdd2-4d75-83cd-c138334827ea None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:53.387005 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 191/351] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 27 16:16:53 2022] GET /identity/v3/role_assignments?group.id=7082146cd7c44f1baf48b10a98514519&scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9&role.id=e7e5b03d7a3d404f841a8341244d5d78 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:53.387816 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f9e75-bdd2-4d75-83cd-c138334827ea None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:53.417670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a30f50-3e9d-4ec8-8e5c-f031c2681156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:53.419400 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a30f50-3e9d-4ec8-8e5c-f031c2681156 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:53.420220 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a30f50-3e9d-4ec8-8e5c-f031c2681156 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:53.420702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a30f50-3e9d-4ec8-8e5c-f031c2681156 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:53.438037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a30f50-3e9d-4ec8-8e5c-f031c2681156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:53.445331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-b7a30f50-3e9d-4ec8-8e5c-f031c2681156 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 16:16:53.445331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:53.445331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:53.445331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:53.445331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:53.445331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:53.445331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:53.445331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:53.445331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:53.445331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:53.445331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:53.445331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:53.445331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:53.445331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:53.445331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:53.445331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:53.446276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:53.446276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:53.446276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:53.446276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:53.446276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:53.446276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:53.446276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:53.446276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:53.446276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:53.446276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:53.446276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:53.446276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:53.446276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:53.446276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:53.446276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:53.446276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:53.447097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:53.447097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:53.447097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:53.447097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:53.447097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:53.447097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:53.447097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:53.447097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:53.447097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:53.447097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:53.447097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 16:16:53.447097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:53.450370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 161/352] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:53.452309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a30f50-3e9d-4ec8-8e5c-f031c2681156 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:53.520906 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f9e75-bdd2-4d75-83cd-c138334827ea None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:53.555053 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:53.568375 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:53.575157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb870b7-0e5f-4f97-b075-e8c32a95c074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:53.576599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb870b7-0e5f-4f97-b075-e8c32a95c074 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:53.577071 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb870b7-0e5f-4f97-b075-e8c32a95c074 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:53.577815 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb870b7-0e5f-4f97-b075-e8c32a95c074 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:53.578661 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb870b7-0e5f-4f97-b075-e8c32a95c074 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:53.579295 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb870b7-0e5f-4f97-b075-e8c32a95c074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:53.581350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb870b7-0e5f-4f97-b075-e8c32a95c074 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:53.595061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 192/353] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:16:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:53.596834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f9432-f7ad-4b0b-b296-71edf1b2e8f3 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:53.597264 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f9432-f7ad-4b0b-b296-71edf1b2e8f3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:53.597696 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f9432-f7ad-4b0b-b296-71edf1b2e8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:53.603422 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a30f50-3e9d-4ec8-8e5c-f031c2681156 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:53.618981 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-828f9432-f7ad-4b0b-b296-71edf1b2e8f3 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:53.619785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-828f9432-f7ad-4b0b-b296-71edf1b2e8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:53.649330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd822ed-44fa-4832-81de-13749b8b6c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:53.649969 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd822ed-44fa-4832-81de-13749b8b6c34 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:53.650256 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd822ed-44fa-4832-81de-13749b8b6c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:53.650594 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd822ed-44fa-4832-81de-13749b8b6c34 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:53.651285 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd822ed-44fa-4832-81de-13749b8b6c34 None admin] RBAC: Adding query filter params (name=member) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:53.651643 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd822ed-44fa-4832-81de-13749b8b6c34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:53.653201 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd822ed-44fa-4832-81de-13749b8b6c34 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:53.663673 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 162/354] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:53.664649 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd822ed-44fa-4832-81de-13749b8b6c34 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:53.714576 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 193/355] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:53.714744 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f9432-f7ad-4b0b-b296-71edf1b2e8f3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:53.833500 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd822ed-44fa-4832-81de-13749b8b6c34 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:53.871988 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f9432-f7ad-4b0b-b296-71edf1b2e8f3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:53.881769 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887600af-6ead-466e-8505-1d841d9b1b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:53.882699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887600af-6ead-466e-8505-1d841d9b1b5e None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:53.883615 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887600af-6ead-466e-8505-1d841d9b1b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:53.884097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887600af-6ead-466e-8505-1d841d9b1b5e None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:53.885548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887600af-6ead-466e-8505-1d841d9b1b5e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:53.886206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887600af-6ead-466e-8505-1d841d9b1b5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:53.887707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:53.889558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887600af-6ead-466e-8505-1d841d9b1b5e None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:53.902740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 163/356] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:53.906994 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887600af-6ead-466e-8505-1d841d9b1b5e None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:53.907480 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:53.912816 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44b2b8-877f-4faa-b37a-b9099c1c8e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:53.913839 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44b2b8-877f-4faa-b37a-b9099c1c8e67 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:53.914325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44b2b8-877f-4faa-b37a-b9099c1c8e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:53.914801 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44b2b8-877f-4faa-b37a-b9099c1c8e67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:53.999949 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44b2b8-877f-4faa-b37a-b9099c1c8e67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:54.002438 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44b2b8-877f-4faa-b37a-b9099c1c8e67 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:54.022632 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887600af-6ead-466e-8505-1d841d9b1b5e None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:54.072943 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aba34c-9195-43bd-8782-6cda7284d67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:54.074207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aba34c-9195-43bd-8782-6cda7284d67e None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:54.075118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aba34c-9195-43bd-8782-6cda7284d67e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:54.075876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aba34c-9195-43bd-8782-6cda7284d67e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:54.125518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 194/357] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:54.126932 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66471f9-362f-409b-b3f6-da789249c2ac None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:54.127228 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66471f9-362f-409b-b3f6-da789249c2ac None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:54.127631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66471f9-362f-409b-b3f6-da789249c2ac None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:54.129212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 195/358] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:54.129864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66471f9-362f-409b-b3f6-da789249c2ac None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:54.145398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:54.162794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aba34c-9195-43bd-8782-6cda7284d67e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:54.165335 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aba34c-9195-43bd-8782-6cda7284d67e None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:54.167172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:54.268893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66471f9-362f-409b-b3f6-da789249c2ac None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:54.281570 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 164/359] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:54.282748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aba34c-9195-43bd-8782-6cda7284d67e None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:54.320891 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca4a9f-6493-40fa-94fa-c88e4afa6f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:54.321637 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca4a9f-6493-40fa-94fa-c88e4afa6f99 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:54.321922 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca4a9f-6493-40fa-94fa-c88e4afa6f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:54.322194 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca4a9f-6493-40fa-94fa-c88e4afa6f99 None admin] PATH_INFO: `/v3/users/014b7ccdc7624fa2823092e6520795e6` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:54.323348 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca4a9f-6493-40fa-94fa-c88e4afa6f99 None admin] RBAC: Authorizing `identity:get_user(user_id=014b7ccdc7624fa2823092e6520795e6)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:54.325170 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca4a9f-6493-40fa-94fa-c88e4afa6f99 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:54.326628 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 196/360] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:16:54 2022] GET /identity/v3/users/014b7ccdc7624fa2823092e6520795e6 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:54.332146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca4a9f-6493-40fa-94fa-c88e4afa6f99 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:54.405394 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aba34c-9195-43bd-8782-6cda7284d67e None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:54.407830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:54.437914 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:54.458934 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca4a9f-6493-40fa-94fa-c88e4afa6f99 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:54.462850 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f27a7-6a6c-47a0-a82c-3642401d373c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:54.463468 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f27a7-6a6c-47a0-a82c-3642401d373c None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:54.463752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f27a7-6a6c-47a0-a82c-3642401d373c None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:54.464026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f27a7-6a6c-47a0-a82c-3642401d373c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:54.478645 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f27a7-6a6c-47a0-a82c-3642401d373c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:54.485876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-395f27a7-6a6c-47a0-a82c-3642401d373c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:54.485876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:54.485876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:54.485876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:54.485876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:54.485876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:54.485876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:54.485876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:54.485876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:54.485876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:54.485876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:54.485876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:54.485876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:54.485876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:54.485876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:54.485876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:54.486784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:54.486784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:54.486784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:54.486784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:54.486784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:54.486784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:54.486784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:54.486784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:54.486784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:54.486784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:54.486784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:54.486784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:54.486784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:54.486784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:54.486784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:54.486784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:54.487591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:54.487591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:54.487591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:54.487591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:54.487591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:54.487591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:54.487591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:54.487591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:54.487591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:54.487591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:54.487591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:54.487591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:54.489479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 165/361] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:16:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:54.492508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de2bb4-47fb-449c-9f27-90cb7eeaf795 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:54.492508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de2bb4-47fb-449c-9f27-90cb7eeaf795 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:54.492508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de2bb4-47fb-449c-9f27-90cb7eeaf795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:54.509491 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b0ed3-433c-41ad-b522-309e61581b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:54.510278 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b0ed3-433c-41ad-b522-309e61581b74 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:54.510646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b0ed3-433c-41ad-b522-309e61581b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:54.511018 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b0ed3-433c-41ad-b522-309e61581b74 None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:54.512232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b0ed3-433c-41ad-b522-309e61581b74 None admin] RBAC: Authorizing `identity:get_project(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:54.513929 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b0ed3-433c-41ad-b522-309e61581b74 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:54.514239 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-b8de2bb4-47fb-449c-9f27-90cb7eeaf795 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:54.515617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b8de2bb4-47fb-449c-9f27-90cb7eeaf795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:54.515820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 197/362] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:54 2022] GET /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:54.516806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b0ed3-433c-41ad-b522-309e61581b74 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:54.591948 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 166/363] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:54.592972 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de2bb4-47fb-449c-9f27-90cb7eeaf795 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:54.635262 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b0ed3-433c-41ad-b522-309e61581b74 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:54.687088 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893254f-9d78-4fbe-acbe-9721b52b3cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:54.688120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893254f-9d78-4fbe-acbe-9721b52b3cbe None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:54.688650 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893254f-9d78-4fbe-acbe-9721b52b3cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:54.689173 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893254f-9d78-4fbe-acbe-9721b52b3cbe None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:54.690584 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893254f-9d78-4fbe-acbe-9721b52b3cbe None admin] RBAC: Authorizing `identity:get_project(project_id=05e8dee797fd40d4bab1c7dd5c687e36)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:54.692284 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893254f-9d78-4fbe-acbe-9721b52b3cbe None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:54.694393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 198/364] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:54 2022] GET /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:54.695924 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893254f-9d78-4fbe-acbe-9721b52b3cbe None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:54.708373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:54.721856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de2bb4-47fb-449c-9f27-90cb7eeaf795 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:54.726261 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:54.765456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bda7c-d634-4042-9008-30f63f702004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:54.767771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bda7c-d634-4042-9008-30f63f702004 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:54.767771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bda7c-d634-4042-9008-30f63f702004 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:54.767771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bda7c-d634-4042-9008-30f63f702004 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:54.767992 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596bda7c-d634-4042-9008-30f63f702004 None admin] RBAC: Adding query filter params (role.id=018bcecca3d84d2d990678f3d1d53886, user.id=014b7ccdc7624fa2823092e6520795e6, scope.system=all) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:54.768677 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596bda7c-d634-4042-9008-30f63f702004 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:54.770370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596bda7c-d634-4042-9008-30f63f702004 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:54.787741 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 167/365] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Sep 27 16:16:54 2022] GET /identity/v3/role_assignments?user.id=014b7ccdc7624fa2823092e6520795e6&scope.system=all&role.id=018bcecca3d84d2d990678f3d1d53886 => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:54.790304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bda7c-d634-4042-9008-30f63f702004 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:54.836024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893254f-9d78-4fbe-acbe-9721b52b3cbe None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:54.894406 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ae87a-238d-4c6e-95ec-c40478661fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:54.894826 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ae87a-238d-4c6e-95ec-c40478661fca None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:54.895109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ae87a-238d-4c6e-95ec-c40478661fca None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:54.895375 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ae87a-238d-4c6e-95ec-c40478661fca None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:54.896042 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ae87a-238d-4c6e-95ec-c40478661fca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:54.896355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ae87a-238d-4c6e-95ec-c40478661fca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:54.897730 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ae87a-238d-4c6e-95ec-c40478661fca None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:54.906810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 199/366] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:16:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:54.913709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ae87a-238d-4c6e-95ec-c40478661fca None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:54.954297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bda7c-d634-4042-9008-30f63f702004 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:55.012442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9905a-d2e2-4f8f-b9db-7a230f94e51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:55.013127 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9905a-d2e2-4f8f-b9db-7a230f94e51d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:55.013478 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9905a-d2e2-4f8f-b9db-7a230f94e51d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:55.013839 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9905a-d2e2-4f8f-b9db-7a230f94e51d None admin] PATH_INFO: `/v3/groups/7082146cd7c44f1baf48b10a98514519` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:55.016169 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9905a-d2e2-4f8f-b9db-7a230f94e51d None admin] RBAC: Authorizing `identity:get_group(group_id=7082146cd7c44f1baf48b10a98514519)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:55.018045 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9905a-d2e2-4f8f-b9db-7a230f94e51d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:55.019975 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 168/367] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 27 16:16:54 2022] GET /identity/v3/groups/7082146cd7c44f1baf48b10a98514519 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:55.021457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9905a-d2e2-4f8f-b9db-7a230f94e51d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:55.047001 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:55.060005 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:55.094002 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ae87a-238d-4c6e-95ec-c40478661fca None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:55.135142 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed45a71-26f5-4725-8b5e-e21edf7b3c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:55.136295 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed45a71-26f5-4725-8b5e-e21edf7b3c8c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:55.136858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed45a71-26f5-4725-8b5e-e21edf7b3c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:55.137468 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed45a71-26f5-4725-8b5e-e21edf7b3c8c None admin] PATH_INFO: `/v3/groups/7082146cd7c44f1baf48b10a98514519` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:55.139548 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed45a71-26f5-4725-8b5e-e21edf7b3c8c None admin] RBAC: Authorizing `identity:get_group(group_id=7082146cd7c44f1baf48b10a98514519)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:55.141618 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed45a71-26f5-4725-8b5e-e21edf7b3c8c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:55.143963 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 200/368] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 27 16:16:54 2022] GET /identity/v3/groups/7082146cd7c44f1baf48b10a98514519 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:55.144614 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed45a71-26f5-4725-8b5e-e21edf7b3c8c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:55.147924 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9905a-d2e2-4f8f-b9db-7a230f94e51d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:55.191346 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f3cbf-bba6-40b1-8bc0-6438b95dca7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:55.192770 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f3cbf-bba6-40b1-8bc0-6438b95dca7c None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:55.193267 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f3cbf-bba6-40b1-8bc0-6438b95dca7c None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:55.193705 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f3cbf-bba6-40b1-8bc0-6438b95dca7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:55.265169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed45a71-26f5-4725-8b5e-e21edf7b3c8c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:55.285675 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f3cbf-bba6-40b1-8bc0-6438b95dca7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:55.287123 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f3cbf-bba6-40b1-8bc0-6438b95dca7c None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:55.312166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:55.314284 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102f30f-9660-4a6a-ac95-eea2cfc7bbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:55.314971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102f30f-9660-4a6a-ac95-eea2cfc7bbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:55.315206 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102f30f-9660-4a6a-ac95-eea2cfc7bbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:55.315479 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102f30f-9660-4a6a-ac95-eea2cfc7bbf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:55.328144 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102f30f-9660-4a6a-ac95-eea2cfc7bbf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:55.334630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-e102f30f-9660-4a6a-ac95-eea2cfc7bbf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:16:55.334630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:55.334630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:55.334630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:55.334630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:55.334630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:55.334630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:55.334630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:55.334630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:55.334630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:55.334630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:55.334630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:55.334630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:55.334630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:55.334630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:55.334630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:55.335777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:55.335777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:55.335777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:55.335777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:55.335777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:55.335777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:55.335777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:55.335777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:55.335777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:55.335777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:55.335777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:55.335777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:55.335777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:55.335777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:55.335777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:55.335777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:55.336749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:55.336749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:55.336749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:55.336749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:55.336749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:55.336749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:55.336749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:55.336749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:55.336749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:55.336749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:55.336749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:16:55.336749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:55.336749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 201/369] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:16:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:55.336749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102f30f-9660-4a6a-ac95-eea2cfc7bbf8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:55.350499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:55.411622 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 169/370] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:55.416371 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f3cbf-bba6-40b1-8bc0-6438b95dca7c None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:55.462278 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102f30f-9660-4a6a-ac95-eea2cfc7bbf8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:55.516579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d67193-ca77-43d1-a4b2-7b5111b219ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:55.517140 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d67193-ca77-43d1-a4b2-7b5111b219ea None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:55.517416 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d67193-ca77-43d1-a4b2-7b5111b219ea None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:55.517683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d67193-ca77-43d1-a4b2-7b5111b219ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:55.518398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d67193-ca77-43d1-a4b2-7b5111b219ea None admin] RBAC: Adding query filter params (group.id=7082146cd7c44f1baf48b10a98514519, role.id=f60b6d7b309a4537a233198456c7aa34, scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:55.518704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d67193-ca77-43d1-a4b2-7b5111b219ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:55.520131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d67193-ca77-43d1-a4b2-7b5111b219ea None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:55.525997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 202/371] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 27 16:16:55 2022] GET /identity/v3/role_assignments?group.id=7082146cd7c44f1baf48b10a98514519&scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9&role.id=f60b6d7b309a4537a233198456c7aa34 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:55.526781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d67193-ca77-43d1-a4b2-7b5111b219ea None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:55.553206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f3cbf-bba6-40b1-8bc0-6438b95dca7c None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:55.575670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:55.603156 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2d4ad-35da-4bb1-8039-ed2d601aaf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:55.603788 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2d4ad-35da-4bb1-8039-ed2d601aaf68 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:55.604070 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2d4ad-35da-4bb1-8039-ed2d601aaf68 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:55.604365 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2d4ad-35da-4bb1-8039-ed2d601aaf68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:55.605117 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2d4ad-35da-4bb1-8039-ed2d601aaf68 None admin] RBAC: Adding query filter params (group.id=7082146cd7c44f1baf48b10a98514519, role.id=e7e5b03d7a3d404f841a8341244d5d78, scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:55.605457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2d4ad-35da-4bb1-8039-ed2d601aaf68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:55.607809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2d4ad-35da-4bb1-8039-ed2d601aaf68 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:55.619997 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 170/372] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 27 16:16:55 2022] GET /identity/v3/role_assignments?group.id=7082146cd7c44f1baf48b10a98514519&scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36&role.id=e7e5b03d7a3d404f841a8341244d5d78 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:55.619997 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2d4ad-35da-4bb1-8039-ed2d601aaf68 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:55.657131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:55.736405 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d67193-ca77-43d1-a4b2-7b5111b219ea None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:55.814832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2d4ad-35da-4bb1-8039-ed2d601aaf68 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:55.820694 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edff0b0-0036-4c99-b3d3-b3f6c7f37fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:55.821691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edff0b0-0036-4c99-b3d3-b3f6c7f37fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:55.822182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edff0b0-0036-4c99-b3d3-b3f6c7f37fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:55.822658 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edff0b0-0036-4c99-b3d3-b3f6c7f37fe5 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:55.823658 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edff0b0-0036-4c99-b3d3-b3f6c7f37fe5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:55.824178 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edff0b0-0036-4c99-b3d3-b3f6c7f37fe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:55.825903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edff0b0-0036-4c99-b3d3-b3f6c7f37fe5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:55.836061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 203/373] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:55.837830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7dfbb-72ac-4ecf-a01d-616de42a3144 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:55.838338 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7dfbb-72ac-4ecf-a01d-616de42a3144 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:55.838820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7dfbb-72ac-4ecf-a01d-616de42a3144 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:55.840477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 204/374] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:55.847410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b102b07-68b6-4f2f-a778-ceb62f2df09c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:55.847986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b102b07-68b6-4f2f-a778-ceb62f2df09c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:55.848592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b102b07-68b6-4f2f-a778-ceb62f2df09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:55.864900 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b1b4c-76b8-4bff-ab61-066b6ff204b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:55.871791 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b1b4c-76b8-4bff-ab61-066b6ff204b8 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:55.871791 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b1b4c-76b8-4bff-ab61-066b6ff204b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:55.871791 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b1b4c-76b8-4bff-ab61-066b6ff204b8 None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:55.871791 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b1b4c-76b8-4bff-ab61-066b6ff204b8 None admin] RBAC: Authorizing `identity:get_project(project_id=05e8dee797fd40d4bab1c7dd5c687e36)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:55.871791 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b1b4c-76b8-4bff-ab61-066b6ff204b8 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:55.871791 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 171/375] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:55 2022] GET /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:55.872516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b1b4c-76b8-4bff-ab61-066b6ff204b8 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:55.876084 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6b102b07-68b6-4f2f-a778-ceb62f2df09c None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:55.877474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6b102b07-68b6-4f2f-a778-ceb62f2df09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:55.929651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:55.962838 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 205/376] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:16:55.964168 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b102b07-68b6-4f2f-a778-ceb62f2df09c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:56.010589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b1b4c-76b8-4bff-ab61-066b6ff204b8 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:56.035878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:56.083453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b102b07-68b6-4f2f-a778-ceb62f2df09c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:56.089103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c916c-9a83-490c-a2c3-759316471398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:56.095066 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c916c-9a83-490c-a2c3-759316471398 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:56.095574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c916c-9a83-490c-a2c3-759316471398 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:56.096027 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c916c-9a83-490c-a2c3-759316471398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:56.149598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2b23c-c9da-4077-9169-4c4484452471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:56.150240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2b23c-c9da-4077-9169-4c4484452471 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:56.150519 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2b23c-c9da-4077-9169-4c4484452471 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:56.150795 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2b23c-c9da-4077-9169-4c4484452471 None admin] PATH_INFO: `/v3/groups/7082146cd7c44f1baf48b10a98514519` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:56.157006 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2b23c-c9da-4077-9169-4c4484452471 None admin] RBAC: Authorizing `identity:get_group(group_id=7082146cd7c44f1baf48b10a98514519)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:56.158732 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2b23c-c9da-4077-9169-4c4484452471 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:56.161401 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 206/377] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 27 16:16:55 2022] GET /identity/v3/groups/7082146cd7c44f1baf48b10a98514519 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:56.165633 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2b23c-c9da-4077-9169-4c4484452471 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:56.177645 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c916c-9a83-490c-a2c3-759316471398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:56.179417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c916c-9a83-490c-a2c3-759316471398 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:56.234254 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:56.286398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 172/378] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:16:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:16:56.293276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c916c-9a83-490c-a2c3-759316471398 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:56.361448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2b23c-c9da-4077-9169-4c4484452471 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:56.402687 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:56.411075 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f27f3e-5f02-47e7-a2e6-e053d37afde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:56.415938 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f27f3e-5f02-47e7-a2e6-e053d37afde7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:56.415938 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f27f3e-5f02-47e7-a2e6-e053d37afde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:56.415938 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f27f3e-5f02-47e7-a2e6-e053d37afde7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:56.415938 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f27f3e-5f02-47e7-a2e6-e053d37afde7 None admin] RBAC: Adding query filter params (group.id=7082146cd7c44f1baf48b10a98514519, role.id=f60b6d7b309a4537a233198456c7aa34, scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:56.415938 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f27f3e-5f02-47e7-a2e6-e053d37afde7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:56.415938 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f27f3e-5f02-47e7-a2e6-e053d37afde7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:56.418653 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c916c-9a83-490c-a2c3-759316471398 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:56.429080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 207/379] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 27 16:16:56 2022] GET /identity/v3/role_assignments?group.id=7082146cd7c44f1baf48b10a98514519&scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36&role.id=f60b6d7b309a4537a233198456c7aa34 => generated 260 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:56.430345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f27f3e-5f02-47e7-a2e6-e053d37afde7 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:56.461620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18206d-bdf6-43fa-9bff-a8ee411d0768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:56.462278 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18206d-bdf6-43fa-9bff-a8ee411d0768 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:56.462558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18206d-bdf6-43fa-9bff-a8ee411d0768 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:56.462833 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18206d-bdf6-43fa-9bff-a8ee411d0768 None admin] PATH_INFO: `/v3/projects/e4cc0d5ca9c1419e8012fd96a408e70a` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:56.464049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18206d-bdf6-43fa-9bff-a8ee411d0768 None admin] RBAC: Authorizing `identity:get_project(project_id=e4cc0d5ca9c1419e8012fd96a408e70a)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:56.465683 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18206d-bdf6-43fa-9bff-a8ee411d0768 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:56.468897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 173/380] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:56 2022] GET /identity/v3/projects/e4cc0d5ca9c1419e8012fd96a408e70a => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:56.475854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18206d-bdf6-43fa-9bff-a8ee411d0768 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:56.501001 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:56.577657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f27f3e-5f02-47e7-a2e6-e053d37afde7 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:56.599484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18206d-bdf6-43fa-9bff-a8ee411d0768 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:56.625094 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b7dcf-4bb4-47b4-9894-6927bd921f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:56.626307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b7dcf-4bb4-47b4-9894-6927bd921f18 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:56.626923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b7dcf-4bb4-47b4-9894-6927bd921f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:56.627404 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b7dcf-4bb4-47b4-9894-6927bd921f18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:56.646075 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b7dcf-4bb4-47b4-9894-6927bd921f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:56.652904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-840b7dcf-4bb4-47b4-9894-6927bd921f18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:56.652904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:56.652904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:56.652904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:56.652904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:56.652904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:56.652904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:56.652904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:56.652904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:56.652904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:56.652904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:56.652904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:56.652904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:56.652904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:56.652904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:56.652904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:56.653895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:56.653895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:56.653895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:56.653895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:56.653895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:56.653895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:56.653895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:56.653895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:56.653895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:56.653895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:56.653895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:56.653895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:56.653895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:56.653895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:56.653895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:56.653895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:56.655238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:56.655238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:56.655238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:56.655238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:56.655238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:56.655238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:56.655238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:56.655238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:56.655238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:56.655238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:56.655238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:56.655238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:56.657835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 208/381] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:56.658768 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f7f66-b4cd-49dd-a10e-d2e8dce3343b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:56.659564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f7f66-b4cd-49dd-a10e-d2e8dce3343b None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:56.659845 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f7f66-b4cd-49dd-a10e-d2e8dce3343b None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:56.660117 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f7f66-b4cd-49dd-a10e-d2e8dce3343b None admin] PATH_INFO: `/v3/groups/c939a1e7787e48dc831cd64404c5c5eb` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:56.665355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b7dcf-4bb4-47b4-9894-6927bd921f18 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:56.681070 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f7f66-b4cd-49dd-a10e-d2e8dce3343b None admin] RBAC: Authorizing `identity:get_group(group_id=c939a1e7787e48dc831cd64404c5c5eb)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:56.682637 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f7f66-b4cd-49dd-a10e-d2e8dce3343b None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:56.684853 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 174/382] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 27 16:16:56 2022] GET /identity/v3/groups/c939a1e7787e48dc831cd64404c5c5eb => generated 229 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:56.695105 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f7f66-b4cd-49dd-a10e-d2e8dce3343b None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:56.772118 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:56.853169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b7dcf-4bb4-47b4-9894-6927bd921f18 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:56.868699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:56.896125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f7f66-b4cd-49dd-a10e-d2e8dce3343b None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:56.906411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b37bb-5f29-4de0-b524-d9d4da215d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:56.907380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b37bb-5f29-4de0-b524-d9d4da215d20 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:56.907861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b37bb-5f29-4de0-b524-d9d4da215d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:56.908821 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b37bb-5f29-4de0-b524-d9d4da215d20 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:56.909687 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b37bb-5f29-4de0-b524-d9d4da215d20 None admin] RBAC: Adding query filter params (name=member) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:56.910191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b37bb-5f29-4de0-b524-d9d4da215d20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:56.911772 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b37bb-5f29-4de0-b524-d9d4da215d20 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:56.925242 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 209/383] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:56.931633 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b37bb-5f29-4de0-b524-d9d4da215d20 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:56.993632 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b972ded-fee1-4ccc-b975-dc8c266091ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:56.994792 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b972ded-fee1-4ccc-b975-dc8c266091ef None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:56.997122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b972ded-fee1-4ccc-b975-dc8c266091ef None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:56.997839 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b972ded-fee1-4ccc-b975-dc8c266091ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:56.999415 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b972ded-fee1-4ccc-b975-dc8c266091ef None admin] RBAC: Adding query filter params (group.id=c939a1e7787e48dc831cd64404c5c5eb, role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.project.id=e4cc0d5ca9c1419e8012fd96a408e70a) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:57.000085 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b972ded-fee1-4ccc-b975-dc8c266091ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:57.002672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b972ded-fee1-4ccc-b975-dc8c266091ef None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:57.015772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 175/384] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 27 16:16:56 2022] GET /identity/v3/role_assignments?group.id=c939a1e7787e48dc831cd64404c5c5eb&scope.project.id=e4cc0d5ca9c1419e8012fd96a408e70a&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 260 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:57.063187 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b37bb-5f29-4de0-b524-d9d4da215d20 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:57.083093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:57.106449 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751590b-cc8e-4810-af25-1c40ec15e12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:57.107464 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751590b-cc8e-4810-af25-1c40ec15e12f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:57.107961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751590b-cc8e-4810-af25-1c40ec15e12f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:57.108481 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751590b-cc8e-4810-af25-1c40ec15e12f None admin] PATH_INFO: `/v3/groups/7082146cd7c44f1baf48b10a98514519` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:57.109779 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751590b-cc8e-4810-af25-1c40ec15e12f None admin] RBAC: Authorizing `identity:get_group(group_id=7082146cd7c44f1baf48b10a98514519)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:57.111432 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751590b-cc8e-4810-af25-1c40ec15e12f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:57.113216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 210/385] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 27 16:16:56 2022] GET /identity/v3/groups/7082146cd7c44f1baf48b10a98514519 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:57.120356 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b972ded-fee1-4ccc-b975-dc8c266091ef None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:57.246895 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b972ded-fee1-4ccc-b975-dc8c266091ef None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:57.287400 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccecbf-58dc-46fe-8b7c-81cf3a540e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:57.288443 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccecbf-58dc-46fe-8b7c-81cf3a540e3d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:57.288922 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccecbf-58dc-46fe-8b7c-81cf3a540e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:57.289418 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccecbf-58dc-46fe-8b7c-81cf3a540e3d None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:57.290785 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccecbf-58dc-46fe-8b7c-81cf3a540e3d None admin] RBAC: Authorizing `identity:get_project(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:57.292482 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccecbf-58dc-46fe-8b7c-81cf3a540e3d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:57.294578 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 176/386] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:57 2022] GET /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:57.301076 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751590b-cc8e-4810-af25-1c40ec15e12f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:57.425600 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751590b-cc8e-4810-af25-1c40ec15e12f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:57.472020 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ced49-6fda-46d5-ab1a-b238a985a63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:57.473544 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ced49-6fda-46d5-ab1a-b238a985a63c None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:57.474213 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ced49-6fda-46d5-ab1a-b238a985a63c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:57.474824 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ced49-6fda-46d5-ab1a-b238a985a63c None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9/groups/7082146cd7c44f1baf48b10a98514519/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:57.477204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ced49-6fda-46d5-ab1a-b238a985a63c None admin] RBAC: Authorizing `identity:create_grant(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9, group_id=7082146cd7c44f1baf48b10a98514519, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:57.478904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ced49-6fda-46d5-ab1a-b238a985a63c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:57.581102 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 211/387] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Sep 27 16:16:57 2022] PUT /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9/groups/7082146cd7c44f1baf48b10a98514519/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:16:58.129062 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fb893-578f-414d-9530-99a686a92bf2 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:58.129556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fb893-578f-414d-9530-99a686a92bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:58.129556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fb893-578f-414d-9530-99a686a92bf2 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:58.131105 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 177/388] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:58.136328 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3dcad-8e1a-424a-8ded-9839a50eee86 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:58.136758 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3dcad-8e1a-424a-8ded-9839a50eee86 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:58.136968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3dcad-8e1a-424a-8ded-9839a50eee86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:58.156781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1ad3dcad-8e1a-424a-8ded-9839a50eee86 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:58.157975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1ad3dcad-8e1a-424a-8ded-9839a50eee86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:58.205109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:58.232509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 212/389] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:58.520081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a286cd-9092-44f6-ba4b-88d070cf76b2 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:58.520598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a286cd-9092-44f6-ba4b-88d070cf76b2 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:58.520876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a286cd-9092-44f6-ba4b-88d070cf76b2 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:58.522432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 178/390] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:58.527725 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee371a-2fa4-4067-91ed-8db2f986763f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:58.528010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee371a-2fa4-4067-91ed-8db2f986763f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:58.528282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee371a-2fa4-4067-91ed-8db2f986763f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:58.548837 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-f9ee371a-2fa4-4067-91ed-8db2f986763f None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:58.550018 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f9ee371a-2fa4-4067-91ed-8db2f986763f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:58.570769 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a286cd-9092-44f6-ba4b-88d070cf76b2 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:58.594886 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:58.622672 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 213/391] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:58.737095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a286cd-9092-44f6-ba4b-88d070cf76b2 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:58.798396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff1b0a-ccdc-41aa-923f-acb361db420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:58.798510 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff1b0a-ccdc-41aa-923f-acb361db420f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:58.798754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff1b0a-ccdc-41aa-923f-acb361db420f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:58.799034 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff1b0a-ccdc-41aa-923f-acb361db420f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:58.817232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff1b0a-ccdc-41aa-923f-acb361db420f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:58.822150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-6cff1b0a-ccdc-41aa-923f-acb361db420f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:58.822150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:58.822150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:58.822150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:58.822150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:58.822150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:58.822150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:58.822150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:58.822150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:58.822150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:58.822150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:58.822150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:58.822150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:58.822150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:58.822150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:58.822150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:58.823039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:58.823039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:58.823039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:58.823039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:58.823039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:58.823039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:58.823039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:58.823039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:58.823039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:58.823039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:58.823039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:58.823039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:58.823039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:58.823039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:58.823039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:58.823039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:58.823834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:58.823834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:58.823834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:58.823834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:58.823834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:58.823834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:58.823834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:58.823834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:58.823834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:58.823834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:58.823834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:58.823834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:16:58.823834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 179/392] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:16:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:58.829372 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee371a-2fa4-4067-91ed-8db2f986763f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:58.945769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee371a-2fa4-4067-91ed-8db2f986763f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:58.948094 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:58.981221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b96cd-5ce4-4210-bdff-6dea55dec3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:58.981885 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b96cd-5ce4-4210-bdff-6dea55dec3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:58.982165 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b96cd-5ce4-4210-bdff-6dea55dec3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:58.982993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b96cd-5ce4-4210-bdff-6dea55dec3f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:58.983659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b96cd-5ce4-4210-bdff-6dea55dec3f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:58.983959 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b96cd-5ce4-4210-bdff-6dea55dec3f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:58.985378 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b96cd-5ce4-4210-bdff-6dea55dec3f5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:58.994743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 214/393] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:16:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:59.001091 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff1b0a-ccdc-41aa-923f-acb361db420f None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:59.034231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b96cd-5ce4-4210-bdff-6dea55dec3f5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:59.135662 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:59.153519 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b96cd-5ce4-4210-bdff-6dea55dec3f5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:59.164964 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff1b0a-ccdc-41aa-923f-acb361db420f None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:59.191084 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7667cd1-6f50-4949-b1e6-824054e33944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:59.192048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7667cd1-6f50-4949-b1e6-824054e33944 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:59.192628 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7667cd1-6f50-4949-b1e6-824054e33944 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:59.193075 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7667cd1-6f50-4949-b1e6-824054e33944 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:59.204616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a16a9-9f8b-4c34-b204-85a1cd9e02cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:59.205561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a16a9-9f8b-4c34-b204-85a1cd9e02cb None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:59.205948 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7667cd1-6f50-4949-b1e6-824054e33944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:59.206331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a16a9-9f8b-4c34-b204-85a1cd9e02cb None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:59.206801 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a16a9-9f8b-4c34-b204-85a1cd9e02cb None admin] PATH_INFO: `/v3/groups/7082146cd7c44f1baf48b10a98514519` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:59.208104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a16a9-9f8b-4c34-b204-85a1cd9e02cb None admin] RBAC: Authorizing `identity:get_group(group_id=7082146cd7c44f1baf48b10a98514519)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:59.209796 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a16a9-9f8b-4c34-b204-85a1cd9e02cb None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:59.211319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-c7667cd1-6f50-4949-b1e6-824054e33944 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:59.211319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:59.211319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:59.211319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:59.211319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:59.211319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:59.211319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:59.211319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:59.211319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:59.211319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:59.211319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:59.211319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:59.211319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:59.211319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:59.211319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:59.211319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:59.212181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:59.212181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:59.212181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:59.212181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:59.212181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:59.212181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:59.212181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:59.212181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:59.212181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:59.212181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:59.212181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:59.212181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:59.212181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:59.212181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:59.212181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:59.212181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:59.213017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:59.213017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:59.213017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:59.213017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:59.213017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:59.213017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:59.213017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:59.213017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:59.213017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:59.213017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:59.213017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:16:59.213017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:59.213017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 215/394] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:16:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:16:59.214213 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba8d92-fe65-44e8-978b-c7f49cb6b1ad None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:59.214213 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba8d92-fe65-44e8-978b-c7f49cb6b1ad None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:59.214455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba8d92-fe65-44e8-978b-c7f49cb6b1ad None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:59.214915 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 180/395] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 27 16:16:58 2022] GET /identity/v3/groups/7082146cd7c44f1baf48b10a98514519 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:59.215797 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 216/396] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:59.221201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba8d92-fe65-44e8-978b-c7f49cb6b1ad None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:59.221797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93583ba5-471f-4147-9c83-89cae1e9bec1 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:59.222298 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93583ba5-471f-4147-9c83-89cae1e9bec1 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:59.222776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93583ba5-471f-4147-9c83-89cae1e9bec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:59.243850 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-93583ba5-471f-4147-9c83-89cae1e9bec1 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:59.245523 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-93583ba5-471f-4147-9c83-89cae1e9bec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:59.251383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:59.319432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 181/397] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:59.325397 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93583ba5-471f-4147-9c83-89cae1e9bec1 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:59.334152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba8d92-fe65-44e8-978b-c7f49cb6b1ad None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:59.370900 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9eca3-9d1c-448e-9e70-885de877da6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:59.371552 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9eca3-9d1c-448e-9e70-885de877da6b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:59.371839 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9eca3-9d1c-448e-9e70-885de877da6b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:59.372115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9eca3-9d1c-448e-9e70-885de877da6b None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:59.373344 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9eca3-9d1c-448e-9e70-885de877da6b None admin] RBAC: Authorizing `identity:get_project(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:59.376559 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9eca3-9d1c-448e-9e70-885de877da6b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:59.376679 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 217/398] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:59 2022] GET /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:59.382602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9eca3-9d1c-448e-9e70-885de877da6b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:59.479903 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:59.483377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:59.495636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9eca3-9d1c-448e-9e70-885de877da6b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:59.530200 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93583ba5-471f-4147-9c83-89cae1e9bec1 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:59.562035 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62691e-0a9e-483a-93ef-fb7cfa7f6ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:59.562708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62691e-0a9e-483a-93ef-fb7cfa7f6ccb None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:59.562985 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62691e-0a9e-483a-93ef-fb7cfa7f6ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:59.563258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62691e-0a9e-483a-93ef-fb7cfa7f6ccb None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9/groups/7082146cd7c44f1baf48b10a98514519/roles/f60b6d7b309a4537a233198456c7aa34` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:59.568535 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62691e-0a9e-483a-93ef-fb7cfa7f6ccb None admin] RBAC: Authorizing `identity:create_grant(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9, group_id=7082146cd7c44f1baf48b10a98514519, role_id=f60b6d7b309a4537a233198456c7aa34)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:59.569988 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62691e-0a9e-483a-93ef-fb7cfa7f6ccb None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:59.586974 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea88a98-fb35-49f9-87e1-ea9097926ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:59.587581 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea88a98-fb35-49f9-87e1-ea9097926ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:59.588066 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea88a98-fb35-49f9-87e1-ea9097926ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:59.588369 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea88a98-fb35-49f9-87e1-ea9097926ea5 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:59.589042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea88a98-fb35-49f9-87e1-ea9097926ea5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:16:59.589346 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea88a98-fb35-49f9-87e1-ea9097926ea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:59.590837 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea88a98-fb35-49f9-87e1-ea9097926ea5 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:59.600240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 182/399] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:16:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:16:59.605840 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea88a98-fb35-49f9-87e1-ea9097926ea5 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:59.640748 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 218/400] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Sep 27 16:16:59 2022] PUT /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9/groups/7082146cd7c44f1baf48b10a98514519/roles/f60b6d7b309a4537a233198456c7aa34 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:16:59.641759 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62691e-0a9e-483a-93ef-fb7cfa7f6ccb None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:59.771830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62691e-0a9e-483a-93ef-fb7cfa7f6ccb None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:59.782449 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea88a98-fb35-49f9-87e1-ea9097926ea5 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:16:59.828460 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beded8ca-459c-4962-8263-957ffe78e84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:59.829096 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beded8ca-459c-4962-8263-957ffe78e84f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:59.829376 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beded8ca-459c-4962-8263-957ffe78e84f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:59.829547 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a7f39-7e7e-4232-a4cc-0822210c01b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:16:59.829664 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beded8ca-459c-4962-8263-957ffe78e84f None admin] PATH_INFO: `/v3/groups/7082146cd7c44f1baf48b10a98514519` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:59.830177 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a7f39-7e7e-4232-a4cc-0822210c01b8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:59.830432 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a7f39-7e7e-4232-a4cc-0822210c01b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:59.830706 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a7f39-7e7e-4232-a4cc-0822210c01b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:59.830802 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beded8ca-459c-4962-8263-957ffe78e84f None admin] RBAC: Authorizing `identity:get_group(group_id=7082146cd7c44f1baf48b10a98514519)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:16:59.832172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beded8ca-459c-4962-8263-957ffe78e84f None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:16:59.834188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 183/401] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 27 16:16:59 2022] GET /identity/v3/groups/7082146cd7c44f1baf48b10a98514519 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:16:59.835175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13325a8-abf2-402b-9d52-23984e2012fe None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:59.835458 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13325a8-abf2-402b-9d52-23984e2012fe None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:59.835730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13325a8-abf2-402b-9d52-23984e2012fe None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:59.837086 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 184/402] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:16:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:16:59.842313 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13325a8-abf2-402b-9d52-23984e2012fe None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:59.845447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:59.849274 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a7f39-7e7e-4232-a4cc-0822210c01b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:16:59.854418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-c81a7f39-7e7e-4232-a4cc-0822210c01b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:59.854418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:16:59.854418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:16:59.854418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:16:59.854418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:16:59.854418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:16:59.854418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:16:59.854418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:16:59.854418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:16:59.854418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:16:59.854418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:16:59.854418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:16:59.854418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:16:59.854418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:16:59.854418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:16:59.854418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:16:59.862355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:16:59.862355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:16:59.862355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:16:59.862355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:16:59.862355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:16:59.862355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:16:59.862355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:16:59.862355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:16:59.862355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:16:59.862355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:16:59.862355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:16:59.862355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:16:59.862355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:16:59.862355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:16:59.862355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:16:59.862355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:16:59.863257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:16:59.863257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:16:59.863257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:16:59.863257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:16:59.863257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:16:59.863257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:16:59.863257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:16:59.863257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:16:59.863257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:16:59.863257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:16:59.863257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:16:59.863257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:16:59.863257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 219/403] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:16:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:16:59.863257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35c161-3551-433d-97e8-342bc20e3b7b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:16:59.863968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35c161-3551-433d-97e8-342bc20e3b7b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:16:59.863968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35c161-3551-433d-97e8-342bc20e3b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:16:59.888018 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-bc35c161-3551-433d-97e8-342bc20e3b7b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:16:59.889311 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-bc35c161-3551-433d-97e8-342bc20e3b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:16:59.903952 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:16:59.977897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 220/404] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:16:59.979222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35c161-3551-433d-97e8-342bc20e3b7b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:16:59.993015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13325a8-abf2-402b-9d52-23984e2012fe None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:00.074060 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4915e7-d171-40f8-b442-7f488d73dd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:00.075243 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4915e7-d171-40f8-b442-7f488d73dd07 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:00.077316 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4915e7-d171-40f8-b442-7f488d73dd07 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:00.077797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4915e7-d171-40f8-b442-7f488d73dd07 None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:00.079300 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4915e7-d171-40f8-b442-7f488d73dd07 None admin] RBAC: Authorizing `identity:get_project(project_id=05e8dee797fd40d4bab1c7dd5c687e36)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:00.081835 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4915e7-d171-40f8-b442-7f488d73dd07 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:00.086411 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 185/405] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:16:59 2022] GET /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:00.093275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4915e7-d171-40f8-b442-7f488d73dd07 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:00.122776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35c161-3551-433d-97e8-342bc20e3b7b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:00.194723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0d9b4-0e2e-45e9-8c47-4533085b1aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:00.196257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0d9b4-0e2e-45e9-8c47-4533085b1aba None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:00.196768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0d9b4-0e2e-45e9-8c47-4533085b1aba None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:00.197244 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0d9b4-0e2e-45e9-8c47-4533085b1aba None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:00.198127 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0d9b4-0e2e-45e9-8c47-4533085b1aba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:00.198644 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0d9b4-0e2e-45e9-8c47-4533085b1aba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:00.201055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0d9b4-0e2e-45e9-8c47-4533085b1aba None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:00.211899 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 221/406] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:16:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:00.218444 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0d9b4-0e2e-45e9-8c47-4533085b1aba None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:00.227746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:00.246080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:00.296909 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4915e7-d171-40f8-b442-7f488d73dd07 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:00.340326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0d9b4-0e2e-45e9-8c47-4533085b1aba None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:00.341022 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3c53f-e8e5-400e-ac30-bd1a8b036e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:00.342432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3c53f-e8e5-400e-ac30-bd1a8b036e7d None admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:00.346969 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3c53f-e8e5-400e-ac30-bd1a8b036e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:00.346969 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3c53f-e8e5-400e-ac30-bd1a8b036e7d None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36/groups/7082146cd7c44f1baf48b10a98514519/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:00.346969 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3c53f-e8e5-400e-ac30-bd1a8b036e7d None admin] RBAC: Authorizing `identity:create_grant(project_id=05e8dee797fd40d4bab1c7dd5c687e36, group_id=7082146cd7c44f1baf48b10a98514519, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:00.346969 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3c53f-e8e5-400e-ac30-bd1a8b036e7d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:00.376431 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e7576-765a-463f-8bb1-a12dda2869f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:00.377104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7576-765a-463f-8bb1-a12dda2869f2 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:00.377379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7576-765a-463f-8bb1-a12dda2869f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:00.377647 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7576-765a-463f-8bb1-a12dda2869f2 None admin] PATH_INFO: `/v3/groups/7082146cd7c44f1baf48b10a98514519` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:00.378767 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e7576-765a-463f-8bb1-a12dda2869f2 None admin] RBAC: Authorizing `identity:get_group(group_id=7082146cd7c44f1baf48b10a98514519)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:00.380170 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e7576-765a-463f-8bb1-a12dda2869f2 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:00.381981 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 222/407] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 27 16:17:00 2022] GET /identity/v3/groups/7082146cd7c44f1baf48b10a98514519 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:00.386558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e7576-765a-463f-8bb1-a12dda2869f2 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:00.438156 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 186/408] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Sep 27 16:17:00 2022] PUT /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36/groups/7082146cd7c44f1baf48b10a98514519/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:17:00.439775 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3c53f-e8e5-400e-ac30-bd1a8b036e7d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:00.476878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:00.541333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e7576-765a-463f-8bb1-a12dda2869f2 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:00.614163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c400f88-99e9-4a5d-8433-eee8c14581a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:00.614728 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c400f88-99e9-4a5d-8433-eee8c14581a4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:00.615009 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c400f88-99e9-4a5d-8433-eee8c14581a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:00.615291 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c400f88-99e9-4a5d-8433-eee8c14581a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:00.626478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c400f88-99e9-4a5d-8433-eee8c14581a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:00.632594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-3c400f88-99e9-4a5d-8433-eee8c14581a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:17:00.632594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:00.632594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:00.632594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:00.632594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:00.632594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:00.632594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:00.632594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:00.632594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:00.632594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:00.632594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:00.632594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:00.632594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:00.632594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:00.632594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:00.632594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:00.633667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:00.633667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:00.633667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:00.633667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:00.633667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:00.633667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:00.633667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:00.633667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:00.633667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:00.633667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:00.633667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:00.633667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:00.633667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:00.633667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:00.633667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:00.633667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:00.634654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:00.634654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:00.634654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:00.634654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:00.634654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:00.634654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:00.634654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:00.634654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:00.634654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:00.634654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:00.634654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:17:00.634654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:00.634654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 223/409] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:17:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:00.635444 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0366fab-b573-4127-8c41-a26657120a64 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:00.635444 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0366fab-b573-4127-8c41-a26657120a64 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:00.635444 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0366fab-b573-4127-8c41-a26657120a64 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:00.636899 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 224/410] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:00.637227 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3c53f-e8e5-400e-ac30-bd1a8b036e7d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:00.641504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0366fab-b573-4127-8c41-a26657120a64 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:00.673641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:00.681969 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54211e94-23a3-4916-9bbe-0347d21f774f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:00.683452 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54211e94-23a3-4916-9bbe-0347d21f774f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:00.683898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54211e94-23a3-4916-9bbe-0347d21f774f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:00.684503 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54211e94-23a3-4916-9bbe-0347d21f774f None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:00.686042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54211e94-23a3-4916-9bbe-0347d21f774f None admin] RBAC: Authorizing `identity:get_project(project_id=05e8dee797fd40d4bab1c7dd5c687e36)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:00.688888 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54211e94-23a3-4916-9bbe-0347d21f774f None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:00.691048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 187/411] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:17:00 2022] GET /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:00.692620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9da54-7cf6-4c34-bd26-9321439d5841 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:00.693599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9da54-7cf6-4c34-bd26-9321439d5841 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:00.694053 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9da54-7cf6-4c34-bd26-9321439d5841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:00.719826 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-4cd9da54-7cf6-4c34-bd26-9321439d5841 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:00.721580 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4cd9da54-7cf6-4c34-bd26-9321439d5841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:00.768432 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0366fab-b573-4127-8c41-a26657120a64 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:00.806170 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802f20e-2088-438d-8658-ec8a55df3f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:00.806850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802f20e-2088-438d-8658-ec8a55df3f38 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:00.807229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802f20e-2088-438d-8658-ec8a55df3f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:00.807614 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802f20e-2088-438d-8658-ec8a55df3f38 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:00.808419 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802f20e-2088-438d-8658-ec8a55df3f38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:00.808875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802f20e-2088-438d-8658-ec8a55df3f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:00.810461 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802f20e-2088-438d-8658-ec8a55df3f38 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:00.812441 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:00.820536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 188/412] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:00.822277 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9da54-7cf6-4c34-bd26-9321439d5841 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:00.827135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 225/413] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:17:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:00.828895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802f20e-2088-438d-8658-ec8a55df3f38 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:00.941534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9da54-7cf6-4c34-bd26-9321439d5841 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:00.973452 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:00.983674 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed6e34-f65a-46bf-8be2-793858da7f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:00.984727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed6e34-f65a-46bf-8be2-793858da7f6d None admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:00.985416 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed6e34-f65a-46bf-8be2-793858da7f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:00.990870 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed6e34-f65a-46bf-8be2-793858da7f6d None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36/groups/7082146cd7c44f1baf48b10a98514519/roles/f60b6d7b309a4537a233198456c7aa34` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:00.990870 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed6e34-f65a-46bf-8be2-793858da7f6d None admin] RBAC: Authorizing `identity:create_grant(project_id=05e8dee797fd40d4bab1c7dd5c687e36, group_id=7082146cd7c44f1baf48b10a98514519, role_id=f60b6d7b309a4537a233198456c7aa34)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:00.990870 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed6e34-f65a-46bf-8be2-793858da7f6d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:01.009084 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802f20e-2088-438d-8658-ec8a55df3f38 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:01.046616 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3860a-8220-499a-b9a0-44971c359cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:01.047633 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3860a-8220-499a-b9a0-44971c359cec None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:01.048084 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3860a-8220-499a-b9a0-44971c359cec None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:01.048553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3860a-8220-499a-b9a0-44971c359cec None admin] PATH_INFO: `/v3/groups/c939a1e7787e48dc831cd64404c5c5eb` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:01.049813 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3860a-8220-499a-b9a0-44971c359cec None admin] RBAC: Authorizing `identity:get_group(group_id=c939a1e7787e48dc831cd64404c5c5eb)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:01.051487 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3860a-8220-499a-b9a0-44971c359cec None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:01.053537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 226/414] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 27 16:17:00 2022] GET /identity/v3/groups/c939a1e7787e48dc831cd64404c5c5eb => generated 229 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:01.063154 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3860a-8220-499a-b9a0-44971c359cec None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:01.110435 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 189/415] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Sep 27 16:17:00 2022] PUT /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36/groups/7082146cd7c44f1baf48b10a98514519/roles/f60b6d7b309a4537a233198456c7aa34 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:17:01.112225 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed6e34-f65a-46bf-8be2-793858da7f6d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:01.161556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:01.244379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3860a-8220-499a-b9a0-44971c359cec None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:01.305565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85befa-4674-4853-b82d-d06bfc7a9f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:01.306201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85befa-4674-4853-b82d-d06bfc7a9f84 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:01.306480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85befa-4674-4853-b82d-d06bfc7a9f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:01.306749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85befa-4674-4853-b82d-d06bfc7a9f84 None admin] PATH_INFO: `/v3/projects/e4cc0d5ca9c1419e8012fd96a408e70a` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:01.308790 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85befa-4674-4853-b82d-d06bfc7a9f84 None admin] RBAC: Authorizing `identity:get_project(project_id=e4cc0d5ca9c1419e8012fd96a408e70a)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:01.310247 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85befa-4674-4853-b82d-d06bfc7a9f84 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:01.312749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 227/416] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:17:01 2022] GET /identity/v3/projects/e4cc0d5ca9c1419e8012fd96a408e70a => generated 344 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:01.319386 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85befa-4674-4853-b82d-d06bfc7a9f84 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:01.321553 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed6e34-f65a-46bf-8be2-793858da7f6d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:01.385066 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a576bbf-8ca6-4feb-80be-58f93ce7521f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:01.385725 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a576bbf-8ca6-4feb-80be-58f93ce7521f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:01.386079 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a576bbf-8ca6-4feb-80be-58f93ce7521f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:01.386362 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a576bbf-8ca6-4feb-80be-58f93ce7521f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:01.409782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a576bbf-8ca6-4feb-80be-58f93ce7521f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:01.422862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-7a576bbf-8ca6-4feb-80be-58f93ce7521f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:17:01.422862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:01.422862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:01.422862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:01.422862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:01.422862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:01.422862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:01.422862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:01.422862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:01.422862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:01.422862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:01.422862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:01.422862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:01.422862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:01.422862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:01.422862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:01.423878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:01.423878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:01.423878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:01.423878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:01.423878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:01.423878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:01.423878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:01.423878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:01.423878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:01.423878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:01.423878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:01.423878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:01.423878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:01.423878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:01.423878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:01.423878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:01.424763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:01.424763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:01.424763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:01.424763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:01.424763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:01.424763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:01.424763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:01.424763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:01.424763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:01.424763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:01.424763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:17:01.424763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:01.425366 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85befa-4674-4853-b82d-d06bfc7a9f84 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:01.425439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 190/417] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:17:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:01.430015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a576bbf-8ca6-4feb-80be-58f93ce7521f None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:01.458822 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:01.463207 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa394b3-dcec-497f-9a01-184e4accdafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:01.463889 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa394b3-dcec-497f-9a01-184e4accdafb None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:01.464224 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa394b3-dcec-497f-9a01-184e4accdafb None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:01.464538 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa394b3-dcec-497f-9a01-184e4accdafb None admin] PATH_INFO: `/v3/projects/e4cc0d5ca9c1419e8012fd96a408e70a/groups/c939a1e7787e48dc831cd64404c5c5eb/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:01.466688 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa394b3-dcec-497f-9a01-184e4accdafb None admin] RBAC: Authorizing `identity:create_grant(project_id=e4cc0d5ca9c1419e8012fd96a408e70a, group_id=c939a1e7787e48dc831cd64404c5c5eb, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:01.468372 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa394b3-dcec-497f-9a01-184e4accdafb None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:01.537178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:01.575661 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 228/418] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Sep 27 16:17:01 2022] PUT /identity/v3/projects/e4cc0d5ca9c1419e8012fd96a408e70a/groups/c939a1e7787e48dc831cd64404c5c5eb/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:17:01.598209 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a576bbf-8ca6-4feb-80be-58f93ce7521f None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:01.653651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7a40b-34b1-43c3-9abf-e122caf0ec99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:01.654421 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7a40b-34b1-43c3-9abf-e122caf0ec99 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:01.654704 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7a40b-34b1-43c3-9abf-e122caf0ec99 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:01.655033 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7a40b-34b1-43c3-9abf-e122caf0ec99 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:01.655780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7a40b-34b1-43c3-9abf-e122caf0ec99 None admin] RBAC: Adding query filter params (name=member) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:01.656089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7a40b-34b1-43c3-9abf-e122caf0ec99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:01.657506 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7a40b-34b1-43c3-9abf-e122caf0ec99 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:01.677104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 191/419] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:17:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:01.683034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa394b3-dcec-497f-9a01-184e4accdafb None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:01.881554 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa394b3-dcec-497f-9a01-184e4accdafb None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:01.962088 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1735a-873c-488f-aea1-a60c5ec3fdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:01.962700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1735a-873c-488f-aea1-a60c5ec3fdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:01.964367 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1735a-873c-488f-aea1-a60c5ec3fdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:01.964367 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1735a-873c-488f-aea1-a60c5ec3fdb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:02.076791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:02.085376 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1735a-873c-488f-aea1-a60c5ec3fdb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:02.086860 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1735a-873c-488f-aea1-a60c5ec3fdb7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:02.235176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 229/420] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:17:02.240581 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7a40b-34b1-43c3-9abf-e122caf0ec99 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:02.383259 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7a40b-34b1-43c3-9abf-e122caf0ec99 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:02.387230 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c769380-df8a-464c-82e9-4ccffd998e04 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:02.387637 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c769380-df8a-464c-82e9-4ccffd998e04 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:02.387806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c769380-df8a-464c-82e9-4ccffd998e04 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:02.389657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 230/421] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:02.399604 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:02.401665 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c35b5-0fc1-4608-a292-dc60579d8452 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:02.401952 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c35b5-0fc1-4608-a292-dc60579d8452 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:02.402232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c35b5-0fc1-4608-a292-dc60579d8452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:02.424791 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b461829-45d4-41dd-8ab5-9dec0c11c782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:02.425733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b461829-45d4-41dd-8ab5-9dec0c11c782 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:02.426238 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b461829-45d4-41dd-8ab5-9dec0c11c782 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:02.426706 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b461829-45d4-41dd-8ab5-9dec0c11c782 None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:02.428125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b461829-45d4-41dd-8ab5-9dec0c11c782 None admin] RBAC: Authorizing `identity:get_project(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:02.429888 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b461829-45d4-41dd-8ab5-9dec0c11c782 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:02.432218 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 192/422] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:17:02 2022] GET /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:02.438264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b461829-45d4-41dd-8ab5-9dec0c11c782 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:02.441357 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a37c35b5-0fc1-4608-a292-dc60579d8452 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:02.443103 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a37c35b5-0fc1-4608-a292-dc60579d8452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:02.547061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 231/423] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:02.559449 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b461829-45d4-41dd-8ab5-9dec0c11c782 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:02.607129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cca53-67e0-4474-ab41-18b950a65949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:02.608742 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cca53-67e0-4474-ab41-18b950a65949 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:02.609305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cca53-67e0-4474-ab41-18b950a65949 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:02.609788 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cca53-67e0-4474-ab41-18b950a65949 None admin] PATH_INFO: `/v3/groups/7082146cd7c44f1baf48b10a98514519` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:02.612807 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cca53-67e0-4474-ab41-18b950a65949 None admin] RBAC: Authorizing `identity:get_group(group_id=7082146cd7c44f1baf48b10a98514519)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:02.614498 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cca53-67e0-4474-ab41-18b950a65949 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:02.616670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 193/424] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 27 16:17:02 2022] GET /identity/v3/groups/7082146cd7c44f1baf48b10a98514519 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:02.622964 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c35b5-0fc1-4608-a292-dc60579d8452 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:02.672017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:02.770163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c35b5-0fc1-4608-a292-dc60579d8452 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:02.824181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c068ce-8553-4a93-8bc4-edfe08a1561e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:02.824844 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c068ce-8553-4a93-8bc4-edfe08a1561e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:02.825126 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c068ce-8553-4a93-8bc4-edfe08a1561e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:02.825396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c068ce-8553-4a93-8bc4-edfe08a1561e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:02.826214 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c068ce-8553-4a93-8bc4-edfe08a1561e None admin] RBAC: Adding query filter params (group.id=7082146cd7c44f1baf48b10a98514519, role.id=e7e5b03d7a3d404f841a8341244d5d78, scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:02.826524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c068ce-8553-4a93-8bc4-edfe08a1561e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:02.827999 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c068ce-8553-4a93-8bc4-edfe08a1561e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:02.834747 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 232/425] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 27 16:17:02 2022] GET /identity/v3/role_assignments?group.id=7082146cd7c44f1baf48b10a98514519&scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9&role.id=e7e5b03d7a3d404f841a8341244d5d78 => generated 611 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:02.839200 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cca53-67e0-4474-ab41-18b950a65949 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:02.919611 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:02.996470 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cca53-67e0-4474-ab41-18b950a65949 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:03.045067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef7178-0f43-47a9-9fed-74711bfb7307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:03.046075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef7178-0f43-47a9-9fed-74711bfb7307 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:03.046565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef7178-0f43-47a9-9fed-74711bfb7307 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:03.047036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef7178-0f43-47a9-9fed-74711bfb7307 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:03.061852 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef7178-0f43-47a9-9fed-74711bfb7307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:03.068081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-2cef7178-0f43-47a9-9fed-74711bfb7307 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:17:03.068081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:03.068081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:03.068081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:03.068081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:03.068081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:03.068081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:03.068081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:03.068081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:03.068081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:03.068081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:03.068081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:03.068081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:03.068081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:03.068081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:03.068081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:03.069017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:03.069017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:03.069017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:03.069017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:03.069017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:03.069017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:03.069017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:03.069017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:03.069017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:03.069017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:03.069017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:03.069017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:03.069017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:03.069017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:03.069017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:03.069017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:03.069832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:03.069832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:03.069832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:03.069832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:03.069832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:03.069832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:03.069832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:03.069832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:03.069832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:03.069832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:03.069832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:17:03.069832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:03.073584 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 194/426] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:17:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:03.079417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c068ce-8553-4a93-8bc4-edfe08a1561e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:03.174545 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:03.190460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c068ce-8553-4a93-8bc4-edfe08a1561e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:03.231246 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecfa32-46e1-4a4a-976e-5d20bfcf8616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:03.231868 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecfa32-46e1-4a4a-976e-5d20bfcf8616 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:03.232145 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecfa32-46e1-4a4a-976e-5d20bfcf8616 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:03.232491 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecfa32-46e1-4a4a-976e-5d20bfcf8616 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:03.233160 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ecfa32-46e1-4a4a-976e-5d20bfcf8616 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:03.233464 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ecfa32-46e1-4a4a-976e-5d20bfcf8616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:03.234835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ecfa32-46e1-4a4a-976e-5d20bfcf8616 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:03.243465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 233/427] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:03.249530 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef7178-0f43-47a9-9fed-74711bfb7307 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:03.371443 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef7178-0f43-47a9-9fed-74711bfb7307 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:03.379660 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:03.409354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d5f3a-3fb7-4870-9da9-ce70898edec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:03.410827 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d5f3a-3fb7-4870-9da9-ce70898edec5 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:03.411626 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d5f3a-3fb7-4870-9da9-ce70898edec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:03.411901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d5f3a-3fb7-4870-9da9-ce70898edec5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:03.444958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314b1b0-b4ae-49ee-a6a5-430a6a9cf79f None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:03.445907 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314b1b0-b4ae-49ee-a6a5-430a6a9cf79f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:03.446417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314b1b0-b4ae-49ee-a6a5-430a6a9cf79f None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:03.449442 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 234/428] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:03.455397 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d8e82-586c-4e09-9dc2-fcfddfe25cf5 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:03.455686 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d8e82-586c-4e09-9dc2-fcfddfe25cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:03.455969 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d8e82-586c-4e09-9dc2-fcfddfe25cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:03.482820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-0a6d8e82-586c-4e09-9dc2-fcfddfe25cf5 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:03.484038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0a6d8e82-586c-4e09-9dc2-fcfddfe25cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:03.491685 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d5f3a-3fb7-4870-9da9-ce70898edec5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:03.495304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d5f3a-3fb7-4870-9da9-ce70898edec5 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:03.577151 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 235/429] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:03.630014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 195/430] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:17:03.635533 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d8e82-586c-4e09-9dc2-fcfddfe25cf5 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:03.731037 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:03.753679 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d8e82-586c-4e09-9dc2-fcfddfe25cf5 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:03.792260 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78beacc9-3f61-4209-ad00-bb46e50ebb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:03.792976 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78beacc9-3f61-4209-ad00-bb46e50ebb33 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:03.793261 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78beacc9-3f61-4209-ad00-bb46e50ebb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:03.793535 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78beacc9-3f61-4209-ad00-bb46e50ebb33 None admin] PATH_INFO: `/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:03.794961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78beacc9-3f61-4209-ad00-bb46e50ebb33 None admin] RBAC: Authorizing `identity:get_project(project_id=6e8ba91c7b0e4cc189f0095ea9ee5df9)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:03.796446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78beacc9-3f61-4209-ad00-bb46e50ebb33 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:03.798484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 236/431] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:17:03 2022] GET /identity/v3/projects/6e8ba91c7b0e4cc189f0095ea9ee5df9 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:03.803933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d5f3a-3fb7-4870-9da9-ce70898edec5 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:03.812899 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:03.816660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2196dc-5bc3-4976-8d08-2ad16b104fd0 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:03.816939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2196dc-5bc3-4976-8d08-2ad16b104fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:03.817258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2196dc-5bc3-4976-8d08-2ad16b104fd0 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:03.818579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 237/432] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:03.824733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4320f0-7f7e-47d4-a1da-da9a130b773c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:03.824733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4320f0-7f7e-47d4-a1da-da9a130b773c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:03.824733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4320f0-7f7e-47d4-a1da-da9a130b773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:03.844525 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9a4320f0-7f7e-47d4-a1da-da9a130b773c None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:03.845720 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9a4320f0-7f7e-47d4-a1da-da9a130b773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:03.920611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 238/433] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:17:03.934109 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d5f3a-3fb7-4870-9da9-ce70898edec5 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:03.956434 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4320f0-7f7e-47d4-a1da-da9a130b773c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:03.976224 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd11338-c888-4660-939e-2589511258aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:03.977367 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd11338-c888-4660-939e-2589511258aa None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:03.977716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd11338-c888-4660-939e-2589511258aa None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:03.978066 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd11338-c888-4660-939e-2589511258aa None admin] PATH_INFO: `/v3/groups/7082146cd7c44f1baf48b10a98514519` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:03.979255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd11338-c888-4660-939e-2589511258aa None admin] RBAC: Authorizing `identity:get_group(group_id=7082146cd7c44f1baf48b10a98514519)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:03.981633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd11338-c888-4660-939e-2589511258aa None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:03.984530 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 196/434] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 27 16:17:03 2022] GET /identity/v3/groups/7082146cd7c44f1baf48b10a98514519 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:03.990085 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd11338-c888-4660-939e-2589511258aa None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:04.040489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:04.064549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4320f0-7f7e-47d4-a1da-da9a130b773c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:04.068265 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:04.096602 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd11338-c888-4660-939e-2589511258aa None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:04.100308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8ae32-e671-4561-b323-e588ace42667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:04.100995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8ae32-e671-4561-b323-e588ace42667 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:04.101270 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8ae32-e671-4561-b323-e588ace42667 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:04.101538 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8ae32-e671-4561-b323-e588ace42667 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:04.114026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8ae32-e671-4561-b323-e588ace42667 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:04.119070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-97a8ae32-e671-4561-b323-e588ace42667 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:17:04.119070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:04.119070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:04.119070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:04.119070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:04.119070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:04.119070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:04.119070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:04.119070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:04.119070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:04.119070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:04.119070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:04.119070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:04.119070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:04.119070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:04.119070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:04.120049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:04.120049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:04.120049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:04.120049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:04.120049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:04.120049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:04.120049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:04.120049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:04.120049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:04.120049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:04.120049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:04.120049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:04.120049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:04.120049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:04.120049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:04.120049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:04.120911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:04.120911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:04.120911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:04.120911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:04.120911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:04.120911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:04.120911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:04.120911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:04.120911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:04.120911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:04.120911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 16:17:04.120911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:04.120911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 239/435] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:17:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:04.128718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8ae32-e671-4561-b323-e588ace42667 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:04.141696 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6d168-c2fe-4f59-b612-f93e0920f359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:04.143038 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6d168-c2fe-4f59-b612-f93e0920f359 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:04.143491 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6d168-c2fe-4f59-b612-f93e0920f359 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:04.143902 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6d168-c2fe-4f59-b612-f93e0920f359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:04.145218 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6d168-c2fe-4f59-b612-f93e0920f359 None admin] RBAC: Adding query filter params (group.id=7082146cd7c44f1baf48b10a98514519, role.id=f60b6d7b309a4537a233198456c7aa34, scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:04.145935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6d168-c2fe-4f59-b612-f93e0920f359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:04.147797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6d168-c2fe-4f59-b612-f93e0920f359 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:04.157034 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 197/436] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 27 16:17:03 2022] GET /identity/v3/role_assignments?group.id=7082146cd7c44f1baf48b10a98514519&scope.project.id=6e8ba91c7b0e4cc189f0095ea9ee5df9&role.id=f60b6d7b309a4537a233198456c7aa34 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:04.198052 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6d168-c2fe-4f59-b612-f93e0920f359 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:04.248595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8ae32-e671-4561-b323-e588ace42667 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:04.286426 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78c084-2de2-490b-ad75-9a4c0138c0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:04.287440 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78c084-2de2-490b-ad75-9a4c0138c0ed None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:04.287932 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78c084-2de2-490b-ad75-9a4c0138c0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:04.288435 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78c084-2de2-490b-ad75-9a4c0138c0ed None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:04.289315 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78c084-2de2-490b-ad75-9a4c0138c0ed None admin] RBAC: Adding query filter params (name=member) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:04.289827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78c084-2de2-490b-ad75-9a4c0138c0ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:04.291485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78c084-2de2-490b-ad75-9a4c0138c0ed None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:04.295629 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:04.302655 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 240/437] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:17:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:04.304447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c8f9b-4e0c-40e0-a8ca-733a15704cfb None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:04.304791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c8f9b-4e0c-40e0-a8ca-733a15704cfb None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:04.305073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c8f9b-4e0c-40e0-a8ca-733a15704cfb None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:04.309136 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 241/438] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:04.309471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c8f9b-4e0c-40e0-a8ca-733a15704cfb None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:04.326280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6d168-c2fe-4f59-b612-f93e0920f359 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:04.367337 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26bea0-6862-4a02-b4d3-c897f68241cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:04.367885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26bea0-6862-4a02-b4d3-c897f68241cc None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:04.368221 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26bea0-6862-4a02-b4d3-c897f68241cc None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:04.368523 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26bea0-6862-4a02-b4d3-c897f68241cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:04.377253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:04.382653 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26bea0-6862-4a02-b4d3-c897f68241cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:04.387514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-0d26bea0-6862-4a02-b4d3-c897f68241cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:17:04.387514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:04.387514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:04.387514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:04.387514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:04.387514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:04.387514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:04.387514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:04.387514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:04.387514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:04.387514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:04.387514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:04.387514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:04.387514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:04.387514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:04.387514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:04.395176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:04.395176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:04.395176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:04.395176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:04.395176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:04.395176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:04.395176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:04.395176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:04.395176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:04.395176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:04.395176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:04.395176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:04.395176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:04.395176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:04.395176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:04.395176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:04.396179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:04.396179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:04.396179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:04.396179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:04.396179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:04.396179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:04.396179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:04.396179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:04.396179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:04.396179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:04.396179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:17:04.396179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:04.396179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 198/439] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:17:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:04.396179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3437436-6bfc-4ad9-b136-1fababe4617e None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:04.397050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3437436-6bfc-4ad9-b136-1fababe4617e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:04.397050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3437436-6bfc-4ad9-b136-1fababe4617e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:04.412876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-b3437436-6bfc-4ad9-b136-1fababe4617e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:04.414518 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b3437436-6bfc-4ad9-b136-1fababe4617e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:04.441562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c8f9b-4e0c-40e0-a8ca-733a15704cfb None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:04.484183 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1146a-7894-4ebf-a954-cf02f2fff55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:04.484827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1146a-7894-4ebf-a954-cf02f2fff55e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:04.485108 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1146a-7894-4ebf-a954-cf02f2fff55e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:04.485374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1146a-7894-4ebf-a954-cf02f2fff55e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:04.501642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 199/440] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:04.502584 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3437436-6bfc-4ad9-b136-1fababe4617e None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:04.562838 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:04.567846 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1146a-7894-4ebf-a954-cf02f2fff55e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:04.569553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1146a-7894-4ebf-a954-cf02f2fff55e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:04.627436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3437436-6bfc-4ad9-b136-1fababe4617e None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:04.655939 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:04.664180 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61a69f-4136-402e-9c7a-0686c7234149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:04.664866 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61a69f-4136-402e-9c7a-0686c7234149 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:04.667673 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61a69f-4136-402e-9c7a-0686c7234149 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:04.667673 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61a69f-4136-402e-9c7a-0686c7234149 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:04.667673 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61a69f-4136-402e-9c7a-0686c7234149 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:04.667673 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61a69f-4136-402e-9c7a-0686c7234149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:04.667931 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61a69f-4136-402e-9c7a-0686c7234149 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:04.681084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 200/441] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:04.681270 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 242/442] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:17:04.681401 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61a69f-4136-402e-9c7a-0686c7234149 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:04.682468 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1146a-7894-4ebf-a954-cf02f2fff55e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:04.778921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:04.783538 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1146a-7894-4ebf-a954-cf02f2fff55e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:04.805510 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61a69f-4136-402e-9c7a-0686c7234149 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:04.818245 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1478d2-767f-4249-bf6f-336febeca733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:04.819079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1478d2-767f-4249-bf6f-336febeca733 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:04.819387 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1478d2-767f-4249-bf6f-336febeca733 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:04.819662 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1478d2-767f-4249-bf6f-336febeca733 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:04.839232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea3d91-f86a-458c-8b00-f692fac29af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:04.839850 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea3d91-f86a-458c-8b00-f692fac29af7 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:04.840128 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea3d91-f86a-458c-8b00-f692fac29af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:04.840426 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea3d91-f86a-458c-8b00-f692fac29af7 None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:04.841541 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea3d91-f86a-458c-8b00-f692fac29af7 None admin] RBAC: Authorizing `identity:get_project(project_id=05e8dee797fd40d4bab1c7dd5c687e36)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:04.843546 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea3d91-f86a-458c-8b00-f692fac29af7 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:04.845191 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 201/443] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:17:04 2022] GET /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:04.845963 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea3d91-f86a-458c-8b00-f692fac29af7 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:04.885720 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1478d2-767f-4249-bf6f-336febeca733 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:04.887104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1478d2-767f-4249-bf6f-336febeca733 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:04.901465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:04.941599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea3d91-f86a-458c-8b00-f692fac29af7 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:04.975430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f762114-9011-411f-a30d-93288f4bc55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:04.976046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f762114-9011-411f-a30d-93288f4bc55e None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:04.976324 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f762114-9011-411f-a30d-93288f4bc55e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:04.976622 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f762114-9011-411f-a30d-93288f4bc55e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:04.979393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:04.984578 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 243/444] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:17:04.985378 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1478d2-767f-4249-bf6f-336febeca733 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:04.987364 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f762114-9011-411f-a30d-93288f4bc55e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:04.992538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-6f762114-9011-411f-a30d-93288f4bc55e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:17:04.992538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:04.992538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:04.992538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:04.992538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:04.992538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:04.992538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:04.992538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:04.992538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:04.992538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:04.992538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:04.992538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:04.992538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:04.992538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:04.992538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:04.992538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:04.994558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:04.994558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:04.994558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:04.994558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:04.994558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:04.994558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:04.994558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:04.994558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:04.994558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:04.994558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:04.994558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:04.994558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:04.994558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:04.994558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:04.994558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:04.994558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:04.995420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:04.995420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:04.995420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:04.995420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:04.995420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:04.995420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:04.995420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:04.995420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:04.995420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:04.995420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:04.995420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:17:04.995420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:04.995420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 202/445] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:17:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:04.995420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f762114-9011-411f-a30d-93288f4bc55e None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:05.083802 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1478d2-767f-4249-bf6f-336febeca733 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:05.090585 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f762114-9011-411f-a30d-93288f4bc55e None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:05.107198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:05.116687 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3236149-f07e-402e-9895-e8d9653a6ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:05.117312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3236149-f07e-402e-9895-e8d9653a6ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:05.117590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3236149-f07e-402e-9895-e8d9653a6ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:05.119824 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3236149-f07e-402e-9895-e8d9653a6ec4 None admin] PATH_INFO: `/v3/groups/7082146cd7c44f1baf48b10a98514519` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:05.119824 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3236149-f07e-402e-9895-e8d9653a6ec4 None admin] RBAC: Authorizing `identity:get_group(group_id=7082146cd7c44f1baf48b10a98514519)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:05.120486 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3236149-f07e-402e-9895-e8d9653a6ec4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:05.122028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 244/446] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 27 16:17:04 2022] GET /identity/v3/groups/7082146cd7c44f1baf48b10a98514519 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:05.123296 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3236149-f07e-402e-9895-e8d9653a6ec4 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:05.123464 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114578aa-2e34-480a-af3a-574711400a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:05.124031 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114578aa-2e34-480a-af3a-574711400a93 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:05.124308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114578aa-2e34-480a-af3a-574711400a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:05.124650 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114578aa-2e34-480a-af3a-574711400a93 None admin] PATH_INFO: `/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:05.125753 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114578aa-2e34-480a-af3a-574711400a93 None admin] RBAC: Authorizing `identity:get_project(project_id=05e8dee797fd40d4bab1c7dd5c687e36)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:05.127181 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114578aa-2e34-480a-af3a-574711400a93 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:05.132377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 203/447] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:17:04 2022] GET /identity/v3/projects/05e8dee797fd40d4bab1c7dd5c687e36 => generated 302 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:05.132377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114578aa-2e34-480a-af3a-574711400a93 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:05.192213 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:05.226655 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3236149-f07e-402e-9895-e8d9653a6ec4 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:05.227206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114578aa-2e34-480a-af3a-574711400a93 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:05.260995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bc332-0a87-442d-aa08-2b2849868238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:05.261162 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24af96c-c1bd-462e-ab30-169703274080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:05.261591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bc332-0a87-442d-aa08-2b2849868238 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:05.261735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24af96c-c1bd-462e-ab30-169703274080 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:05.261869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bc332-0a87-442d-aa08-2b2849868238 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:05.262011 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24af96c-c1bd-462e-ab30-169703274080 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:05.262141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bc332-0a87-442d-aa08-2b2849868238 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:05.262282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24af96c-c1bd-462e-ab30-169703274080 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:05.262852 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bc332-0a87-442d-aa08-2b2849868238 None admin] RBAC: Adding query filter params (group.id=7082146cd7c44f1baf48b10a98514519, role.id=e7e5b03d7a3d404f841a8341244d5d78, scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:05.262950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24af96c-c1bd-462e-ab30-169703274080 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:05.263158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bc332-0a87-442d-aa08-2b2849868238 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:05.263252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24af96c-c1bd-462e-ab30-169703274080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:05.264634 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24af96c-c1bd-462e-ab30-169703274080 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:05.264724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bc332-0a87-442d-aa08-2b2849868238 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:05.270112 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 204/448] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 27 16:17:05 2022] GET /identity/v3/role_assignments?group.id=7082146cd7c44f1baf48b10a98514519&scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36&role.id=e7e5b03d7a3d404f841a8341244d5d78 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:05.270879 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bc332-0a87-442d-aa08-2b2849868238 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:05.277073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 245/449] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:17:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:05.278871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24af96c-c1bd-462e-ab30-169703274080 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:05.331199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:05.388329 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bc332-0a87-442d-aa08-2b2849868238 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:05.393418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24af96c-c1bd-462e-ab30-169703274080 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:05.422742 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:05.426857 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a82a4-2452-4d66-ac1d-f34699e59d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:05.427546 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a82a4-2452-4d66-ac1d-f34699e59d71 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:05.427827 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a82a4-2452-4d66-ac1d-f34699e59d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:05.428168 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a82a4-2452-4d66-ac1d-f34699e59d71 None admin] PATH_INFO: `/v3/groups/7082146cd7c44f1baf48b10a98514519` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:05.429525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a82a4-2452-4d66-ac1d-f34699e59d71 None admin] RBAC: Authorizing `identity:get_group(group_id=7082146cd7c44f1baf48b10a98514519)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:05.431195 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a82a4-2452-4d66-ac1d-f34699e59d71 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:05.431712 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cf838-4f27-4464-b6e5-e22cde840f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:05.432380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cf838-4f27-4464-b6e5-e22cde840f4d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:05.432663 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cf838-4f27-4464-b6e5-e22cde840f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:05.433207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 205/450] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 27 16:17:05 2022] GET /identity/v3/groups/7082146cd7c44f1baf48b10a98514519 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:05.436140 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cf838-4f27-4464-b6e5-e22cde840f4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:05.439672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a82a4-2452-4d66-ac1d-f34699e59d71 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:05.525530 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cf838-4f27-4464-b6e5-e22cde840f4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:05.526988 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cf838-4f27-4464-b6e5-e22cde840f4d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:05.560910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a82a4-2452-4d66-ac1d-f34699e59d71 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:05.579788 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:05.600833 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa5b6c-962e-455c-aaf2-0522c7502928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:05.601423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa5b6c-962e-455c-aaf2-0522c7502928 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:05.601699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa5b6c-962e-455c-aaf2-0522c7502928 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:05.601970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa5b6c-962e-455c-aaf2-0522c7502928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:05.602684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa5b6c-962e-455c-aaf2-0522c7502928 None admin] RBAC: Adding query filter params (group.id=7082146cd7c44f1baf48b10a98514519, role.id=f60b6d7b309a4537a233198456c7aa34, scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:05.602988 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa5b6c-962e-455c-aaf2-0522c7502928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:05.604431 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa5b6c-962e-455c-aaf2-0522c7502928 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:05.611098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 206/451] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 27 16:17:05 2022] GET /identity/v3/role_assignments?group.id=7082146cd7c44f1baf48b10a98514519&scope.project.id=05e8dee797fd40d4bab1c7dd5c687e36&role.id=f60b6d7b309a4537a233198456c7aa34 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:05.645951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 246/452] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 16:17:05.651867 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa5b6c-962e-455c-aaf2-0522c7502928 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:05.757884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa5b6c-962e-455c-aaf2-0522c7502928 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:05.798984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445db37-40ea-430b-a2bc-3121cb40bb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:05.799618 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445db37-40ea-430b-a2bc-3121cb40bb7d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:05.799896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445db37-40ea-430b-a2bc-3121cb40bb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:05.800169 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445db37-40ea-430b-a2bc-3121cb40bb7d None admin] PATH_INFO: `/v3/projects/e4cc0d5ca9c1419e8012fd96a408e70a` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:05.801312 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445db37-40ea-430b-a2bc-3121cb40bb7d None admin] RBAC: Authorizing `identity:get_project(project_id=e4cc0d5ca9c1419e8012fd96a408e70a)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:05.802755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445db37-40ea-430b-a2bc-3121cb40bb7d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:05.804709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 207/453] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:17:05 2022] GET /identity/v3/projects/e4cc0d5ca9c1419e8012fd96a408e70a => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:05.809933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cf838-4f27-4464-b6e5-e22cde840f4d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:05.837593 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:05.910378 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cf838-4f27-4464-b6e5-e22cde840f4d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:05.944721 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bfb47-8a79-4507-84c8-69def6447c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:05.945350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bfb47-8a79-4507-84c8-69def6447c3a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:05.945631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bfb47-8a79-4507-84c8-69def6447c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:05.945909 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bfb47-8a79-4507-84c8-69def6447c3a None admin] PATH_INFO: `/v3/groups/c939a1e7787e48dc831cd64404c5c5eb` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:05.947017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0bfb47-8a79-4507-84c8-69def6447c3a None admin] RBAC: Authorizing `identity:get_group(group_id=c939a1e7787e48dc831cd64404c5c5eb)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:05.948504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0bfb47-8a79-4507-84c8-69def6447c3a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:05.950080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 247/454] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 27 16:17:05 2022] GET /identity/v3/groups/c939a1e7787e48dc831cd64404c5c5eb => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:05.956767 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445db37-40ea-430b-a2bc-3121cb40bb7d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:06.007628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:06.057130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445db37-40ea-430b-a2bc-3121cb40bb7d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:06.089067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af53f55-829a-4ebc-adf4-5796fb5db3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:06.089660 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af53f55-829a-4ebc-adf4-5796fb5db3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:06.089940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af53f55-829a-4ebc-adf4-5796fb5db3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:06.090215 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af53f55-829a-4ebc-adf4-5796fb5db3b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:06.090930 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af53f55-829a-4ebc-adf4-5796fb5db3b3 None admin] RBAC: Adding query filter params (group.id=c939a1e7787e48dc831cd64404c5c5eb, role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.project.id=e4cc0d5ca9c1419e8012fd96a408e70a) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:06.091242 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af53f55-829a-4ebc-adf4-5796fb5db3b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:06.093338 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af53f55-829a-4ebc-adf4-5796fb5db3b3 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:06.098873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 208/455] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 27 16:17:05 2022] GET /identity/v3/role_assignments?group.id=c939a1e7787e48dc831cd64404c5c5eb&scope.project.id=e4cc0d5ca9c1419e8012fd96a408e70a&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:08.628149 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05222af3-6f56-4d6b-974d-82e35e2c0ea8 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:08.628716 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05222af3-6f56-4d6b-974d-82e35e2c0ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:08.628716 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05222af3-6f56-4d6b-974d-82e35e2c0ea8 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:08.630292 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 248/456] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:08.635620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e64b70-951b-4b37-b0fa-21ee0a514fd0 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:08.636009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e64b70-951b-4b37-b0fa-21ee0a514fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:08.636212 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e64b70-951b-4b37-b0fa-21ee0a514fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:08.661315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-75e64b70-951b-4b37-b0fa-21ee0a514fd0 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:08.662601 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-75e64b70-951b-4b37-b0fa-21ee0a514fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:08.751686 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 209/457] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:09.051805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba9acf-3c3a-4e17-bf73-a60e0ae2f8bd None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:09.052204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba9acf-3c3a-4e17-bf73-a60e0ae2f8bd None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:09.052405 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba9acf-3c3a-4e17-bf73-a60e0ae2f8bd None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:09.053723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 249/458] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:09.059055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d1fbf-8d5f-40a7-8691-ea884d2980a4 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:09.059343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d1fbf-8d5f-40a7-8691-ea884d2980a4 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:09.059644 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d1fbf-8d5f-40a7-8691-ea884d2980a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:09.085290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-902d1fbf-8d5f-40a7-8691-ea884d2980a4 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:09.086556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-902d1fbf-8d5f-40a7-8691-ea884d2980a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:09.143893 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:09.186701 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 210/459] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:09.220703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba9acf-3c3a-4e17-bf73-a60e0ae2f8bd None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:09.297688 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0746c2-4bdb-4e3a-a5a0-cc0f482e0fb0 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:09.298319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0746c2-4bdb-4e3a-a5a0-cc0f482e0fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:09.298871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0746c2-4bdb-4e3a-a5a0-cc0f482e0fb0 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:09.300648 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 211/460] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:09.306307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce599c7-98e4-4519-a8cd-e3291c8e8051 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:09.306526 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce599c7-98e4-4519-a8cd-e3291c8e8051 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:09.306796 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce599c7-98e4-4519-a8cd-e3291c8e8051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:09.328783 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:09.342524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-3ce599c7-98e4-4519-a8cd-e3291c8e8051 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:09.343714 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3ce599c7-98e4-4519-a8cd-e3291c8e8051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:09.346595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba9acf-3c3a-4e17-bf73-a60e0ae2f8bd None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:09.410002 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f332c-abc2-4835-a705-0eb183f7a24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:09.410637 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f332c-abc2-4835-a705-0eb183f7a24d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:09.410918 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f332c-abc2-4835-a705-0eb183f7a24d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:09.411824 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f332c-abc2-4835-a705-0eb183f7a24d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:09.423676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f332c-abc2-4835-a705-0eb183f7a24d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:09.425272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f332c-abc2-4835-a705-0eb183f7a24d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:09.443455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-7c1f332c-abc2-4835-a705-0eb183f7a24d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:09.443455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:09.443455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:09.443455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:09.443455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:09.443455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:09.443455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:09.443455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:09.443455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:09.443455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:09.443455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:09.443455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:09.443455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:09.443455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:09.443455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:09.443455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:09.444427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:09.444427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:09.444427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:09.444427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:09.444427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:09.444427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:09.444427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:09.444427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:09.444427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:09.444427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:09.444427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:09.444427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:09.444427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:09.444427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:09.444427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:09.444427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:09.444427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:09.445314 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:09.445314 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:09.445314 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:09.445314 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 250/461] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:09.447048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff345cce-b311-40e1-bf90-a333e4ff0b78 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:09.447337 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff345cce-b311-40e1-bf90-a333e4ff0b78 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:09.447613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff345cce-b311-40e1-bf90-a333e4ff0b78 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:09.449019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 251/462] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:09.449920 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 212/463] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:09.457807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23d2b7-d344-45d7-8fbf-dbe84aa7ed04 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:09.458099 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23d2b7-d344-45d7-8fbf-dbe84aa7ed04 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:09.458379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23d2b7-d344-45d7-8fbf-dbe84aa7ed04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:09.461365 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce599c7-98e4-4519-a8cd-e3291c8e8051 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:09.486621 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-0f23d2b7-d344-45d7-8fbf-dbe84aa7ed04 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:09.487814 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0f23d2b7-d344-45d7-8fbf-dbe84aa7ed04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:09.580493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 252/464] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:09.582377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23d2b7-d344-45d7-8fbf-dbe84aa7ed04 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:09.598435 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce599c7-98e4-4519-a8cd-e3291c8e8051 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:09.606161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:09.667188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ab86c-1732-4eb4-bff5-48512907856a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:09.668610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ab86c-1732-4eb4-bff5-48512907856a None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:09.669361 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ab86c-1732-4eb4-bff5-48512907856a None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:09.669869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ab86c-1732-4eb4-bff5-48512907856a None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:09.670769 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ab86c-1732-4eb4-bff5-48512907856a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:09.671285 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ab86c-1732-4eb4-bff5-48512907856a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:09.672899 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ab86c-1732-4eb4-bff5-48512907856a None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:09.712461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 213/465] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:09.713665 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ab86c-1732-4eb4-bff5-48512907856a None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:09.735427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:09.766955 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23d2b7-d344-45d7-8fbf-dbe84aa7ed04 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:09.822794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0a4a0-c80a-4cd2-9798-61665fc1c3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:09.823433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0a4a0-c80a-4cd2-9798-61665fc1c3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:09.823714 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0a4a0-c80a-4cd2-9798-61665fc1c3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:09.823990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0a4a0-c80a-4cd2-9798-61665fc1c3e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:09.836958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0a4a0-c80a-4cd2-9798-61665fc1c3e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:09.838636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0a4a0-c80a-4cd2-9798-61665fc1c3e4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:09.842590 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ab86c-1732-4eb4-bff5-48512907856a None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:09.858130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-c5c0a4a0-c80a-4cd2-9798-61665fc1c3e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:09.858130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:09.858130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:09.858130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:09.858130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:09.858130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:09.858130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:09.858130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:09.858130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:09.858130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:09.858130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:09.858130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:09.858130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:09.858130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:09.858130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:09.858130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:09.859117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:09.859117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:09.859117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:09.859117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:09.859117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:09.859117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:09.859117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:09.859117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:09.859117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:09.859117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:09.859117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:09.859117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:09.859117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:09.859117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:09.859117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:09.859117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:09.859117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:09.859989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:09.859989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:09.859989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:09.859989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 253/466] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:09.860207 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0a4a0-c80a-4cd2-9798-61665fc1c3e4 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:09.882387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7164e5-a8ed-4866-a9bf-5e5860d2adf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:09.883149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7164e5-a8ed-4866-a9bf-5e5860d2adf9 None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:09.883581 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7164e5-a8ed-4866-a9bf-5e5860d2adf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:09.883974 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7164e5-a8ed-4866-a9bf-5e5860d2adf9 None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:09.884769 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7164e5-a8ed-4866-a9bf-5e5860d2adf9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:09.886366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7164e5-a8ed-4866-a9bf-5e5860d2adf9 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:09.965215 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0a4a0-c80a-4cd2-9798-61665fc1c3e4 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:09.993358 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:10.000101 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd062fd1-87e4-42fa-880e-3a0e03917e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:10.000760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd062fd1-87e4-42fa-880e-3a0e03917e5f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:10.001041 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd062fd1-87e4-42fa-880e-3a0e03917e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:10.001327 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd062fd1-87e4-42fa-880e-3a0e03917e5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:10.010134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 214/467] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 27 16:17:09 2022] POST /identity/v3/users => generated 246 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:17:10.011235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7164e5-a8ed-4866-a9bf-5e5860d2adf9 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:10.013794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd062fd1-87e4-42fa-880e-3a0e03917e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:10.015344 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd062fd1-87e4-42fa-880e-3a0e03917e5f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:10.031512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-cd062fd1-87e4-42fa-880e-3a0e03917e5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:10.031512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:10.031512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:10.031512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:10.031512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:10.031512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:10.031512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:10.031512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:10.031512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:10.031512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:10.031512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:10.031512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:10.031512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:10.031512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:10.031512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:10.031512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:10.039325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:10.039325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:10.039325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:10.039325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:10.039325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:10.039325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:10.039325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:10.039325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:10.039325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:10.039325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:10.039325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:10.039325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:10.039325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:10.039325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:10.039325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:10.039325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:10.039325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:10.040209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:10.040209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:10.040209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:10.040209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 254/468] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:10.040209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd062fd1-87e4-42fa-880e-3a0e03917e5f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:10.074695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:10.179382 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd062fd1-87e4-42fa-880e-3a0e03917e5f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:10.182327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7164e5-a8ed-4866-a9bf-5e5860d2adf9 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:10.218460 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06006c4-d8f3-41b4-b1ee-ac3e1bf6c94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:10.219123 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06006c4-d8f3-41b4-b1ee-ac3e1bf6c94c None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:10.219412 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06006c4-d8f3-41b4-b1ee-ac3e1bf6c94c None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:10.219689 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06006c4-d8f3-41b4-b1ee-ac3e1bf6c94c None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:10.220354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06006c4-d8f3-41b4-b1ee-ac3e1bf6c94c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:10.220701 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06006c4-d8f3-41b4-b1ee-ac3e1bf6c94c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:10.221571 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7b5c0-46f6-4897-8589-179def3c2866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:10.222105 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06006c4-d8f3-41b4-b1ee-ac3e1bf6c94c None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:10.222233 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7b5c0-46f6-4897-8589-179def3c2866 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:10.222459 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7b5c0-46f6-4897-8589-179def3c2866 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:10.222735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7b5c0-46f6-4897-8589-179def3c2866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:10.235104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7b5c0-46f6-4897-8589-179def3c2866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:10.235263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 215/469] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:10.236312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7b5c0-46f6-4897-8589-179def3c2866 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:10.236522 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06006c4-d8f3-41b4-b1ee-ac3e1bf6c94c None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:10.253236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-5fc7b5c0-46f6-4897-8589-179def3c2866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:10.253236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:10.253236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:10.253236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:10.253236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:10.253236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:10.253236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:10.253236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:10.253236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:10.253236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:10.253236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:10.253236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:10.253236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:10.253236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:10.253236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:10.253236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:10.254208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:10.254208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:10.254208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:10.254208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:10.254208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:10.254208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:10.254208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:10.254208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:10.254208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:10.254208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:10.254208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:10.254208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:10.254208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:10.254208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:10.254208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:10.254208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:10.254208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:10.255066 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:10.255066 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:10.255066 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:10.255066 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 255/470] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:10.256166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26228d2-3ae8-4a4a-af32-139cd729826d None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:10.256166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26228d2-3ae8-4a4a-af32-139cd729826d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:10.256166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26228d2-3ae8-4a4a-af32-139cd729826d None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:10.257661 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 256/471] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:10.258129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26228d2-3ae8-4a4a-af32-139cd729826d None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:10.294407 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:10.331585 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:10.350985 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06006c4-d8f3-41b4-b1ee-ac3e1bf6c94c None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:10.368388 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26228d2-3ae8-4a4a-af32-139cd729826d None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:10.386974 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddaabb2-4d12-41a8-ae2e-87779f0c69e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:10.387577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddaabb2-4d12-41a8-ae2e-87779f0c69e7 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:10.387852 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddaabb2-4d12-41a8-ae2e-87779f0c69e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:10.388119 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddaabb2-4d12-41a8-ae2e-87779f0c69e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:10.388800 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddaabb2-4d12-41a8-ae2e-87779f0c69e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:10.389100 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddaabb2-4d12-41a8-ae2e-87779f0c69e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:10.390476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddaabb2-4d12-41a8-ae2e-87779f0c69e7 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:10.402329 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 216/472] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:10.403350 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddaabb2-4d12-41a8-ae2e-87779f0c69e7 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:10.467368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b89fb5-2327-41eb-bd7c-af182ef3106d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:10.468001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b89fb5-2327-41eb-bd7c-af182ef3106d None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:10.468431 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b89fb5-2327-41eb-bd7c-af182ef3106d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:10.468706 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b89fb5-2327-41eb-bd7c-af182ef3106d None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:10.469414 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b89fb5-2327-41eb-bd7c-af182ef3106d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:10.470903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b89fb5-2327-41eb-bd7c-af182ef3106d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:10.504668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddaabb2-4d12-41a8-ae2e-87779f0c69e7 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:10.538521 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdbcaf-63e7-47bd-b53f-2ee56086827d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:10.539121 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdbcaf-63e7-47bd-b53f-2ee56086827d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:10.539400 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdbcaf-63e7-47bd-b53f-2ee56086827d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:10.539672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdbcaf-63e7-47bd-b53f-2ee56086827d None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:10.540306 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdbcaf-63e7-47bd-b53f-2ee56086827d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:10.540636 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdbcaf-63e7-47bd-b53f-2ee56086827d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:10.542013 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdbcaf-63e7-47bd-b53f-2ee56086827d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:10.545420 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 257/473] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 27 16:17:10 2022] POST /identity/v3/users => generated 248 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:17:10.546837 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ab5da-6740-4ac6-a1dd-be8fbf8aa5cf None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:10.547284 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ab5da-6740-4ac6-a1dd-be8fbf8aa5cf None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:10.547960 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ab5da-6740-4ac6-a1dd-be8fbf8aa5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:10.552258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:10.559757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 217/474] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:10.559757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdbcaf-63e7-47bd-b53f-2ee56086827d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:10.594885 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-0b2ab5da-6740-4ac6-a1dd-be8fbf8aa5cf None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:10.596850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0b2ab5da-6740-4ac6-a1dd-be8fbf8aa5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:10.678318 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdbcaf-63e7-47bd-b53f-2ee56086827d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:10.685252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 258/475] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:10.686281 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ab5da-6740-4ac6-a1dd-be8fbf8aa5cf None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:10.712909 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:10.728622 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ad954-54c5-4f8e-9f32-fa2f14f2fa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:10.730324 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ad954-54c5-4f8e-9f32-fa2f14f2fa54 None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:10.730751 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ad954-54c5-4f8e-9f32-fa2f14f2fa54 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:10.731190 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ad954-54c5-4f8e-9f32-fa2f14f2fa54 None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:10.732615 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ad954-54c5-4f8e-9f32-fa2f14f2fa54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:10.734283 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ad954-54c5-4f8e-9f32-fa2f14f2fa54 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:10.805904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ab5da-6740-4ac6-a1dd-be8fbf8aa5cf None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:10.846780 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76027be2-d4b3-41b4-939c-dc1ea2a24610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:10.847391 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76027be2-d4b3-41b4-939c-dc1ea2a24610 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:10.847673 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76027be2-d4b3-41b4-939c-dc1ea2a24610 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:10.849717 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76027be2-d4b3-41b4-939c-dc1ea2a24610 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:10.849717 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76027be2-d4b3-41b4-939c-dc1ea2a24610 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:10.851154 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76027be2-d4b3-41b4-939c-dc1ea2a24610 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:10.872384 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 218/476] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 27 16:17:10 2022] POST /identity/v3/users => generated 248 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:17:10.955056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 259/477] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 27 16:17:10 2022] POST /identity/v3/users => generated 249 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:17:11.038645 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ad954-54c5-4f8e-9f32-fa2f14f2fa54 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:11.115449 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:11.171888 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ad954-54c5-4f8e-9f32-fa2f14f2fa54 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:11.210445 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb66ad8-5232-4993-8883-e5b2c45361f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:11.211063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb66ad8-5232-4993-8883-e5b2c45361f9 None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:11.211343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb66ad8-5232-4993-8883-e5b2c45361f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:11.211616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb66ad8-5232-4993-8883-e5b2c45361f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:11.212298 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb66ad8-5232-4993-8883-e5b2c45361f9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:11.213725 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb66ad8-5232-4993-8883-e5b2c45361f9 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:11.251672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.sql.core [None req-bbb66ad8-5232-4993-8883-e5b2c45361f9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 27 16:17:11.251672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 27 16:17:11.251672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [parameters: {'id': '5dcfbd2eb1d84f9cbec3ad746cd3cf71', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 27 16:17:11.251672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81630) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 27 16:17:11.268035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-bbb66ad8-5232-4993-8883-e5b2c45361f9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 27 16:17:11.268035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:11.268035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 16:17:11.268035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 16:17:11.268035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 16:17:11.268035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 16:17:11.268035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 16:17:11.268035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 16:17:11.268035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 16:17:11.268035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application conn.query(q) Sep 27 16:17:11.268035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 16:17:11.268035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 16:17:11.268035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 16:17:11.268035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application result.read() Sep 27 16:17:11.268035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 16:17:11.269173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 16:17:11.269173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 16:17:11.269173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 16:17:11.269173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 16:17:11.269173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 16:17:11.269173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 16:17:11.269173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 16:17:11.269173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 27 16:17:11.269173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:11.269173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 27 16:17:11.269173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:11.269173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:11.269173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 27 16:17:11.269173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 27 16:17:11.269173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 27 16:17:11.269173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return ref.to_dict() Sep 27 16:17:11.269173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 16:17:11.269173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application next(self.gen) Sep 27 16:17:11.270151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 27 16:17:11.270151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application yield resource Sep 27 16:17:11.270151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 16:17:11.270151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application next(self.gen) Sep 27 16:17:11.270151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 27 16:17:11.270151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self.session.rollback() Sep 27 16:17:11.270151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 16:17:11.270151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self.force_reraise() Sep 27 16:17:11.270151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 16:17:11.270151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise self.value Sep 27 16:17:11.270151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 27 16:17:11.270151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 27 16:17:11.270151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 27 16:17:11.270151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application session.commit() Sep 27 16:17:11.270151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 27 16:17:11.270151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 27 16:17:11.270151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 27 16:17:11.271003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._prepare_impl() Sep 27 16:17:11.271003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 27 16:17:11.271003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self.session.flush() Sep 27 16:17:11.271003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 27 16:17:11.271003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._flush(objects) Sep 27 16:17:11.271003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 27 16:17:11.271003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 27 16:17:11.271003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 27 16:17:11.271003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application compat.raise_( Sep 27 16:17:11.271003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 16:17:11.271003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception Sep 27 16:17:11.271003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 27 16:17:11.271003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application flush_context.execute() Sep 27 16:17:11.271003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 27 16:17:11.271003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rec.execute(self) Sep 27 16:17:11.271003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 27 16:17:11.271003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 27 16:17:11.271869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 27 16:17:11.271869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 27 16:17:11.271869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 27 16:17:11.271869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 27 16:17:11.271869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 27 16:17:11.271869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 27 16:17:11.271869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 27 16:17:11.271869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 27 16:17:11.271869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 27 16:17:11.271869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 27 16:17:11.271869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 27 16:17:11.271869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 27 16:17:11.271869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 27 16:17:11.271869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 27 16:17:11.271869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 16:17:11.271869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception Sep 27 16:17:11.272754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 16:17:11.272754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 16:17:11.272754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 16:17:11.272754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 16:17:11.272754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 16:17:11.272754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 16:17:11.272754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 16:17:11.272754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application conn.query(q) Sep 27 16:17:11.272754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 16:17:11.272754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 16:17:11.272754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 16:17:11.272754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application result.read() Sep 27 16:17:11.272754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 16:17:11.272754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 16:17:11.272754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 16:17:11.272754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 16:17:11.273561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 16:17:11.273561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 16:17:11.273561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 16:17:11.273561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 16:17:11.273561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 27 16:17:11.273561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 27 16:17:11.273561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [parameters: {'id': '5dcfbd2eb1d84f9cbec3ad746cd3cf71', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 27 16:17:11.273561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 27 16:17:11.273561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:11.273561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:17:11.273561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:11.273561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:11.273561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:11.273561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:11.273561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:11.273561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:11.275490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:11.275490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:11.275490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:11.275490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:11.275490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:11.275490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:11.275490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 27 16:17:11.275490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 27 16:17:11.275490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:11.275490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:11.275490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 27 16:17:11.275490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 27 16:17:11.275490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 27 16:17:11.275490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 27 16:17:11.275490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 27 16:17:11.275490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:11.276545 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 219/478] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Sep 27 16:17:11 2022] POST /identity/v3/roles => generated 144 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:11.276623 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76027be2-d4b3-41b4-939c-dc1ea2a24610 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:11.366628 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:11.391194 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76027be2-d4b3-41b4-939c-dc1ea2a24610 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:11.428568 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c9279-82c8-429f-82f8-ecd3f4aeaf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:11.429209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c9279-82c8-429f-82f8-ecd3f4aeaf28 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:11.429487 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c9279-82c8-429f-82f8-ecd3f4aeaf28 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:11.429752 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c9279-82c8-429f-82f8-ecd3f4aeaf28 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:11.442200 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c9279-82c8-429f-82f8-ecd3f4aeaf28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:11.447469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-438c9279-82c8-429f-82f8-ecd3f4aeaf28 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:17:11.447469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:11.447469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:11.447469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:11.447469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:11.447469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:11.447469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:11.447469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:11.447469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:11.447469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:11.447469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:11.447469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:11.447469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:11.447469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:11.447469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:11.447469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:11.449625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:11.449625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:11.449625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:11.449625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:11.449625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:11.449625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:11.449625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:11.449625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:11.449625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:11.449625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:11.449625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:11.449625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:11.449625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:11.449625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:11.449625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:11.449625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:11.450612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:11.450612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:11.450612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:11.450612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:11.450612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:11.450612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:11.450612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:11.450612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:11.450612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:11.450612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:11.450612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 16:17:11.450612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:11.450612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 260/479] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:17:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:11.457639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb66ad8-5232-4993-8883-e5b2c45361f9 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:11.601811 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb66ad8-5232-4993-8883-e5b2c45361f9 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:11.632918 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:11.647239 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fede6b-1a2b-40b1-8f92-ba6a0962898a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:11.647849 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fede6b-1a2b-40b1-8f92-ba6a0962898a None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:11.648124 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fede6b-1a2b-40b1-8f92-ba6a0962898a None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:11.648430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fede6b-1a2b-40b1-8f92-ba6a0962898a None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:11.649093 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fede6b-1a2b-40b1-8f92-ba6a0962898a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:11.649391 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fede6b-1a2b-40b1-8f92-ba6a0962898a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:11.650818 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fede6b-1a2b-40b1-8f92-ba6a0962898a None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:11.665498 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 220/480] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:12.604486 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2d77b-9cf5-43fb-a768-cbe042771d13 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:12.605027 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2d77b-9cf5-43fb-a768-cbe042771d13 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:12.605027 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2d77b-9cf5-43fb-a768-cbe042771d13 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:12.606618 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 261/481] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:12.611936 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3673d1-b684-42a2-9ef5-e4a002c42a82 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:12.612354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3673d1-b684-42a2-9ef5-e4a002c42a82 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:12.612548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3673d1-b684-42a2-9ef5-e4a002c42a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:12.635443 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-ae3673d1-b684-42a2-9ef5-e4a002c42a82 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:12.636669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ae3673d1-b684-42a2-9ef5-e4a002c42a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:12.725184 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 221/482] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:13.015005 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2d77b-9cf5-43fb-a768-cbe042771d13 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:13.150867 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2d77b-9cf5-43fb-a768-cbe042771d13 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:13.199062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef1694-b2ea-433e-a30c-1edbd6a963f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:13.199693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef1694-b2ea-433e-a30c-1edbd6a963f6 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:13.199968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef1694-b2ea-433e-a30c-1edbd6a963f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:13.200240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef1694-b2ea-433e-a30c-1edbd6a963f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:13.203507 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:13.211566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef1694-b2ea-433e-a30c-1edbd6a963f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:13.216384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-45ef1694-b2ea-433e-a30c-1edbd6a963f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:13.216384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:13.216384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:13.216384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:13.216384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:13.216384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:13.216384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:13.216384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:13.216384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:13.216384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:13.216384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:13.216384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:13.216384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:13.216384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:13.216384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:13.216384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:13.236887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:13.236887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:13.236887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:13.236887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:13.236887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:13.236887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:13.236887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:13.236887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:13.236887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:13.236887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:13.236887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:13.236887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:13.236887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:13.236887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:13.236887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:13.236887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:13.237713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:13.237713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:13.237713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:13.237713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:13.237713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:13.237713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:13.237713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:13.237713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:13.237713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:13.237713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:13.237713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:13.237713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:13.237713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 262/483] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:13.238414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3673d1-b684-42a2-9ef5-e4a002c42a82 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:13.334252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc9810-6a4c-46b9-bb87-52caaae0eacc None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:13.334438 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc9810-6a4c-46b9-bb87-52caaae0eacc None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:13.334703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc9810-6a4c-46b9-bb87-52caaae0eacc None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:13.337347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 263/484] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:13.342993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e930b-fc02-4cac-b701-2e628477a8e5 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:13.343279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e930b-fc02-4cac-b701-2e628477a8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:13.343554 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e930b-fc02-4cac-b701-2e628477a8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:13.363117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-fc8e930b-fc02-4cac-b701-2e628477a8e5 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:13.364290 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-fc8e930b-fc02-4cac-b701-2e628477a8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:13.387737 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3673d1-b684-42a2-9ef5-e4a002c42a82 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:13.414319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:13.447025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8a15a-b5e6-48b1-955d-0d6dc2ca9511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:13.447637 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8a15a-b5e6-48b1-955d-0d6dc2ca9511 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:13.447947 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8a15a-b5e6-48b1-955d-0d6dc2ca9511 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:13.448242 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8a15a-b5e6-48b1-955d-0d6dc2ca9511 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:13.448909 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8a15a-b5e6-48b1-955d-0d6dc2ca9511 None admin] RBAC: Adding query filter params (name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:13.449214 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8a15a-b5e6-48b1-955d-0d6dc2ca9511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:13.451866 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8a15a-b5e6-48b1-955d-0d6dc2ca9511 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:13.461115 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 222/485] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:17:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:13.473299 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8a15a-b5e6-48b1-955d-0d6dc2ca9511 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:13.485322 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 264/486] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:17:13.628192 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8a15a-b5e6-48b1-955d-0d6dc2ca9511 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:13.680636 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756fa7b-34c6-42a5-9b4f-aedc5750ffc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:13.681290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756fa7b-34c6-42a5-9b4f-aedc5750ffc8 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:13.681571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756fa7b-34c6-42a5-9b4f-aedc5750ffc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:13.681846 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756fa7b-34c6-42a5-9b4f-aedc5750ffc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:13.698693 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756fa7b-34c6-42a5-9b4f-aedc5750ffc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:13.700167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756fa7b-34c6-42a5-9b4f-aedc5750ffc8 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:13.714977 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790643f-7889-4425-bf5a-841153a335b2 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:13.715485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790643f-7889-4425-bf5a-841153a335b2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:13.715559 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790643f-7889-4425-bf5a-841153a335b2 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:13.716424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-c756fa7b-34c6-42a5-9b4f-aedc5750ffc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:13.716424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:13.716424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:13.716424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:13.716424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:13.716424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:13.716424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:13.716424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:13.716424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:13.716424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:13.716424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:13.716424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:13.716424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:13.716424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:13.716424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:13.716424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:13.717297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:13.717297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:13.717297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:13.717297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:13.717297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:13.717297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:13.717297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:13.717297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:13.717297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:13.717297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:13.717297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:13.717297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:13.717297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:13.717297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:13.717297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:13.717297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:13.717297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:13.718148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:13.718148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:13.718148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:13.718308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 265/487] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:17:13.718373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 223/488] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:13.723498 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790643f-7889-4425-bf5a-841153a335b2 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:13.724782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d5e93-edd7-4068-9614-e250955d18b6 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:13.725271 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d5e93-edd7-4068-9614-e250955d18b6 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:13.725737 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d5e93-edd7-4068-9614-e250955d18b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:13.759664 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-990d5e93-edd7-4068-9614-e250955d18b6 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:13.761236 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-990d5e93-edd7-4068-9614-e250955d18b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:13.803092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:13.854438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 224/489] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:17:13.855524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d5e93-edd7-4068-9614-e250955d18b6 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:13.867502 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790643f-7889-4425-bf5a-841153a335b2 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:13.899668 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:13.911324 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a8f60-64f3-41fa-abd8-55c87ecdbe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:13.912521 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a8f60-64f3-41fa-abd8-55c87ecdbe0e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:13.915898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a8f60-64f3-41fa-abd8-55c87ecdbe0e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:13.916181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a8f60-64f3-41fa-abd8-55c87ecdbe0e None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:13.916930 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a8f60-64f3-41fa-abd8-55c87ecdbe0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:13.917291 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a8f60-64f3-41fa-abd8-55c87ecdbe0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:13.919597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a8f60-64f3-41fa-abd8-55c87ecdbe0e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:13.940662 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 266/490] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:13.942289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed56ae-b8b7-4d22-8ee0-f7c26031beb1 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:13.942849 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed56ae-b8b7-4d22-8ee0-f7c26031beb1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:13.943134 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed56ae-b8b7-4d22-8ee0-f7c26031beb1 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:13.944620 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 267/491] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:13.945336 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed56ae-b8b7-4d22-8ee0-f7c26031beb1 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:13.986130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d5e93-edd7-4068-9614-e250955d18b6 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:14.020630 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddef70d-f1e2-43e1-8ddb-113b74e35d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:14.021341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddef70d-f1e2-43e1-8ddb-113b74e35d3a None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:14.021621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddef70d-f1e2-43e1-8ddb-113b74e35d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:14.021946 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddef70d-f1e2-43e1-8ddb-113b74e35d3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:14.033323 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddef70d-f1e2-43e1-8ddb-113b74e35d3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:14.038235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-4ddef70d-f1e2-43e1-8ddb-113b74e35d3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:14.038235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:14.038235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:14.038235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:14.038235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:14.038235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:14.038235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:14.038235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:14.038235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:14.038235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:14.038235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:14.038235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:14.038235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:14.038235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:14.038235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:14.038235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:14.039457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:14.039457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:14.039457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:14.039457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:14.039457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:14.039457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:14.039457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:14.039457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:14.039457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:14.039457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:14.039457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:14.039457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:14.039457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:14.039457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:14.039457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:14.039457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:14.040319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:14.040319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:14.040319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:14.040319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:14.040319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:14.040319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:14.040319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:14.040319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:14.040319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:14.040319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:14.040319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:14.040319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:14.040319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 225/492] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:14.041028 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd49453-d4bb-423a-98ab-edf60d1d29d2 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:14.041198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd49453-d4bb-423a-98ab-edf60d1d29d2 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:14.041510 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd49453-d4bb-423a-98ab-edf60d1d29d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:14.061222 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-abd49453-d4bb-423a-98ab-edf60d1d29d2 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:14.062464 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-abd49453-d4bb-423a-98ab-edf60d1d29d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:14.068502 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed56ae-b8b7-4d22-8ee0-f7c26031beb1 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:14.074390 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:14.110368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c86d96-07c4-4b7d-86bd-e860aa2d0179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:14.111273 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c86d96-07c4-4b7d-86bd-e860aa2d0179 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:14.111730 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c86d96-07c4-4b7d-86bd-e860aa2d0179 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:14.112151 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c86d96-07c4-4b7d-86bd-e860aa2d0179 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:14.121193 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c86d96-07c4-4b7d-86bd-e860aa2d0179 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:14.123432 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c86d96-07c4-4b7d-86bd-e860aa2d0179 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:14.138054 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 226/493] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:14.138054 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd49453-d4bb-423a-98ab-edf60d1d29d2 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:14.141972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-e1c86d96-07c4-4b7d-86bd-e860aa2d0179 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 16:17:14.141972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:14.141972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:14.141972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:14.141972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:14.141972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:14.141972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:14.141972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:14.141972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:14.141972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:14.141972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:14.141972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:14.141972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:14.141972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:14.141972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:14.141972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:14.142905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:14.142905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:14.142905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:14.142905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:14.142905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:14.142905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:14.142905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:14.142905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:14.142905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:14.142905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:14.142905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:14.142905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:14.142905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:14.142905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:14.142905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:14.142905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:14.142905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:14.142905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:14.143845 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:14.143845 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:14.143845 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:14.143845 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:14.143845 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:14.143845 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:14.143845 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:14.143845 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:14.143845 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 16:17:14.143845 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:14.143845 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 268/494] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Sep 27 16:17:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:14.144440 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c86d96-07c4-4b7d-86bd-e860aa2d0179 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:14.208812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:14.248254 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd49453-d4bb-423a-98ab-edf60d1d29d2 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:14.269698 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c86d96-07c4-4b7d-86bd-e860aa2d0179 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:14.283436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df834b1-d4cc-4f0d-9a90-33e36e3ffc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:14.284237 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df834b1-d4cc-4f0d-9a90-33e36e3ffc1a None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:14.284691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df834b1-d4cc-4f0d-9a90-33e36e3ffc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:14.285103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df834b1-d4cc-4f0d-9a90-33e36e3ffc1a None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:14.286019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df834b1-d4cc-4f0d-9a90-33e36e3ffc1a None admin] RBAC: Adding query filter params (name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:14.286500 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df834b1-d4cc-4f0d-9a90-33e36e3ffc1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:14.288061 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df834b1-d4cc-4f0d-9a90-33e36e3ffc1a None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:14.298157 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 227/495] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:17:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:14.299217 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df834b1-d4cc-4f0d-9a90-33e36e3ffc1a None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:14.309255 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19159800-f598-4fdc-b7a1-3bd4c6ae6760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:14.310694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:14.310804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19159800-f598-4fdc-b7a1-3bd4c6ae6760 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:14.311604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19159800-f598-4fdc-b7a1-3bd4c6ae6760 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:14.311726 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19159800-f598-4fdc-b7a1-3bd4c6ae6760 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:14.324435 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19159800-f598-4fdc-b7a1-3bd4c6ae6760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:14.332283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-19159800-f598-4fdc-b7a1-3bd4c6ae6760 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:14.332283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:14.332283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:14.332283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:14.332283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:14.332283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:14.332283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:14.332283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:14.332283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:14.332283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:14.332283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:14.332283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:14.332283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:14.332283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:14.332283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:14.332283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:14.333241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:14.333241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:14.333241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:14.333241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:14.333241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:14.333241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:14.333241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:14.333241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:14.333241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:14.333241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:14.333241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:14.333241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:14.333241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:14.333241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:14.333241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:14.333241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:14.334031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:14.334031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:14.334031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:14.334031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:14.334031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:14.334031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:14.334031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:14.334031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:14.334031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:14.334031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:14.334031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:14.334031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:14.336641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 269/496] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:14.337642 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19159800-f598-4fdc-b7a1-3bd4c6ae6760 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:14.422746 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df834b1-d4cc-4f0d-9a90-33e36e3ffc1a None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:14.460532 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5ddf8-e7cb-4d95-8e46-1b9b140f952f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:14.461070 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5ddf8-e7cb-4d95-8e46-1b9b140f952f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:14.461350 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5ddf8-e7cb-4d95-8e46-1b9b140f952f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:14.461621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5ddf8-e7cb-4d95-8e46-1b9b140f952f None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:14.462511 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5ddf8-e7cb-4d95-8e46-1b9b140f952f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:14.462816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5ddf8-e7cb-4d95-8e46-1b9b140f952f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:14.464301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5ddf8-e7cb-4d95-8e46-1b9b140f952f None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:14.475286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19159800-f598-4fdc-b7a1-3bd4c6ae6760 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:14.483564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:14.509161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 228/497] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Sep 27 16:17:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:14.509161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5ddf8-e7cb-4d95-8e46-1b9b140f952f None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:14.516238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0109b6-36eb-41cc-bbb0-1f1385454c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:14.516900 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0109b6-36eb-41cc-bbb0-1f1385454c7d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:14.517178 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0109b6-36eb-41cc-bbb0-1f1385454c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:14.517452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0109b6-36eb-41cc-bbb0-1f1385454c7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:14.529480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0109b6-36eb-41cc-bbb0-1f1385454c7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:14.530948 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0109b6-36eb-41cc-bbb0-1f1385454c7d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:14.546345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-6e0109b6-36eb-41cc-bbb0-1f1385454c7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:14.546345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:14.546345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:14.546345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:14.546345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:14.546345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:14.546345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:14.546345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:14.546345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:14.546345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:14.546345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:14.546345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:14.546345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:14.546345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:14.546345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:14.546345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:14.547522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:14.547522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:14.547522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:14.547522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:14.547522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:14.547522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:14.547522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:14.547522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:14.547522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:14.547522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:14.547522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:14.547522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:14.547522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:14.547522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:14.547522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:14.547522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:14.547522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:14.548419 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:14.548419 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:14.548419 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:14.548419 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 270/498] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:14.548658 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0109b6-36eb-41cc-bbb0-1f1385454c7d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:14.580479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:14.615647 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5ddf8-e7cb-4d95-8e46-1b9b140f952f None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:14.647848 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199eeeb-1f07-48cf-9469-0990524edc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:14.648480 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199eeeb-1f07-48cf-9469-0990524edc45 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:14.648736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199eeeb-1f07-48cf-9469-0990524edc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:14.648903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0109b6-36eb-41cc-bbb0-1f1385454c7d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:14.649006 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199eeeb-1f07-48cf-9469-0990524edc45 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:14.649643 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199eeeb-1f07-48cf-9469-0990524edc45 None admin] RBAC: Adding query filter params (name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:14.649941 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199eeeb-1f07-48cf-9469-0990524edc45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:14.651315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199eeeb-1f07-48cf-9469-0990524edc45 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:14.659360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 229/499] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:17:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:14.660135 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199eeeb-1f07-48cf-9469-0990524edc45 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:14.683781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe3321-5893-436a-adee-c242858ed4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:14.684471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe3321-5893-436a-adee-c242858ed4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:14.684763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe3321-5893-436a-adee-c242858ed4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:14.685615 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe3321-5893-436a-adee-c242858ed4e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:14.695539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe3321-5893-436a-adee-c242858ed4e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:14.701403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-59fe3321-5893-436a-adee-c242858ed4e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:14.701403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:14.701403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:14.701403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:14.701403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:14.701403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:14.701403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:14.701403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:14.701403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:14.701403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:14.701403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:14.701403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:14.701403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:14.701403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:14.701403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:14.701403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:14.702553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:14.702553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:14.702553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:14.702553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:14.702553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:14.702553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:14.702553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:14.702553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:14.702553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:14.702553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:14.702553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:14.702553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:14.702553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:14.702553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:14.702553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:14.702553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:14.703532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:14.703532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:14.703532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:14.703532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:14.703532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:14.703532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:14.703532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:14.703532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:14.703532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:14.703532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:14.703532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:14.703532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:14.703532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 271/500] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:14.703532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe3321-5893-436a-adee-c242858ed4e0 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:14.722321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:14.760585 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199eeeb-1f07-48cf-9469-0990524edc45 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:14.786312 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:14.794869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da043e5-277a-4846-81a6-0d36d8f4c182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:14.798703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da043e5-277a-4846-81a6-0d36d8f4c182 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:14.798703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da043e5-277a-4846-81a6-0d36d8f4c182 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:14.798703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da043e5-277a-4846-81a6-0d36d8f4c182 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:14.803874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe3321-5893-436a-adee-c242858ed4e0 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:14.837453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a05c61-1462-4386-b6ca-4dc3aa1f9417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:14.838053 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a05c61-1462-4386-b6ca-4dc3aa1f9417 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:14.838326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a05c61-1462-4386-b6ca-4dc3aa1f9417 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:14.838592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a05c61-1462-4386-b6ca-4dc3aa1f9417 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:14.839216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a05c61-1462-4386-b6ca-4dc3aa1f9417 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:14.839522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a05c61-1462-4386-b6ca-4dc3aa1f9417 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:14.840933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a05c61-1462-4386-b6ca-4dc3aa1f9417 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:14.852382 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 272/501] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:14.853556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e537d-e944-4204-83cf-a737446c4e5c None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:14.853841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e537d-e944-4204-83cf-a737446c4e5c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:14.854111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e537d-e944-4204-83cf-a737446c4e5c None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:14.855448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 273/502] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:14.855957 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e537d-e944-4204-83cf-a737446c4e5c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:14.867378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da043e5-277a-4846-81a6-0d36d8f4c182 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:14.868863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da043e5-277a-4846-81a6-0d36d8f4c182 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:14.934007 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:14.955650 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e537d-e944-4204-83cf-a737446c4e5c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:14.965603 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 230/503] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:17:14.966977 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da043e5-277a-4846-81a6-0d36d8f4c182 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:14.992940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:14.993836 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca35ad6-8cec-4724-b461-6c11967fd73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:14.994463 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca35ad6-8cec-4724-b461-6c11967fd73d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:14.994739 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca35ad6-8cec-4724-b461-6c11967fd73d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:14.995018 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca35ad6-8cec-4724-b461-6c11967fd73d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:15.005498 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca35ad6-8cec-4724-b461-6c11967fd73d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:15.006939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca35ad6-8cec-4724-b461-6c11967fd73d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:15.021294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-1ca35ad6-8cec-4724-b461-6c11967fd73d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:15.021294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:15.021294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:15.021294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:15.021294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:15.021294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:15.021294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:15.021294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:15.021294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:15.021294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:15.021294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:15.021294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:15.021294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:15.021294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:15.021294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:15.021294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:15.022351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:15.022351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:15.022351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:15.022351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:15.022351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:15.022351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:15.022351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:15.022351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:15.022351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:15.022351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:15.022351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:15.022351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:15.022351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:15.022351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:15.022351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:15.022351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:15.022351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:15.023384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:15.023384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:15.023384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:15.023384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 274/504] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:15.023638 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca35ad6-8cec-4724-b461-6c11967fd73d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:15.066844 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da043e5-277a-4846-81a6-0d36d8f4c182 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:15.100158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20639e3-4ef6-4604-b27b-f2e636b58b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:15.100788 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20639e3-4ef6-4604-b27b-f2e636b58b52 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:15.101061 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20639e3-4ef6-4604-b27b-f2e636b58b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:15.101330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20639e3-4ef6-4604-b27b-f2e636b58b52 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:15.101982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20639e3-4ef6-4604-b27b-f2e636b58b52 None admin] RBAC: Adding query filter params (name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:15.102281 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20639e3-4ef6-4604-b27b-f2e636b58b52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:15.103637 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20639e3-4ef6-4604-b27b-f2e636b58b52 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:15.111305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 231/505] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:17:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:15.112522 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68546c-2f95-43eb-9fa0-ac660b176b88 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:15.112802 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68546c-2f95-43eb-9fa0-ac660b176b88 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:15.113151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68546c-2f95-43eb-9fa0-ac660b176b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:15.125143 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca35ad6-8cec-4724-b461-6c11967fd73d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:15.129992 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-3e68546c-2f95-43eb-9fa0-ac660b176b88 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:15.131173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3e68546c-2f95-43eb-9fa0-ac660b176b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:15.154490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:15.160184 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8c64d-bf44-4858-b285-865cfa08ee84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:15.160828 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8c64d-bf44-4858-b285-865cfa08ee84 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:15.161109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8c64d-bf44-4858-b285-865cfa08ee84 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:15.161377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8c64d-bf44-4858-b285-865cfa08ee84 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:15.168615 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8c64d-bf44-4858-b285-865cfa08ee84 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:15.170781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8c64d-bf44-4858-b285-865cfa08ee84 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:15.182192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-e3e8c64d-bf44-4858-b285-865cfa08ee84 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 16:17:15.182192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:15.182192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:15.182192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:15.182192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:15.182192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:15.182192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:15.182192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:15.182192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:15.182192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:15.182192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:15.182192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:15.182192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:15.182192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:15.182192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:15.182192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:15.183275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:15.183275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:15.183275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:15.183275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:15.183275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:15.183275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:15.183275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:15.183275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:15.183275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:15.183275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:15.183275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:15.183275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:15.183275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:15.183275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:15.183275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:15.183275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:15.183275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:15.183275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:15.184222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:15.184222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:15.184222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:15.184222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:15.184222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:15.184222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:15.184222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:15.184222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:15.184222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 16:17:15.184222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:15.184222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 275/506] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:17:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:15.184904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8c64d-bf44-4858-b285-865cfa08ee84 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:15.198081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 232/507] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:15.199012 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68546c-2f95-43eb-9fa0-ac660b176b88 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:15.221066 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:15.304231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8c64d-bf44-4858-b285-865cfa08ee84 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:15.305199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68546c-2f95-43eb-9fa0-ac660b176b88 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:15.339738 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d39e1b-28be-4899-a34e-52ac69a212fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:15.340386 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d39e1b-28be-4899-a34e-52ac69a212fe None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:15.340669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d39e1b-28be-4899-a34e-52ac69a212fe None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:15.340941 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d39e1b-28be-4899-a34e-52ac69a212fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:15.341987 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0c92c-2a76-4783-9ebd-372fab8432c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:15.342687 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0c92c-2a76-4783-9ebd-372fab8432c7 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:15.342961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0c92c-2a76-4783-9ebd-372fab8432c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:15.343227 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0c92c-2a76-4783-9ebd-372fab8432c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:15.343857 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0c92c-2a76-4783-9ebd-372fab8432c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:15.344156 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0c92c-2a76-4783-9ebd-372fab8432c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:15.345556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0c92c-2a76-4783-9ebd-372fab8432c7 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:15.352774 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d39e1b-28be-4899-a34e-52ac69a212fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:15.354296 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d39e1b-28be-4899-a34e-52ac69a212fe None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:15.362301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 233/508] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:15.362301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0c92c-2a76-4783-9ebd-372fab8432c7 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:15.370859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-b8d39e1b-28be-4899-a34e-52ac69a212fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:15.370859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:15.370859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:15.370859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:15.370859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:15.370859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:15.370859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:15.370859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:15.370859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:15.370859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:15.370859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:15.370859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:15.370859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:15.370859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:15.370859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:15.370859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:15.371785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:15.371785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:15.371785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:15.371785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:15.371785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:15.371785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:15.371785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:15.371785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:15.371785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:15.371785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:15.371785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:15.371785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:15.371785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:15.371785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:15.371785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:15.371785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:15.371785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:15.372680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:15.372680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:15.372680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:15.372680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 276/509] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:15.372907 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d39e1b-28be-4899-a34e-52ac69a212fe None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:15.416727 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:15.456959 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:15.474248 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d39e1b-28be-4899-a34e-52ac69a212fe None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:15.476736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0c92c-2a76-4783-9ebd-372fab8432c7 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:15.507071 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f131e3-0486-4779-ac80-934d59d1d0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:15.507746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f131e3-0486-4779-ac80-934d59d1d0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:15.508023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f131e3-0486-4779-ac80-934d59d1d0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:15.508299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f131e3-0486-4779-ac80-934d59d1d0a4 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:15.509033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f131e3-0486-4779-ac80-934d59d1d0a4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:15.509333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f131e3-0486-4779-ac80-934d59d1d0a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:15.510762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f131e3-0486-4779-ac80-934d59d1d0a4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:15.511498 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb017a8-7d3d-4554-ab1b-187feaaf3711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:15.512124 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb017a8-7d3d-4554-ab1b-187feaaf3711 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:15.512438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb017a8-7d3d-4554-ab1b-187feaaf3711 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:15.512714 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb017a8-7d3d-4554-ab1b-187feaaf3711 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:15.523107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb017a8-7d3d-4554-ab1b-187feaaf3711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:15.524595 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb017a8-7d3d-4554-ab1b-187feaaf3711 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:15.538776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-4eb017a8-7d3d-4554-ab1b-187feaaf3711 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:15.538776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:15.538776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:15.538776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:15.538776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:15.538776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:15.538776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:15.538776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:15.538776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:15.538776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:15.538776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:15.538776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:15.538776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:15.538776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:15.538776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:15.538776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:15.539843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:15.539843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:15.539843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:15.539843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:15.539843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:15.539843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:15.539843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:15.539843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:15.539843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:15.539843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:15.539843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:15.539843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:15.539843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:15.539843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:15.539843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:15.539843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:15.539843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:15.545697 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:15.545697 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:15.545697 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:15.545697 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 234/510] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:15.545697 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb017a8-7d3d-4554-ab1b-187feaaf3711 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:15.548094 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 277/511] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Sep 27 16:17:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:15.548954 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f131e3-0486-4779-ac80-934d59d1d0a4 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:15.639895 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb017a8-7d3d-4554-ab1b-187feaaf3711 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:15.644297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:15.647191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f131e3-0486-4779-ac80-934d59d1d0a4 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:15.668519 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:15.674013 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a759f-6555-4ebd-bbcf-f7d0b9a825aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:15.674717 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a759f-6555-4ebd-bbcf-f7d0b9a825aa None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:15.675125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a759f-6555-4ebd-bbcf-f7d0b9a825aa None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:15.675474 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a759f-6555-4ebd-bbcf-f7d0b9a825aa None admin] PATH_INFO: `/v3/users/glance` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:15.680378 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad583c-33df-4998-a058-1b2b2311cdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:15.681019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad583c-33df-4998-a058-1b2b2311cdcf None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:15.681295 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad583c-33df-4998-a058-1b2b2311cdcf None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:15.681631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad583c-33df-4998-a058-1b2b2311cdcf None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:15.682268 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad583c-33df-4998-a058-1b2b2311cdcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:15.682563 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad583c-33df-4998-a058-1b2b2311cdcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:15.682919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a759f-6555-4ebd-bbcf-f7d0b9a825aa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:15.683935 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad583c-33df-4998-a058-1b2b2311cdcf None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:15.684373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a759f-6555-4ebd-bbcf-f7d0b9a825aa None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:15.695407 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 278/512] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:15.696095 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad583c-33df-4998-a058-1b2b2311cdcf None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:15.697919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-4c6a759f-6555-4ebd-bbcf-f7d0b9a825aa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 27 16:17:15.697919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:15.697919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:15.697919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:15.697919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:15.697919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:15.697919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:15.697919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:15.697919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:15.697919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:15.697919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:15.697919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:15.697919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:15.697919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:15.697919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:15.697919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:15.698794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:15.698794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:15.698794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:15.698794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:15.698794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:15.698794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:15.698794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:15.698794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:15.698794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:15.698794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:15.698794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:15.698794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:15.698794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:15.698794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:15.698794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:15.698794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:15.698794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:15.698794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:15.699691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:15.699691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:15.699691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:15.699691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:15.699691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:15.699691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:15.699691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:15.699691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:15.699691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 27 16:17:15.699691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:15.699691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 235/513] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:17:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:15.700305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a759f-6555-4ebd-bbcf-f7d0b9a825aa None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:15.797606 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a759f-6555-4ebd-bbcf-f7d0b9a825aa None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:15.801097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad583c-33df-4998-a058-1b2b2311cdcf None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:15.830224 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd54032-8ae9-4f69-bfa2-dc5d46b4ab74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:15.830826 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd54032-8ae9-4f69-bfa2-dc5d46b4ab74 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:15.831104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd54032-8ae9-4f69-bfa2-dc5d46b4ab74 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:15.831378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd54032-8ae9-4f69-bfa2-dc5d46b4ab74 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:15.832012 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd54032-8ae9-4f69-bfa2-dc5d46b4ab74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:15.832317 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd54032-8ae9-4f69-bfa2-dc5d46b4ab74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:15.833419 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b006940-f942-443f-9fd0-5de4c5ee76da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:15.833721 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd54032-8ae9-4f69-bfa2-dc5d46b4ab74 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:15.834028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b006940-f942-443f-9fd0-5de4c5ee76da None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:15.834302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b006940-f942-443f-9fd0-5de4c5ee76da None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:15.834568 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b006940-f942-443f-9fd0-5de4c5ee76da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:15.844563 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b006940-f942-443f-9fd0-5de4c5ee76da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:15.845002 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 236/514] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:15.845782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd54032-8ae9-4f69-bfa2-dc5d46b4ab74 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:15.845998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b006940-f942-443f-9fd0-5de4c5ee76da None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:15.863161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-5b006940-f942-443f-9fd0-5de4c5ee76da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:15.863161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:15.863161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:15.863161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:15.863161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:15.863161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:15.863161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:15.863161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:15.863161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:15.863161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:15.863161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:15.863161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:15.863161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:15.863161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:15.863161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:15.863161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:15.864745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:15.864745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:15.864745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:15.864745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:15.864745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:15.864745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:15.864745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:15.864745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:15.864745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:15.864745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:15.864745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:15.864745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:15.864745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:15.864745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:15.864745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:15.864745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:15.864745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:15.865839 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:15.865839 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:15.865839 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:15.869179 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 279/515] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:15.869991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b006940-f942-443f-9fd0-5de4c5ee76da None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:15.884743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:15.901491 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:15.960904 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd54032-8ae9-4f69-bfa2-dc5d46b4ab74 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:15.968601 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b006940-f942-443f-9fd0-5de4c5ee76da None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:15.999280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e947944-0906-42b6-a04d-e313ca5078f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:15.999885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e947944-0906-42b6-a04d-e313ca5078f3 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:16.000164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e947944-0906-42b6-a04d-e313ca5078f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:16.000471 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e947944-0906-42b6-a04d-e313ca5078f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:16.002422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783437e-7b02-4d09-9f63-09f36d4ac927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:16.003143 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783437e-7b02-4d09-9f63-09f36d4ac927 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:16.003531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783437e-7b02-4d09-9f63-09f36d4ac927 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:16.003822 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783437e-7b02-4d09-9f63-09f36d4ac927 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:16.010322 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783437e-7b02-4d09-9f63-09f36d4ac927 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:16.011782 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783437e-7b02-4d09-9f63-09f36d4ac927 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:16.023474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-6783437e-7b02-4d09-9f63-09f36d4ac927 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:16.023474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:16.023474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:16.023474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:16.023474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:16.023474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:16.023474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:16.023474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:16.023474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:16.023474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:16.023474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:16.023474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:16.023474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:16.023474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:16.023474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:16.024425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:16.024425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:16.024425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:16.024425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:16.024425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:16.024425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:16.024425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:16.024425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:16.024425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:16.024425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:16.024425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:16.024425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:16.024425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:16.024425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:16.024425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:16.024425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:16.024425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:16.025422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:16.025422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:16.025422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:16.025422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:16.025422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:16.025422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:16.025422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:16.025422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:16.025422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 280/516] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:16.025422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783437e-7b02-4d09-9f63-09f36d4ac927 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:16.066395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e947944-0906-42b6-a04d-e313ca5078f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:16.067847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e947944-0906-42b6-a04d-e313ca5078f3 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:16.095435 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:16.117483 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:16.126187 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783437e-7b02-4d09-9f63-09f36d4ac927 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:16.159220 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a91acf-fd4c-4a0c-a96c-33f6a59ddb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:16.159733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a91acf-fd4c-4a0c-a96c-33f6a59ddb2d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:16.160103 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a91acf-fd4c-4a0c-a96c-33f6a59ddb2d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:16.160399 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a91acf-fd4c-4a0c-a96c-33f6a59ddb2d None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:16.161120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a91acf-fd4c-4a0c-a96c-33f6a59ddb2d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:16.161420 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a91acf-fd4c-4a0c-a96c-33f6a59ddb2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:16.162840 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a91acf-fd4c-4a0c-a96c-33f6a59ddb2d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:16.165471 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 237/517] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:17:16.166377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e947944-0906-42b6-a04d-e313ca5078f3 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:16.179738 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 281/518] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Sep 27 16:17:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:16.180573 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a91acf-fd4c-4a0c-a96c-33f6a59ddb2d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:16.266501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e947944-0906-42b6-a04d-e313ca5078f3 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:16.283592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a91acf-fd4c-4a0c-a96c-33f6a59ddb2d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:16.300821 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478532c-f444-4c85-9118-c8631f07ea8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:16.301453 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478532c-f444-4c85-9118-c8631f07ea8c None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:16.301734 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478532c-f444-4c85-9118-c8631f07ea8c None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:16.302009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478532c-f444-4c85-9118-c8631f07ea8c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:16.308748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478532c-f444-4c85-9118-c8631f07ea8c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:16.310728 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478532c-f444-4c85-9118-c8631f07ea8c None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:16.311341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:16.317242 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db6b4d-1457-48ee-9f72-f7a6e264badb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:16.317835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db6b4d-1457-48ee-9f72-f7a6e264badb None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:16.318152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db6b4d-1457-48ee-9f72-f7a6e264badb None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:16.318421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db6b4d-1457-48ee-9f72-f7a6e264badb None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:16.319046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db6b4d-1457-48ee-9f72-f7a6e264badb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:16.319344 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db6b4d-1457-48ee-9f72-f7a6e264badb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:16.320750 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db6b4d-1457-48ee-9f72-f7a6e264badb None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:16.322164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-f478532c-f444-4c85-9118-c8631f07ea8c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 16:17:16.322164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:16.322164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:16.322164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:16.322164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:16.322164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:16.322164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:16.322164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:16.322164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:16.322164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:16.322164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:16.322164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:16.322164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:16.322164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:16.322164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:16.322164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:16.327134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:16.327134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:16.327134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:16.327134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:16.327134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:16.327134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:16.327134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:16.327134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:16.327134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:16.327134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:16.327134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:16.327134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:16.327134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:16.327134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:16.327134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:16.327134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:16.327134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:16.327134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:16.328036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:16.328036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:16.328036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:16.328036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:16.328036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:16.328036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:16.328036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:16.328036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:16.328036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 16:17:16.328036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:16.328036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 238/519] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:16.328036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478532c-f444-4c85-9118-c8631f07ea8c None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:16.333925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 282/520] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:16.334732 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db6b4d-1457-48ee-9f72-f7a6e264badb None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:16.344572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:16.428651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478532c-f444-4c85-9118-c8631f07ea8c None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:16.430790 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db6b4d-1457-48ee-9f72-f7a6e264badb None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:16.461490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99157cc7-1d14-4c8a-a86e-13a81fb8f31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:16.462089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99157cc7-1d14-4c8a-a86e-13a81fb8f31b None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:16.462365 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99157cc7-1d14-4c8a-a86e-13a81fb8f31b None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:16.462640 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99157cc7-1d14-4c8a-a86e-13a81fb8f31b None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:16.463309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99157cc7-1d14-4c8a-a86e-13a81fb8f31b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:16.463609 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99157cc7-1d14-4c8a-a86e-13a81fb8f31b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:16.463763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea21ac-8e99-4bf3-8af4-7735778a1261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:16.464407 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea21ac-8e99-4bf3-8af4-7735778a1261 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:16.464693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea21ac-8e99-4bf3-8af4-7735778a1261 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:16.464967 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea21ac-8e99-4bf3-8af4-7735778a1261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:16.465062 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99157cc7-1d14-4c8a-a86e-13a81fb8f31b None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:16.475271 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea21ac-8e99-4bf3-8af4-7735778a1261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:16.476730 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea21ac-8e99-4bf3-8af4-7735778a1261 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:16.482540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 239/521] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:16.483322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99157cc7-1d14-4c8a-a86e-13a81fb8f31b None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:16.491709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-24ea21ac-8e99-4bf3-8af4-7735778a1261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:16.491709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:16.491709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:16.491709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:16.491709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:16.491709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:16.491709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:16.491709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:16.491709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:16.491709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:16.491709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:16.491709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:16.491709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:16.491709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:16.491709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:16.491709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:16.492660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:16.492660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:16.492660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:16.492660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:16.492660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:16.492660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:16.492660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:16.492660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:16.492660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:16.492660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:16.492660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:16.492660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:16.492660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:16.492660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:16.492660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:16.492660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:16.492660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:16.493524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:16.493524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:16.493524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:16.493524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 283/522] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:16.493832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea21ac-8e99-4bf3-8af4-7735778a1261 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:16.535321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:16.557693 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:16.599877 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea21ac-8e99-4bf3-8af4-7735778a1261 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:16.600452 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99157cc7-1d14-4c8a-a86e-13a81fb8f31b None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:16.641166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89202d9a-e715-446e-9430-53783a026277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:16.641764 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89202d9a-e715-446e-9430-53783a026277 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:16.642043 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89202d9a-e715-446e-9430-53783a026277 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:16.642319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89202d9a-e715-446e-9430-53783a026277 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:16.643031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89202d9a-e715-446e-9430-53783a026277 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:16.643335 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89202d9a-e715-446e-9430-53783a026277 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:16.643423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8413bc-eff1-4111-b006-47dee525ec11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:16.644026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8413bc-eff1-4111-b006-47dee525ec11 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:16.644305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8413bc-eff1-4111-b006-47dee525ec11 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:16.644731 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8413bc-eff1-4111-b006-47dee525ec11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:16.644818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89202d9a-e715-446e-9430-53783a026277 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:16.661663 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 284/523] 10.222.0.26 () {56 vars in 1139 bytes} [Tue Sep 27 16:17:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:16.662436 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89202d9a-e715-446e-9430-53783a026277 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:16.710382 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8413bc-eff1-4111-b006-47dee525ec11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:16.711773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8413bc-eff1-4111-b006-47dee525ec11 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:16.756720 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:16.759494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89202d9a-e715-446e-9430-53783a026277 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:16.778279 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:16.793779 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5d06c-ddef-4c9a-b765-ff37e8f105de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:16.795137 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5d06c-ddef-4c9a-b765-ff37e8f105de None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:16.795416 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5d06c-ddef-4c9a-b765-ff37e8f105de None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:16.795688 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5d06c-ddef-4c9a-b765-ff37e8f105de None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:16.796354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5d06c-ddef-4c9a-b765-ff37e8f105de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:16.797901 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5d06c-ddef-4c9a-b765-ff37e8f105de None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:16.815137 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 240/524] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:17:16.815137 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8413bc-eff1-4111-b006-47dee525ec11 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:16.909927 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8413bc-eff1-4111-b006-47dee525ec11 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:16.926734 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 285/525] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 27 16:17:16 2022] POST /identity/v3/users => generated 247 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:17:16.927797 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5d06c-ddef-4c9a-b765-ff37e8f105de None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:16.945307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22915d7-0507-4738-9721-927841c68b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:16.945948 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22915d7-0507-4738-9721-927841c68b7c None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:16.946611 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22915d7-0507-4738-9721-927841c68b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:16.946611 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22915d7-0507-4738-9721-927841c68b7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:16.947220 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22915d7-0507-4738-9721-927841c68b7c None admin] RBAC: Adding query filter params (role.id=2696068001744b38a289a59c56f56a95, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=e71fea96b2b949f9abca12172e69284b) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:16.947530 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22915d7-0507-4738-9721-927841c68b7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:16.949117 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22915d7-0507-4738-9721-927841c68b7c None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:16.964474 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 241/526] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:17:16 2022] GET /identity/v3/role_assignments?user.id=e71fea96b2b949f9abca12172e69284b&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=2696068001744b38a289a59c56f56a95 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:16.964474 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22915d7-0507-4738-9721-927841c68b7c None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:17.040472 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:17.072316 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5d06c-ddef-4c9a-b765-ff37e8f105de None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:17.115207 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7fff3-8826-4d65-aa08-eaf346726fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:17.116548 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7fff3-8826-4d65-aa08-eaf346726fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:17.116867 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7fff3-8826-4d65-aa08-eaf346726fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:17.117152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7fff3-8826-4d65-aa08-eaf346726fd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:17.118771 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7fff3-8826-4d65-aa08-eaf346726fd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:17.118771 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7fff3-8826-4d65-aa08-eaf346726fd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:17.120289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7fff3-8826-4d65-aa08-eaf346726fd8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:17.125260 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22915d7-0507-4738-9721-927841c68b7c None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:17.133888 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 286/527] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:17.134599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7fff3-8826-4d65-aa08-eaf346726fd8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:17.154683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:17.167470 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05668bfb-3821-4bba-84a7-5161c3a7a1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:17.168087 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05668bfb-3821-4bba-84a7-5161c3a7a1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:17.168387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05668bfb-3821-4bba-84a7-5161c3a7a1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:17.168662 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05668bfb-3821-4bba-84a7-5161c3a7a1a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:17.258659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05668bfb-3821-4bba-84a7-5161c3a7a1a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:17.260119 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05668bfb-3821-4bba-84a7-5161c3a7a1a9 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:17.272597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7fff3-8826-4d65-aa08-eaf346726fd8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:17.295881 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:17.313201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a34c95-bb39-452d-9f35-beb916432a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:17.314144 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a34c95-bb39-452d-9f35-beb916432a12 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:17.314587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a34c95-bb39-452d-9f35-beb916432a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:17.315001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a34c95-bb39-452d-9f35-beb916432a12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:17.327695 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a34c95-bb39-452d-9f35-beb916432a12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:17.329557 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a34c95-bb39-452d-9f35-beb916432a12 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:17.352038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-62a34c95-bb39-452d-9f35-beb916432a12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:17.352038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:17.352038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:17.352038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:17.352038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:17.352038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:17.352038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:17.352038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:17.352038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:17.352038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:17.352038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:17.352038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:17.352038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:17.352038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:17.352038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:17.352038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:17.353048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:17.353048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:17.353048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:17.353048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:17.353048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:17.353048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:17.353048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:17.353048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:17.353048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:17.353048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:17.353048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:17.353048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:17.353048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:17.353048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:17.353048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:17.353048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:17.353048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:17.353948 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:17.353948 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:17.353948 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:17.353948 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 287/528] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:17.354655 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a34c95-bb39-452d-9f35-beb916432a12 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:17.368567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 242/529] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:17:17.374096 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05668bfb-3821-4bba-84a7-5161c3a7a1a9 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:17.435095 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:17.474245 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a34c95-bb39-452d-9f35-beb916432a12 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:17.493490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05668bfb-3821-4bba-84a7-5161c3a7a1a9 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:17.514550 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2a10f-0f11-444a-a272-e7ec9be99930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:17.515542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2a10f-0f11-444a-a272-e7ec9be99930 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:17.515830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2a10f-0f11-444a-a272-e7ec9be99930 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:17.516167 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2a10f-0f11-444a-a272-e7ec9be99930 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:17.524156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2a10f-0f11-444a-a272-e7ec9be99930 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:17.525782 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2a10f-0f11-444a-a272-e7ec9be99930 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:17.531318 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b6a41-c51f-4fa0-8194-b74a72a2236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:17.532182 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b6a41-c51f-4fa0-8194-b74a72a2236f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:17.532771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b6a41-c51f-4fa0-8194-b74a72a2236f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:17.533257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b6a41-c51f-4fa0-8194-b74a72a2236f None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:17.534097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b6a41-c51f-4fa0-8194-b74a72a2236f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:17.536065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b6a41-c51f-4fa0-8194-b74a72a2236f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:17.538044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-b7d2a10f-0f11-444a-a272-e7ec9be99930 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:17.538044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:17.538044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:17.538044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:17.538044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:17.538044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:17.538044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:17.538044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:17.538044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:17.538044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:17.538044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:17.538044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:17.538044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:17.538044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:17.538044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:17.538927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:17.538927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:17.538927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:17.538927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:17.538927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:17.538927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:17.538927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:17.538927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:17.538927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:17.538927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:17.538927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:17.538927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:17.538927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:17.538927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:17.538927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:17.538927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:17.538927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:17.541389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:17.541389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:17.541389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:17.541389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:17.541389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:17.541389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:17.541389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:17.541389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:17.542513 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b6a41-c51f-4fa0-8194-b74a72a2236f None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:17.545676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 288/530] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:17.545676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2a10f-0f11-444a-a272-e7ec9be99930 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:17.558007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 243/531] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:17.559150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b6a41-c51f-4fa0-8194-b74a72a2236f None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:17.576683 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:17.656625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2a10f-0f11-444a-a272-e7ec9be99930 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:17.686264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b6a41-c51f-4fa0-8194-b74a72a2236f None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:17.687199 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:17.702209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead6546-fed1-4f1b-a6de-644692d14ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:17.703179 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead6546-fed1-4f1b-a6de-644692d14ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:17.703662 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead6546-fed1-4f1b-a6de-644692d14ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:17.704167 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead6546-fed1-4f1b-a6de-644692d14ea4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:17.717209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead6546-fed1-4f1b-a6de-644692d14ea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:17.719245 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead6546-fed1-4f1b-a6de-644692d14ea4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:17.724646 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93012a-81c2-4c13-be7f-16c468bf576f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:17.725263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93012a-81c2-4c13-be7f-16c468bf576f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:17.725547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93012a-81c2-4c13-be7f-16c468bf576f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:17.725827 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93012a-81c2-4c13-be7f-16c468bf576f None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:17.726518 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93012a-81c2-4c13-be7f-16c468bf576f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:17.726824 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93012a-81c2-4c13-be7f-16c468bf576f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:17.728300 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93012a-81c2-4c13-be7f-16c468bf576f None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:17.739054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-eead6546-fed1-4f1b-a6de-644692d14ea4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:17.739054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:17.739054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:17.739054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:17.739054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:17.739054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:17.739054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:17.739054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:17.739054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:17.739054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:17.739054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:17.739054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:17.739054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:17.739054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:17.739054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:17.739054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:17.739995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:17.739995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:17.739995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:17.739995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:17.739995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:17.739995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:17.739995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:17.739995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:17.739995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:17.739995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:17.739995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:17.739995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:17.739995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:17.739995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:17.739995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:17.739995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:17.739995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:17.740904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:17.740904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:17.740904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:17.748391 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 289/532] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:17.748391 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead6546-fed1-4f1b-a6de-644692d14ea4 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:17.748620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 244/533] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:17.751922 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93012a-81c2-4c13-be7f-16c468bf576f None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:17.840729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:17.863266 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead6546-fed1-4f1b-a6de-644692d14ea4 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:17.888425 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93012a-81c2-4c13-be7f-16c468bf576f None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:17.901324 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc8740-7318-4e57-8b69-81c9048716cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:17.901717 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc8740-7318-4e57-8b69-81c9048716cb None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:17.902001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc8740-7318-4e57-8b69-81c9048716cb None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:17.902269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc8740-7318-4e57-8b69-81c9048716cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:17.910510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc8740-7318-4e57-8b69-81c9048716cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:17.911996 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc8740-7318-4e57-8b69-81c9048716cb None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:17.924636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-6dcc8740-7318-4e57-8b69-81c9048716cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:17.924636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:17.924636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:17.924636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:17.924636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:17.924636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:17.924636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:17.924636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:17.924636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:17.924636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:17.924636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:17.924636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:17.924636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:17.924636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:17.924636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:17.925513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:17.925513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:17.925513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:17.925513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:17.925513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:17.925513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:17.925513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:17.925513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:17.925513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:17.925513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:17.925513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:17.925513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:17.925513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:17.925513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:17.925513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:17.925513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:17.925513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:17.926383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:17.926383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:17.926383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:17.926383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:17.926383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:17.926383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:17.926383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:17.926383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:17.930524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 290/534] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:17.931524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc8740-7318-4e57-8b69-81c9048716cb None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:17.934394 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26d5bb-1325-489c-8a9e-1dbd5d8ebc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:17.935642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26d5bb-1325-489c-8a9e-1dbd5d8ebc39 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:17.936165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26d5bb-1325-489c-8a9e-1dbd5d8ebc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:17.936677 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26d5bb-1325-489c-8a9e-1dbd5d8ebc39 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:17.937554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26d5bb-1325-489c-8a9e-1dbd5d8ebc39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:17.938060 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26d5bb-1325-489c-8a9e-1dbd5d8ebc39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:17.939695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26d5bb-1325-489c-8a9e-1dbd5d8ebc39 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:17.954021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 245/535] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:17.959562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26d5bb-1325-489c-8a9e-1dbd5d8ebc39 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:17.978143 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:18.037576 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc8740-7318-4e57-8b69-81c9048716cb None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:18.062783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26d5bb-1325-489c-8a9e-1dbd5d8ebc39 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:18.072346 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02a53d-a5ab-4a88-97e0-8432b8376e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:18.072976 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02a53d-a5ab-4a88-97e0-8432b8376e03 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:18.073259 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02a53d-a5ab-4a88-97e0-8432b8376e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:18.073533 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02a53d-a5ab-4a88-97e0-8432b8376e03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:18.074247 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02a53d-a5ab-4a88-97e0-8432b8376e03 None admin] RBAC: Adding query filter params (role.id=2696068001744b38a289a59c56f56a95, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=edca8115256546ee8a209f1eca99d972) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:18.074550 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02a53d-a5ab-4a88-97e0-8432b8376e03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:18.076552 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02a53d-a5ab-4a88-97e0-8432b8376e03 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:18.088538 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 291/536] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:17:17 2022] GET /identity/v3/role_assignments?user.id=edca8115256546ee8a209f1eca99d972&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=2696068001744b38a289a59c56f56a95 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:18.088727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:18.089480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02a53d-a5ab-4a88-97e0-8432b8376e03 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:18.110331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975249d-b7a5-4846-971a-b16c616355d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:18.111330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975249d-b7a5-4846-971a-b16c616355d7 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:18.111876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975249d-b7a5-4846-971a-b16c616355d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:18.112428 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975249d-b7a5-4846-971a-b16c616355d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:18.113494 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975249d-b7a5-4846-971a-b16c616355d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:18.114052 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975249d-b7a5-4846-971a-b16c616355d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:18.116726 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975249d-b7a5-4846-971a-b16c616355d7 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:18.145082 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 246/537] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:18.151568 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975249d-b7a5-4846-971a-b16c616355d7 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:18.266219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975249d-b7a5-4846-971a-b16c616355d7 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:18.299241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02a53d-a5ab-4a88-97e0-8432b8376e03 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:18.301964 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:18.305125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f213883-d57a-4d22-8e78-8a15287c4a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:18.306039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f213883-d57a-4d22-8e78-8a15287c4a3c None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:18.306541 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f213883-d57a-4d22-8e78-8a15287c4a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:18.307023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f213883-d57a-4d22-8e78-8a15287c4a3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:18.307978 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f213883-d57a-4d22-8e78-8a15287c4a3c None admin] RBAC: Adding query filter params (role.id=2696068001744b38a289a59c56f56a95, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=e15cb1d012934ebeac53af885ca65f75) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:18.308516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f213883-d57a-4d22-8e78-8a15287c4a3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:18.310636 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f213883-d57a-4d22-8e78-8a15287c4a3c None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:18.317086 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 247/538] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:17:18 2022] GET /identity/v3/role_assignments?user.id=e15cb1d012934ebeac53af885ca65f75&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=2696068001744b38a289a59c56f56a95 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:18.362721 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b019b-8da4-46f1-b448-780e3694da23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:18.363420 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b019b-8da4-46f1-b448-780e3694da23 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:18.363705 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b019b-8da4-46f1-b448-780e3694da23 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:18.364033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b019b-8da4-46f1-b448-780e3694da23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:18.371852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b019b-8da4-46f1-b448-780e3694da23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:18.373917 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b019b-8da4-46f1-b448-780e3694da23 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:18.390135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-cd0b019b-8da4-46f1-b448-780e3694da23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:18.390135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:18.390135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:18.390135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:18.390135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:18.390135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:18.390135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:18.390135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:18.390135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:18.390135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:18.390135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:18.390135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:18.390135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:18.390135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:18.390135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:18.391034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:18.391034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:18.391034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:18.391034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:18.391034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:18.391034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:18.391034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:18.391034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:18.391034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:18.391034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:18.391034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:18.391034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:18.391034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:18.391034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:18.391034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:18.391034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:18.391034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:18.391892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:18.391892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:18.391892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:18.391892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:18.391892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:18.391892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:18.391892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:18.391892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:18.391892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 292/539] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:18.397512 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f213883-d57a-4d22-8e78-8a15287c4a3c None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:18.475420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:18.561052 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f213883-d57a-4d22-8e78-8a15287c4a3c None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:18.612161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72e5b1-050e-4aa8-9c02-b4d827415d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:18.612728 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72e5b1-050e-4aa8-9c02-b4d827415d87 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:18.613013 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72e5b1-050e-4aa8-9c02-b4d827415d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:18.613284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72e5b1-050e-4aa8-9c02-b4d827415d87 None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:18.613985 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72e5b1-050e-4aa8-9c02-b4d827415d87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:18.614296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72e5b1-050e-4aa8-9c02-b4d827415d87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:18.615758 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72e5b1-050e-4aa8-9c02-b4d827415d87 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:18.629333 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 248/540] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:18.634919 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b019b-8da4-46f1-b448-780e3694da23 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:18.766116 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b019b-8da4-46f1-b448-780e3694da23 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:18.819563 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bf009-cf6b-4a2b-97e7-162efc7db790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:18.820176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bf009-cf6b-4a2b-97e7-162efc7db790 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:18.820495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bf009-cf6b-4a2b-97e7-162efc7db790 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:18.820769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bf009-cf6b-4a2b-97e7-162efc7db790 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:18.821491 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bf009-cf6b-4a2b-97e7-162efc7db790 None admin] RBAC: Adding query filter params (role.id=2696068001744b38a289a59c56f56a95, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=758380280e33458f8f9112147d5a7819) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:18.821797 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bf009-cf6b-4a2b-97e7-162efc7db790 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:18.823230 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bf009-cf6b-4a2b-97e7-162efc7db790 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:18.830306 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 293/541] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:17:18 2022] GET /identity/v3/role_assignments?user.id=758380280e33458f8f9112147d5a7819&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=2696068001744b38a289a59c56f56a95 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:19.378491 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc313f-18eb-4603-bbd3-88c02df4e0c1 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:19.379092 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc313f-18eb-4603-bbd3-88c02df4e0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:19.379092 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc313f-18eb-4603-bbd3-88c02df4e0c1 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:19.380566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 294/542] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:19.381852 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4abef8-1e1f-4583-a168-b687a2b43f02 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:19.382223 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4abef8-1e1f-4583-a168-b687a2b43f02 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:19.382382 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4abef8-1e1f-4583-a168-b687a2b43f02 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:19.383687 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 249/543] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:19.386692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed1925-8b7e-4a11-8503-a3fe6216275c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:19.387206 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed1925-8b7e-4a11-8503-a3fe6216275c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:19.387693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed1925-8b7e-4a11-8503-a3fe6216275c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:19.390288 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58815c8-cc22-4afe-a652-e296758bc192 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:19.390574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58815c8-cc22-4afe-a652-e296758bc192 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:19.390855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58815c8-cc22-4afe-a652-e296758bc192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:19.417330 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-e9ed1925-8b7e-4a11-8503-a3fe6216275c None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:19.418757 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e9ed1925-8b7e-4a11-8503-a3fe6216275c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:19.425391 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-c58815c8-cc22-4afe-a652-e296758bc192 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:19.426556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c58815c8-cc22-4afe-a652-e296758bc192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:19.470480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:19.553478 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 250/544] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:17:19.555734 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 295/545] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:19.878060 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58815c8-cc22-4afe-a652-e296758bc192 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:19.909554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:19.976056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed1925-8b7e-4a11-8503-a3fe6216275c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:19.983858 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58815c8-cc22-4afe-a652-e296758bc192 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:20.020913 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8dbbf-671c-4a7c-ba12-7e9f1750d96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:20.021552 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8dbbf-671c-4a7c-ba12-7e9f1750d96f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:20.021830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8dbbf-671c-4a7c-ba12-7e9f1750d96f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:20.022104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8dbbf-671c-4a7c-ba12-7e9f1750d96f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:20.033397 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8dbbf-671c-4a7c-ba12-7e9f1750d96f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:20.038436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-17f8dbbf-671c-4a7c-ba12-7e9f1750d96f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:20.038436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:20.038436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:20.038436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:20.038436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:20.038436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:20.038436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:20.038436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:20.038436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:20.038436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:20.038436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:20.038436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:20.038436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:20.038436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:20.038436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:20.038436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:20.039327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:20.039327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:20.039327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:20.039327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:20.039327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:20.039327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:20.039327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:20.039327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:20.039327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:20.039327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:20.039327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:20.039327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:20.039327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:20.039327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:20.039327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:20.039327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:20.040122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:20.040122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:20.040122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:20.040122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:20.040122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:20.040122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:20.040122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:20.040122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:20.040122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:20.040122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:20.040122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:20.040122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:20.040122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 251/546] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:20.045630 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8dbbf-671c-4a7c-ba12-7e9f1750d96f None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:20.121310 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed1925-8b7e-4a11-8503-a3fe6216275c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:20.175338 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdab55a-54a4-4a05-899f-7e5cb32f9461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:20.175972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdab55a-54a4-4a05-899f-7e5cb32f9461 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:20.176260 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdab55a-54a4-4a05-899f-7e5cb32f9461 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:20.176554 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdab55a-54a4-4a05-899f-7e5cb32f9461 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:20.191240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdab55a-54a4-4a05-899f-7e5cb32f9461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:20.197048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-bfdab55a-54a4-4a05-899f-7e5cb32f9461 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:20.197048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:20.197048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:20.197048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:20.197048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:20.197048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:20.197048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:20.197048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:20.197048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:20.197048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:20.197048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:20.197048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:20.197048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:20.197048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:20.197048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:20.197048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:20.198022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:20.198022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:20.198022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:20.198022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:20.198022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:20.198022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:20.198022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:20.198022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:20.198022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:20.198022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:20.198022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:20.198022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:20.198022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:20.198022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:20.198022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:20.198022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:20.198818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:20.198818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:20.198818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:20.198818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:20.198818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:20.198818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:20.198818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:20.198818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:20.198818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:20.198818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:20.198818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:20.198818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:20.198818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 296/547] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:20.213446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdab55a-54a4-4a05-899f-7e5cb32f9461 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:20.223342 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:20.234961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:20.246366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8dbbf-671c-4a7c-ba12-7e9f1750d96f None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:20.318477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d43fc-eef2-4fde-8627-a8614dd33fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:20.319525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d43fc-eef2-4fde-8627-a8614dd33fae None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:20.321162 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d43fc-eef2-4fde-8627-a8614dd33fae None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:20.321661 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d43fc-eef2-4fde-8627-a8614dd33fae None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:20.322782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d43fc-eef2-4fde-8627-a8614dd33fae None admin] RBAC: Adding query filter params (name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:20.324352 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d43fc-eef2-4fde-8627-a8614dd33fae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:20.327130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d43fc-eef2-4fde-8627-a8614dd33fae None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:20.344205 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 252/548] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:17:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:20.349346 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d43fc-eef2-4fde-8627-a8614dd33fae None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:20.392250 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdab55a-54a4-4a05-899f-7e5cb32f9461 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:20.454012 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b68df8-852f-4b9b-a0b8-9184d5c77850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:20.455063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b68df8-852f-4b9b-a0b8-9184d5c77850 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:20.456262 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b68df8-852f-4b9b-a0b8-9184d5c77850 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:20.459377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b68df8-852f-4b9b-a0b8-9184d5c77850 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:20.460256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b68df8-852f-4b9b-a0b8-9184d5c77850 None admin] RBAC: Adding query filter params (name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:20.460804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b68df8-852f-4b9b-a0b8-9184d5c77850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:20.462398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b68df8-852f-4b9b-a0b8-9184d5c77850 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:20.484565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 297/549] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:17:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:20.489703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b68df8-852f-4b9b-a0b8-9184d5c77850 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:20.536844 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d43fc-eef2-4fde-8627-a8614dd33fae None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:20.572029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c18ad1-030e-4397-a1fc-2eee6441937b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:20.573090 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c18ad1-030e-4397-a1fc-2eee6441937b None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:20.573653 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c18ad1-030e-4397-a1fc-2eee6441937b None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:20.574132 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c18ad1-030e-4397-a1fc-2eee6441937b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:20.585172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c18ad1-030e-4397-a1fc-2eee6441937b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:20.586977 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c18ad1-030e-4397-a1fc-2eee6441937b None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:20.600781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:20.602616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-25c18ad1-030e-4397-a1fc-2eee6441937b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:20.602616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:20.602616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:20.602616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:20.602616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:20.602616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:20.602616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:20.602616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:20.602616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:20.602616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:20.602616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:20.602616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:20.602616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:20.602616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:20.602616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:20.602616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:20.603561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:20.603561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:20.603561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:20.603561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:20.603561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:20.603561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:20.603561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:20.603561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:20.603561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:20.603561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:20.603561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:20.603561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:20.603561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:20.603561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:20.603561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:20.603561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:20.603561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:20.604525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:20.604525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:20.604525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:20.606785 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 253/550] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:20.608739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d099af-e27f-4013-9388-5b017aff303e None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:20.609250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d099af-e27f-4013-9388-5b017aff303e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:20.609802 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d099af-e27f-4013-9388-5b017aff303e None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:20.611476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 254/551] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:20.613580 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d099af-e27f-4013-9388-5b017aff303e None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:20.615697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b68df8-852f-4b9b-a0b8-9184d5c77850 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:20.642757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:20.656207 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16add4-d976-4bb0-b88a-7764f956fd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:20.657161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16add4-d976-4bb0-b88a-7764f956fd07 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:20.657537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16add4-d976-4bb0-b88a-7764f956fd07 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:20.657878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16add4-d976-4bb0-b88a-7764f956fd07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:20.670192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16add4-d976-4bb0-b88a-7764f956fd07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:20.671777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16add4-d976-4bb0-b88a-7764f956fd07 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:20.688592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-ff16add4-d976-4bb0-b88a-7764f956fd07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:20.688592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:20.688592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:20.688592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:20.688592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:20.688592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:20.688592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:20.688592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:20.688592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:20.688592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:20.688592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:20.688592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:20.688592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:20.688592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:20.688592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:20.688592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:20.689807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:20.689807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:20.689807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:20.689807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:20.689807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:20.689807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:20.689807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:20.689807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:20.689807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:20.689807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:20.689807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:20.689807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:20.689807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:20.689807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:20.689807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:20.689807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:20.689807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:20.690892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:20.690892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:20.690892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:20.696417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 298/552] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:20.696417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc320a5-4373-4e4f-9658-d906001f5045 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:20.696417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc320a5-4373-4e4f-9658-d906001f5045 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:20.696417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc320a5-4373-4e4f-9658-d906001f5045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:20.715802 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ddc320a5-4373-4e4f-9658-d906001f5045 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:20.718333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ddc320a5-4373-4e4f-9658-d906001f5045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:20.745296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d099af-e27f-4013-9388-5b017aff303e None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:20.789170 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89c638-6cc4-4a03-a569-bbdd4e940c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:20.790407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89c638-6cc4-4a03-a569-bbdd4e940c03 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:20.791234 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89c638-6cc4-4a03-a569-bbdd4e940c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:20.791961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89c638-6cc4-4a03-a569-bbdd4e940c03 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:20.792781 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89c638-6cc4-4a03-a569-bbdd4e940c03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:20.793253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89c638-6cc4-4a03-a569-bbdd4e940c03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:20.795231 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89c638-6cc4-4a03-a569-bbdd4e940c03 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:20.800843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 299/553] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:20.801708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc320a5-4373-4e4f-9658-d906001f5045 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:20.812180 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 255/554] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:20.825303 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89c638-6cc4-4a03-a569-bbdd4e940c03 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:20.873212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:20.914403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc320a5-4373-4e4f-9658-d906001f5045 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:20.957676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:20.963800 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575718c7-9c26-4656-ad90-686d5fce1195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:20.972365 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575718c7-9c26-4656-ad90-686d5fce1195 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:20.972365 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575718c7-9c26-4656-ad90-686d5fce1195 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:20.972365 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575718c7-9c26-4656-ad90-686d5fce1195 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:20.972365 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575718c7-9c26-4656-ad90-686d5fce1195 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:20.972365 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575718c7-9c26-4656-ad90-686d5fce1195 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:20.972365 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575718c7-9c26-4656-ad90-686d5fce1195 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:20.981653 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 300/555] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:20.988066 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575718c7-9c26-4656-ad90-686d5fce1195 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:21.020046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89c638-6cc4-4a03-a569-bbdd4e940c03 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:21.093013 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e62ace-237a-4b10-96e8-d1cc55b867bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:21.094593 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e62ace-237a-4b10-96e8-d1cc55b867bf None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:21.094869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e62ace-237a-4b10-96e8-d1cc55b867bf None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:21.095138 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e62ace-237a-4b10-96e8-d1cc55b867bf None admin] PATH_INFO: `/v3/users/swift` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:21.109898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e62ace-237a-4b10-96e8-d1cc55b867bf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:21.111363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e62ace-237a-4b10-96e8-d1cc55b867bf None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:21.125424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-83e62ace-237a-4b10-96e8-d1cc55b867bf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 16:17:21.125424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:21.125424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:21.125424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:21.125424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:21.125424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:21.125424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:21.125424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:21.125424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:21.125424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:21.125424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:21.125424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:21.125424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:21.125424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:21.125424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:21.125424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:21.126434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:21.126434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:21.126434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:21.126434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:21.126434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:21.126434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:21.126434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:21.126434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:21.126434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:21.126434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:21.126434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:21.126434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:21.126434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:21.126434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:21.126434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:21.126434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:21.126434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:21.126434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:21.127477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:21.127477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:21.127477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:21.127477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:21.127477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:21.127477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:21.127477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:21.127477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:21.127477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 27 16:17:21.127477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:21.134315 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575718c7-9c26-4656-ad90-686d5fce1195 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:21.134618 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 256/556] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:17:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:21.136077 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d68ee3-119c-4822-a893-684c79d22630 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:21.136595 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d68ee3-119c-4822-a893-684c79d22630 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:21.137089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d68ee3-119c-4822-a893-684c79d22630 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:21.142813 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 257/557] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:21.143797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d68ee3-119c-4822-a893-684c79d22630 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:21.160856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:21.170589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4319d-8283-46f1-bfae-2c0c3d2fff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:21.171158 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4319d-8283-46f1-bfae-2c0c3d2fff20 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:21.171441 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4319d-8283-46f1-bfae-2c0c3d2fff20 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:21.171714 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4319d-8283-46f1-bfae-2c0c3d2fff20 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:21.180311 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4319d-8283-46f1-bfae-2c0c3d2fff20 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:21.181947 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4319d-8283-46f1-bfae-2c0c3d2fff20 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:21.193912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-dac4319d-8283-46f1-bfae-2c0c3d2fff20 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 16:17:21.193912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:21.193912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:21.193912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:21.193912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:21.193912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:21.193912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:21.193912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:21.193912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:21.193912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:21.193912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:21.193912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:21.193912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:21.193912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:21.193912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:21.193912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:21.195707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:21.195707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:21.195707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:21.195707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:21.195707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:21.195707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:21.195707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:21.195707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:21.195707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:21.195707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:21.195707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:21.195707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:21.195707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:21.195707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:21.195707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:21.195707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:21.195707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:21.195707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:21.196718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:21.196718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:21.196718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:21.196718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:21.196718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:21.196718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:21.196718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:21.196718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:21.196718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 16:17:21.196718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:21.196718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 301/558] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Sep 27 16:17:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:21.201069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9155a-f3c9-42d2-81f0-36b97e0a2d4e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:21.202825 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9155a-f3c9-42d2-81f0-36b97e0a2d4e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:21.203115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9155a-f3c9-42d2-81f0-36b97e0a2d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:21.222086 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-76a9155a-f3c9-42d2-81f0-36b97e0a2d4e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:21.223276 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-76a9155a-f3c9-42d2-81f0-36b97e0a2d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:21.262490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d68ee3-119c-4822-a893-684c79d22630 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:21.286989 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:21.293052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 302/559] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:21.293797 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9155a-f3c9-42d2-81f0-36b97e0a2d4e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:21.306453 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374966c-f32a-4638-8e02-9a34d4e29c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:21.307678 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374966c-f32a-4638-8e02-9a34d4e29c10 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:21.308136 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374966c-f32a-4638-8e02-9a34d4e29c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:21.308879 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374966c-f32a-4638-8e02-9a34d4e29c10 None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:21.310811 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374966c-f32a-4638-8e02-9a34d4e29c10 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:21.312752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374966c-f32a-4638-8e02-9a34d4e29c10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:21.313812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374966c-f32a-4638-8e02-9a34d4e29c10 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:21.337670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 258/560] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Sep 27 16:17:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:21.339550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374966c-f32a-4638-8e02-9a34d4e29c10 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:21.441546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9155a-f3c9-42d2-81f0-36b97e0a2d4e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:21.460226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:21.463413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374966c-f32a-4638-8e02-9a34d4e29c10 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:21.485555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d04a25-83ba-47e0-a736-506d71a38606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:21.486762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d04a25-83ba-47e0-a736-506d71a38606 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:21.487131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d04a25-83ba-47e0-a736-506d71a38606 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:21.487488 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d04a25-83ba-47e0-a736-506d71a38606 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:21.504585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d04a25-83ba-47e0-a736-506d71a38606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:21.510424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606843c4-b6ab-4357-bee1-8dfc23c20c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:21.510683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-f9d04a25-83ba-47e0-a736-506d71a38606 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:21.510683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:21.510683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:21.510683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:21.510683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:21.510683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:21.510683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:21.510683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:21.510683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:21.510683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:21.510683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:21.510683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:21.510683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:21.510683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:21.510683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:21.510683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:21.511579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:21.511579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:21.511579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:21.511579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:21.511579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:21.511579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:21.511579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:21.511579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:21.511579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:21.511579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:21.511579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:21.511579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:21.511579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:21.511579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:21.511579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:21.511579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:21.512467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:21.512467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:21.512467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:21.512467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:21.512467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:21.512467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:21.512467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:21.512467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:21.512467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:21.512467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:21.512467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:21.512467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:21.515182 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606843c4-b6ab-4357-bee1-8dfc23c20c0a None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:21.515639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606843c4-b6ab-4357-bee1-8dfc23c20c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:21.516081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606843c4-b6ab-4357-bee1-8dfc23c20c0a None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:21.516673 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 303/561] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:21.517263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606843c4-b6ab-4357-bee1-8dfc23c20c0a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:21.517754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606843c4-b6ab-4357-bee1-8dfc23c20c0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:21.517855 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d04a25-83ba-47e0-a736-506d71a38606 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:21.519554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606843c4-b6ab-4357-bee1-8dfc23c20c0a None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:21.545098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 259/562] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Sep 27 16:17:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:21.547283 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606843c4-b6ab-4357-bee1-8dfc23c20c0a None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:21.601535 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:21.634671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d04a25-83ba-47e0-a736-506d71a38606 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:21.658478 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606843c4-b6ab-4357-bee1-8dfc23c20c0a None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:21.668503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8592a3-0723-4835-b7d2-f83aabe1c504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:21.669112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8592a3-0723-4835-b7d2-f83aabe1c504 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:21.669671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8592a3-0723-4835-b7d2-f83aabe1c504 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:21.669951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8592a3-0723-4835-b7d2-f83aabe1c504 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:21.691961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fccb1-dd93-4f49-9703-45c2a964b4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:21.692553 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fccb1-dd93-4f49-9703-45c2a964b4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:21.692853 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fccb1-dd93-4f49-9703-45c2a964b4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:21.693125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fccb1-dd93-4f49-9703-45c2a964b4a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:21.693779 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fccb1-dd93-4f49-9703-45c2a964b4a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:21.694079 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fccb1-dd93-4f49-9703-45c2a964b4a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:21.695433 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fccb1-dd93-4f49-9703-45c2a964b4a9 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:21.703323 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 260/563] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:17:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:21.704111 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fccb1-dd93-4f49-9703-45c2a964b4a9 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:21.710566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:21.736644 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8592a3-0723-4835-b7d2-f83aabe1c504 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:21.738089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8592a3-0723-4835-b7d2-f83aabe1c504 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:21.803920 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fccb1-dd93-4f49-9703-45c2a964b4a9 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:21.805521 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:21.838246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d62a4-5165-401b-91b5-0a7422ab1778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:21.838886 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d62a4-5165-401b-91b5-0a7422ab1778 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:21.839455 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d62a4-5165-401b-91b5-0a7422ab1778 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:21.839726 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d62a4-5165-401b-91b5-0a7422ab1778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:21.839954 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 304/564] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:17:21.840826 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8592a3-0723-4835-b7d2-f83aabe1c504 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:21.853538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d62a4-5165-401b-91b5-0a7422ab1778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:21.854980 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d62a4-5165-401b-91b5-0a7422ab1778 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:21.869175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-592d62a4-5165-401b-91b5-0a7422ab1778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:21.869175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:21.869175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:21.869175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:21.869175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:21.869175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:21.869175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:21.869175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:21.869175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:21.869175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:21.869175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:21.869175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:21.869175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:21.869175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:21.869175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:21.869175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:21.870307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:21.870307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:21.870307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:21.870307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:21.870307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:21.870307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:21.870307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:21.870307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:21.870307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:21.870307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:21.870307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:21.870307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:21.870307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:21.870307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:21.870307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:21.870307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:21.870307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:21.871206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:21.871206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:21.871206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:21.871206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 261/565] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:21.871561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd35d4-4be8-4940-9eef-ae6ab3d4157c None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:21.871795 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd35d4-4be8-4940-9eef-ae6ab3d4157c None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:21.872063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd35d4-4be8-4940-9eef-ae6ab3d4157c None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:21.876374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 262/566] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:21.876374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd35d4-4be8-4940-9eef-ae6ab3d4157c None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:21.912124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:21.942281 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8592a3-0723-4835-b7d2-f83aabe1c504 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:21.974103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd35d4-4be8-4940-9eef-ae6ab3d4157c None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:21.974364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82306f-baee-4fe5-bf26-cdcce8522f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:21.974985 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82306f-baee-4fe5-bf26-cdcce8522f74 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:21.975256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82306f-baee-4fe5-bf26-cdcce8522f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:21.975522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82306f-baee-4fe5-bf26-cdcce8522f74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:21.985642 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82306f-baee-4fe5-bf26-cdcce8522f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:21.990350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-8c82306f-baee-4fe5-bf26-cdcce8522f74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:21.990350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:21.990350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:21.990350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:21.990350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:21.990350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:21.990350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:21.990350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:21.990350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:21.990350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:21.990350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:21.990350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:21.990350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:21.990350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:21.990350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:21.990350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:21.991448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:21.991448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:21.991448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:21.991448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:21.991448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:21.991448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:21.991448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:21.991448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:21.991448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:21.991448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:21.991448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:21.991448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:21.991448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:21.991448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:21.991448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:21.991448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:21.992293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:21.992293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:21.992293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:21.992293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:21.992293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:21.992293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:21.992293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:21.992293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:21.992293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:21.992293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:21.992293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:21.992293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:21.992293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 305/567] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:21.992293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82306f-baee-4fe5-bf26-cdcce8522f74 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:22.010479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc5557-d56c-4d9b-9ec6-556d6c01ac72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:22.011104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc5557-d56c-4d9b-9ec6-556d6c01ac72 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:22.011381 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc5557-d56c-4d9b-9ec6-556d6c01ac72 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:22.011654 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc5557-d56c-4d9b-9ec6-556d6c01ac72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:22.022133 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc5557-d56c-4d9b-9ec6-556d6c01ac72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:22.023567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc5557-d56c-4d9b-9ec6-556d6c01ac72 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:22.037485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-a4dc5557-d56c-4d9b-9ec6-556d6c01ac72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:22.037485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:22.037485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:22.037485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:22.037485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:22.037485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:22.037485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:22.037485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:22.037485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:22.037485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:22.037485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:22.037485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:22.037485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:22.037485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:22.037485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:22.037485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:22.038598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:22.038598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:22.038598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:22.038598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:22.038598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:22.038598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:22.038598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:22.038598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:22.038598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:22.038598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:22.038598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:22.038598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:22.038598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:22.038598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:22.038598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:22.038598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:22.038598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:22.039534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:22.039534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:22.039534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:22.039534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 263/568] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:22.039534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc5557-d56c-4d9b-9ec6-556d6c01ac72 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:22.048591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:22.094201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82306f-baee-4fe5-bf26-cdcce8522f74 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:22.124009 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:22.128896 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05b176-c791-44e2-acc8-07cd6beb9d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:22.129517 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05b176-c791-44e2-acc8-07cd6beb9d1b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:22.129819 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05b176-c791-44e2-acc8-07cd6beb9d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:22.130091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05b176-c791-44e2-acc8-07cd6beb9d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:22.139416 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc5557-d56c-4d9b-9ec6-556d6c01ac72 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:22.140573 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05b176-c791-44e2-acc8-07cd6beb9d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:22.142011 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05b176-c791-44e2-acc8-07cd6beb9d1b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:22.156115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-4b05b176-c791-44e2-acc8-07cd6beb9d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:22.156115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:22.156115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:22.156115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:22.156115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:22.156115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:22.156115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:22.156115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:22.156115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:22.156115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:22.156115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:22.156115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:22.156115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:22.156115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:22.156115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:22.156115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:22.157272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:22.157272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:22.157272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:22.157272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:22.157272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:22.157272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:22.157272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:22.157272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:22.157272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:22.157272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:22.157272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:22.157272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:22.157272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:22.157272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:22.157272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:22.157272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:22.157272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:22.158166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:22.158166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:22.158166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:22.158166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 306/569] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:22.158513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a77dc-8a53-40d7-b05a-ba3dcc60414b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:22.158959 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a77dc-8a53-40d7-b05a-ba3dcc60414b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:22.159480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a77dc-8a53-40d7-b05a-ba3dcc60414b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:22.175587 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3f8f7-b46d-43e8-bf10-7c6ed8bcfdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:22.176183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3f8f7-b46d-43e8-bf10-7c6ed8bcfdba None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:22.176488 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3f8f7-b46d-43e8-bf10-7c6ed8bcfdba None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:22.176760 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3f8f7-b46d-43e8-bf10-7c6ed8bcfdba None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:22.176931 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d14a77dc-8a53-40d7-b05a-ba3dcc60414b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:22.177388 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3f8f7-b46d-43e8-bf10-7c6ed8bcfdba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:22.177688 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3f8f7-b46d-43e8-bf10-7c6ed8bcfdba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:22.178133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d14a77dc-8a53-40d7-b05a-ba3dcc60414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:22.179043 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3f8f7-b46d-43e8-bf10-7c6ed8bcfdba None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:22.195128 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 264/570] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:22.195128 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3f8f7-b46d-43e8-bf10-7c6ed8bcfdba None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:22.244463 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 307/571] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:22.245310 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a77dc-8a53-40d7-b05a-ba3dcc60414b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:22.267670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:22.307029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3f8f7-b46d-43e8-bf10-7c6ed8bcfdba None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:22.343691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebd6f1-5565-49f2-b48a-38ee1c572556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:22.343999 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a77dc-8a53-40d7-b05a-ba3dcc60414b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:22.344300 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebd6f1-5565-49f2-b48a-38ee1c572556 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:22.344615 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebd6f1-5565-49f2-b48a-38ee1c572556 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:22.344890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebd6f1-5565-49f2-b48a-38ee1c572556 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:22.345672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebd6f1-5565-49f2-b48a-38ee1c572556 None admin] RBAC: Adding query filter params (name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:22.345977 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebd6f1-5565-49f2-b48a-38ee1c572556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:22.347460 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebd6f1-5565-49f2-b48a-38ee1c572556 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:22.360301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 265/572] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:17:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:22.360301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebd6f1-5565-49f2-b48a-38ee1c572556 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:22.362006 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:22.382629 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0beb788-ff74-4b3d-8c44-76405b4833ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:22.383307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0beb788-ff74-4b3d-8c44-76405b4833ce None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:22.383662 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0beb788-ff74-4b3d-8c44-76405b4833ce None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:22.383993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0beb788-ff74-4b3d-8c44-76405b4833ce None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:22.384836 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0beb788-ff74-4b3d-8c44-76405b4833ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:22.385198 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0beb788-ff74-4b3d-8c44-76405b4833ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:22.386554 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0beb788-ff74-4b3d-8c44-76405b4833ce None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:22.398579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 308/573] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:22.399362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0beb788-ff74-4b3d-8c44-76405b4833ce None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:22.466977 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebd6f1-5565-49f2-b48a-38ee1c572556 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:22.495239 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:22.503720 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9217d-3749-4ee3-af6f-967cc26d3ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:22.509655 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0beb788-ff74-4b3d-8c44-76405b4833ce None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:22.510124 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9217d-3749-4ee3-af6f-967cc26d3ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:22.510124 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9217d-3749-4ee3-af6f-967cc26d3ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:22.510124 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9217d-3749-4ee3-af6f-967cc26d3ca0 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:22.510124 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9217d-3749-4ee3-af6f-967cc26d3ca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:22.510124 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9217d-3749-4ee3-af6f-967cc26d3ca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:22.510124 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9217d-3749-4ee3-af6f-967cc26d3ca0 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:22.520383 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 266/574] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:22.521222 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9217d-3749-4ee3-af6f-967cc26d3ca0 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:22.540062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45ed3b-7430-4212-8b70-c98e944b365e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:22.540727 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45ed3b-7430-4212-8b70-c98e944b365e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:22.541003 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45ed3b-7430-4212-8b70-c98e944b365e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:22.541271 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45ed3b-7430-4212-8b70-c98e944b365e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:22.548655 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45ed3b-7430-4212-8b70-c98e944b365e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:22.550085 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45ed3b-7430-4212-8b70-c98e944b365e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:22.561425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-ab45ed3b-7430-4212-8b70-c98e944b365e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:22.561425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:22.561425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:22.561425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:22.561425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:22.561425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:22.561425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:22.561425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:22.561425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:22.561425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:22.561425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:22.561425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:22.561425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:22.561425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:22.561425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:22.562305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:22.562305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:22.562305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:22.562305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:22.562305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:22.562305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:22.562305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:22.562305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:22.562305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:22.562305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:22.562305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:22.562305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:22.562305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:22.562305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:22.562305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:22.562305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:22.562305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:22.563240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:22.563240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:22.563240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:22.563240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:22.563240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:22.563240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:22.563240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:22.563240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:22.563240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 309/575] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:22.563240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45ed3b-7430-4212-8b70-c98e944b365e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:22.596599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:22.622232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9217d-3749-4ee3-af6f-967cc26d3ca0 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:22.657125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af145d-4383-43ab-b21a-aaca93272b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:22.657751 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af145d-4383-43ab-b21a-aaca93272b09 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:22.658030 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af145d-4383-43ab-b21a-aaca93272b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:22.658307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af145d-4383-43ab-b21a-aaca93272b09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:22.661943 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45ed3b-7430-4212-8b70-c98e944b365e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:22.668309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af145d-4383-43ab-b21a-aaca93272b09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:22.670314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af145d-4383-43ab-b21a-aaca93272b09 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:22.684537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-67af145d-4383-43ab-b21a-aaca93272b09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:22.684537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:22.684537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:22.684537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:22.684537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:22.684537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:22.684537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:22.684537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:22.684537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:22.684537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:22.684537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:22.684537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:22.684537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:22.684537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:22.684537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:22.684537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:22.685597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:22.685597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:22.685597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:22.685597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:22.685597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:22.685597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:22.685597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:22.685597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:22.685597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:22.685597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:22.685597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:22.685597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:22.685597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:22.685597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:22.685597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:22.685597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:22.685597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:22.686510 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:22.686510 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:22.686510 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:22.686510 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 267/576] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:22.686510 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af145d-4383-43ab-b21a-aaca93272b09 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:22.698591 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911b75a-63a5-4518-9d36-0ac3cba402e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:22.699218 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911b75a-63a5-4518-9d36-0ac3cba402e5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:22.699494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911b75a-63a5-4518-9d36-0ac3cba402e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:22.699765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911b75a-63a5-4518-9d36-0ac3cba402e5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:22.707648 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911b75a-63a5-4518-9d36-0ac3cba402e5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:22.709113 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911b75a-63a5-4518-9d36-0ac3cba402e5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:22.720078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-8911b75a-63a5-4518-9d36-0ac3cba402e5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 16:17:22.720078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:22.720078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:22.720078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:22.720078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:22.720078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:22.720078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:22.720078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:22.720078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:22.720078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:22.720078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:22.720078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:22.720078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:22.720078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:22.720078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:22.720078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:22.721190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:22.721190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:22.721190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:22.721190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:22.721190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:22.721190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:22.721190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:22.721190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:22.721190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:22.721190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:22.721190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:22.721190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:22.721190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:22.721190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:22.721190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:22.721190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:22.721190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:22.721190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:22.722164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:22.722164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:22.722164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:22.722164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:22.722164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:22.722164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:22.722164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:22.722164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:22.722164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 16:17:22.722164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:22.722164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 310/577] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:17:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:22.722164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911b75a-63a5-4518-9d36-0ac3cba402e5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:22.729791 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:22.787309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af145d-4383-43ab-b21a-aaca93272b09 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:22.816668 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:22.820793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85eea3-9dee-4d0e-bda8-7ac86b6a5c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:22.821414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85eea3-9dee-4d0e-bda8-7ac86b6a5c71 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:22.821689 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85eea3-9dee-4d0e-bda8-7ac86b6a5c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:22.821962 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85eea3-9dee-4d0e-bda8-7ac86b6a5c71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:22.823436 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911b75a-63a5-4518-9d36-0ac3cba402e5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:22.832664 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85eea3-9dee-4d0e-bda8-7ac86b6a5c71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:22.837774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-bf85eea3-9dee-4d0e-bda8-7ac86b6a5c71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:22.837774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:22.837774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:22.837774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:22.837774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:22.837774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:22.837774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:22.837774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:22.837774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:22.837774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:22.837774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:22.837774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:22.837774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:22.837774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:22.837774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:22.837774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:22.838910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:22.838910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:22.838910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:22.838910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:22.838910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:22.838910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:22.838910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:22.838910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:22.838910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:22.838910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:22.838910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:22.838910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:22.838910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:22.838910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:22.838910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:22.838910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:22.841360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:22.841360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:22.841360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:22.841360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:22.841360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:22.841360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:22.841360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:22.841360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:22.841360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:22.841360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:22.841360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:22.841360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:22.841360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 268/578] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:22.841360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85eea3-9dee-4d0e-bda8-7ac86b6a5c71 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:22.860208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2725bd-1f19-411b-bc7f-b9a1a98f05c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:22.860867 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2725bd-1f19-411b-bc7f-b9a1a98f05c1 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:22.861147 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2725bd-1f19-411b-bc7f-b9a1a98f05c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:22.861428 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2725bd-1f19-411b-bc7f-b9a1a98f05c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:22.867832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2725bd-1f19-411b-bc7f-b9a1a98f05c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:22.869304 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2725bd-1f19-411b-bc7f-b9a1a98f05c1 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:22.880769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-6c2725bd-1f19-411b-bc7f-b9a1a98f05c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:22.880769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:22.880769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:22.880769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:22.880769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:22.880769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:22.880769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:22.880769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:22.880769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:22.880769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:22.880769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:22.880769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:22.880769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:22.880769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:22.880769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:22.881796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:22.881796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:22.881796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:22.881796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:22.881796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:22.881796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:22.881796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:22.881796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:22.881796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:22.881796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:22.881796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:22.881796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:22.881796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:22.881796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:22.881796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:22.881796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:22.881796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:22.882902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:22.882902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:22.882902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:22.882902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:22.882902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:22.882902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:22.882902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:22.882902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:22.882902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 311/579] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:22.882902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2725bd-1f19-411b-bc7f-b9a1a98f05c1 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:22.938550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:22.941490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85eea3-9dee-4d0e-bda8-7ac86b6a5c71 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:22.976575 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69a26a-a7e2-4201-b440-491669e9d86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:22.977103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69a26a-a7e2-4201-b440-491669e9d86c None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:22.977382 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69a26a-a7e2-4201-b440-491669e9d86c None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:22.977654 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69a26a-a7e2-4201-b440-491669e9d86c None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:22.978332 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69a26a-a7e2-4201-b440-491669e9d86c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:22.978635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69a26a-a7e2-4201-b440-491669e9d86c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:22.980057 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69a26a-a7e2-4201-b440-491669e9d86c None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:22.981526 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2725bd-1f19-411b-bc7f-b9a1a98f05c1 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:22.991632 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 269/580] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:22.992437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69a26a-a7e2-4201-b440-491669e9d86c None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:23.015704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d1c42-be1f-4e9f-a040-d21276b9c2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:23.016302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d1c42-be1f-4e9f-a040-d21276b9c2fd None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:23.016610 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d1c42-be1f-4e9f-a040-d21276b9c2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:23.016895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d1c42-be1f-4e9f-a040-d21276b9c2fd None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:23.017526 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d1c42-be1f-4e9f-a040-d21276b9c2fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:23.017832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d1c42-be1f-4e9f-a040-d21276b9c2fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:23.019303 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d1c42-be1f-4e9f-a040-d21276b9c2fd None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:23.030711 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 312/581] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:23.031491 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d1c42-be1f-4e9f-a040-d21276b9c2fd None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:23.046421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:23.088994 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69a26a-a7e2-4201-b440-491669e9d86c None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:23.123500 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283a280-59d2-4d31-8633-1389b4b4fd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:23.124103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283a280-59d2-4d31-8633-1389b4b4fd2b None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:23.124404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283a280-59d2-4d31-8633-1389b4b4fd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:23.124684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283a280-59d2-4d31-8633-1389b4b4fd2b None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:23.125394 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283a280-59d2-4d31-8633-1389b4b4fd2b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:23.125698 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283a280-59d2-4d31-8633-1389b4b4fd2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:23.127115 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283a280-59d2-4d31-8633-1389b4b4fd2b None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:23.129461 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d1c42-be1f-4e9f-a040-d21276b9c2fd None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:23.143572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 270/582] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Sep 27 16:17:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:23.144636 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283a280-59d2-4d31-8633-1389b4b4fd2b None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:23.163779 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:23.164075 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40cf7e-22dc-4058-a521-54ab06da016e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:23.164773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40cf7e-22dc-4058-a521-54ab06da016e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:23.164998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40cf7e-22dc-4058-a521-54ab06da016e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:23.165271 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40cf7e-22dc-4058-a521-54ab06da016e None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:23.166104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40cf7e-22dc-4058-a521-54ab06da016e None admin] RBAC: Adding query filter params (name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:23.166414 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40cf7e-22dc-4058-a521-54ab06da016e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:23.167787 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40cf7e-22dc-4058-a521-54ab06da016e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:23.175945 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 313/583] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:17:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:23.176780 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40cf7e-22dc-4058-a521-54ab06da016e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:23.248253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283a280-59d2-4d31-8633-1389b4b4fd2b None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:23.250677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:23.273117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40cf7e-22dc-4058-a521-54ab06da016e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:23.283182 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606f302-9bb9-490a-b163-2c9521426e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:23.283778 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606f302-9bb9-490a-b163-2c9521426e81 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:23.284076 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606f302-9bb9-490a-b163-2c9521426e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:23.284409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606f302-9bb9-490a-b163-2c9521426e81 None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:23.285090 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606f302-9bb9-490a-b163-2c9521426e81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:23.285394 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606f302-9bb9-490a-b163-2c9521426e81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:23.286821 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606f302-9bb9-490a-b163-2c9521426e81 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:23.298562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 271/584] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:23.299569 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606f302-9bb9-490a-b163-2c9521426e81 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:23.306172 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6229157-7c75-4508-b82c-782a2b5a4a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:23.306827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6229157-7c75-4508-b82c-782a2b5a4a39 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:23.307112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6229157-7c75-4508-b82c-782a2b5a4a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:23.307387 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6229157-7c75-4508-b82c-782a2b5a4a39 None admin] PATH_INFO: `/v3/projects/ad230723d90a439daf38443915c2282f/users/e71fea96b2b949f9abca12172e69284b/roles/2696068001744b38a289a59c56f56a95` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:23.321801 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6229157-7c75-4508-b82c-782a2b5a4a39 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad230723d90a439daf38443915c2282f, user_id=e71fea96b2b949f9abca12172e69284b, role_id=2696068001744b38a289a59c56f56a95)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:23.323229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6229157-7c75-4508-b82c-782a2b5a4a39 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:23.375182 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:23.395508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606f302-9bb9-490a-b163-2c9521426e81 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:23.427159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18b388-d3aa-41bb-9963-e1a646c1a373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:23.427779 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18b388-d3aa-41bb-9963-e1a646c1a373 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:23.427879 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 314/585] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:17:23 2022] PUT /identity/v3/projects/ad230723d90a439daf38443915c2282f/users/e71fea96b2b949f9abca12172e69284b/roles/2696068001744b38a289a59c56f56a95 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:17:23.428056 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18b388-d3aa-41bb-9963-e1a646c1a373 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:23.428404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18b388-d3aa-41bb-9963-e1a646c1a373 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:23.428737 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6229157-7c75-4508-b82c-782a2b5a4a39 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:23.439684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18b388-d3aa-41bb-9963-e1a646c1a373 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:23.441199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18b388-d3aa-41bb-9963-e1a646c1a373 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:23.454159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-ab18b388-d3aa-41bb-9963-e1a646c1a373 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 27 16:17:23.454159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:23.454159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:23.454159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:23.454159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:23.454159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:23.454159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:23.454159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:23.454159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:23.454159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:23.454159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:23.454159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:23.454159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:23.454159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:23.454159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:23.454159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:23.455258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:23.455258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:23.455258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:23.455258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:23.455258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:23.455258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:23.455258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:23.455258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:23.455258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:23.455258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:23.455258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:23.455258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:23.455258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:23.455258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:23.455258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:23.455258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:23.455258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:23.455258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:23.456354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:23.456354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:23.456354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:23.456354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:23.456354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:23.456354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:23.456354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:23.456354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:23.456354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 27 16:17:23.456354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:23.456354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 272/586] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:17:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:23.456354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18b388-d3aa-41bb-9963-e1a646c1a373 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:23.560853 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6229157-7c75-4508-b82c-782a2b5a4a39 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:23.568436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18b388-d3aa-41bb-9963-e1a646c1a373 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:23.590128 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:23.600524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f49ac8-f100-43b6-9b32-7868bc57e820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:23.607000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f49ac8-f100-43b6-9b32-7868bc57e820 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:23.607000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f49ac8-f100-43b6-9b32-7868bc57e820 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:23.607000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f49ac8-f100-43b6-9b32-7868bc57e820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:23.609655 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a391fc-3d76-4bb4-b366-6b9450a3908d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:23.610759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a391fc-3d76-4bb4-b366-6b9450a3908d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:23.611039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a391fc-3d76-4bb4-b366-6b9450a3908d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:23.611307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a391fc-3d76-4bb4-b366-6b9450a3908d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:23.614807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f49ac8-f100-43b6-9b32-7868bc57e820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:23.616274 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f49ac8-f100-43b6-9b32-7868bc57e820 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:23.619295 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:23.624623 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a391fc-3d76-4bb4-b366-6b9450a3908d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:23.626085 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a391fc-3d76-4bb4-b366-6b9450a3908d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:23.633056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-38f49ac8-f100-43b6-9b32-7868bc57e820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:23.633056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:23.633056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:23.633056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:23.633056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:23.633056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:23.633056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:23.633056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:23.633056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:23.633056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:23.633056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:23.633056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:23.633056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:23.633056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:23.633056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:23.633056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:23.645174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:23.645174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:23.645174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:23.645174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:23.645174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:23.645174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:23.645174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:23.645174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:23.645174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:23.645174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:23.645174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:23.645174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:23.645174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:23.645174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:23.645174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:23.645174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:23.645174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:23.646083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:23.646083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:23.646083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:23.646083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 315/587] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:23.646083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f49ac8-f100-43b6-9b32-7868bc57e820 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:23.646374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-a1a391fc-3d76-4bb4-b366-6b9450a3908d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:23.646374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:23.646374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:23.646374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:23.646374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:23.646374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:23.646374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:23.646374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:23.646374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:23.646374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:23.646374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:23.646374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:23.646374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:23.646374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:23.646374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:23.646374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:23.647199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:23.647199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:23.647199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:23.647199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:23.647199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:23.647199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:23.647199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:23.647199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:23.647199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:23.647199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:23.647199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:23.647199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:23.647199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:23.647199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:23.647199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:23.647199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:23.647199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:23.648072 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:23.648072 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:23.648072 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:23.648072 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 273/588] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:23.648072 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a391fc-3d76-4bb4-b366-6b9450a3908d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:23.743458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f49ac8-f100-43b6-9b32-7868bc57e820 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:23.756901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a391fc-3d76-4bb4-b366-6b9450a3908d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:23.777828 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5915bbb-8207-46d6-abd1-60e3ad1498e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:23.778431 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5915bbb-8207-46d6-abd1-60e3ad1498e0 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:23.778739 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5915bbb-8207-46d6-abd1-60e3ad1498e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:23.779013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5915bbb-8207-46d6-abd1-60e3ad1498e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:23.779724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5915bbb-8207-46d6-abd1-60e3ad1498e0 None admin] RBAC: Adding query filter params (role.id=2696068001744b38a289a59c56f56a95, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=e70b85e430004a8b865622354c1d1ed4) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:23.780028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5915bbb-8207-46d6-abd1-60e3ad1498e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:23.781496 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5915bbb-8207-46d6-abd1-60e3ad1498e0 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:23.790165 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 316/589] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:17:23 2022] GET /identity/v3/role_assignments?user.id=e70b85e430004a8b865622354c1d1ed4&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=2696068001744b38a289a59c56f56a95 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:23.790931 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5915bbb-8207-46d6-abd1-60e3ad1498e0 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:23.808902 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36491f6-8219-4c40-b205-b954c8614cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:23.810677 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36491f6-8219-4c40-b205-b954c8614cea None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:23.811265 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36491f6-8219-4c40-b205-b954c8614cea None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:23.811797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36491f6-8219-4c40-b205-b954c8614cea None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:23.812900 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36491f6-8219-4c40-b205-b954c8614cea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:23.813430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36491f6-8219-4c40-b205-b954c8614cea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:23.815611 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36491f6-8219-4c40-b205-b954c8614cea None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:23.837865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 274/590] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Sep 27 16:17:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:23.839182 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36491f6-8219-4c40-b205-b954c8614cea None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:23.854836 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:23.897474 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:23.941850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5915bbb-8207-46d6-abd1-60e3ad1498e0 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:23.965934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36491f6-8219-4c40-b205-b954c8614cea None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:23.989270 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc13be2-4d9c-43c1-95f6-b07a1a8e0cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:23.989885 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc13be2-4d9c-43c1-95f6-b07a1a8e0cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:23.990164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc13be2-4d9c-43c1-95f6-b07a1a8e0cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:23.990437 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc13be2-4d9c-43c1-95f6-b07a1a8e0cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:23.991079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc13be2-4d9c-43c1-95f6-b07a1a8e0cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:23.991937 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc13be2-4d9c-43c1-95f6-b07a1a8e0cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:23.993665 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc13be2-4d9c-43c1-95f6-b07a1a8e0cf4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:24.006725 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7914ca5-934f-4bd6-9c16-da3c36103b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:24.007336 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7914ca5-934f-4bd6-9c16-da3c36103b0d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:24.007618 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7914ca5-934f-4bd6-9c16-da3c36103b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:24.007893 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7914ca5-934f-4bd6-9c16-da3c36103b0d None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:24.008588 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7914ca5-934f-4bd6-9c16-da3c36103b0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:24.008901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7914ca5-934f-4bd6-9c16-da3c36103b0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:24.010371 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7914ca5-934f-4bd6-9c16-da3c36103b0d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:24.012904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 317/591] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:24.014391 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc13be2-4d9c-43c1-95f6-b07a1a8e0cf4 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:24.027866 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 275/592] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:24.028763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7914ca5-934f-4bd6-9c16-da3c36103b0d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:24.139487 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc13be2-4d9c-43c1-95f6-b07a1a8e0cf4 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:24.142273 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:24.144451 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7914ca5-934f-4bd6-9c16-da3c36103b0d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:24.154206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:24.185478 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdd1b9-e423-45ca-8d4c-dd4316aeee9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:24.186219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdd1b9-e423-45ca-8d4c-dd4316aeee9b None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:24.186621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdd1b9-e423-45ca-8d4c-dd4316aeee9b None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:24.187037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdd1b9-e423-45ca-8d4c-dd4316aeee9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:24.187635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce41c9a-6288-48ed-aed0-9feb3c906bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:24.188490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce41c9a-6288-48ed-aed0-9feb3c906bcd None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:24.189115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce41c9a-6288-48ed-aed0-9feb3c906bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:24.189558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce41c9a-6288-48ed-aed0-9feb3c906bcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:24.194462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bdd1b9-e423-45ca-8d4c-dd4316aeee9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:24.195998 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bdd1b9-e423-45ca-8d4c-dd4316aeee9b None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:24.201994 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce41c9a-6288-48ed-aed0-9feb3c906bcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:24.203997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce41c9a-6288-48ed-aed0-9feb3c906bcd None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:24.208830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-c2bdd1b9-e423-45ca-8d4c-dd4316aeee9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:24.208830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:24.208830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:24.208830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:24.208830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:24.208830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:24.208830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:24.208830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:24.208830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:24.208830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:24.208830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:24.208830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:24.208830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:24.208830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:24.208830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:24.209739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:24.209739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:24.209739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:24.209739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:24.209739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:24.209739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:24.209739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:24.209739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:24.209739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:24.209739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:24.209739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:24.209739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:24.209739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:24.209739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:24.209739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:24.209739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:24.209739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:24.210894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:24.210894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:24.210894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:24.210894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:24.210894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:24.210894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:24.210894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:24.210894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:24.210894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 276/593] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:24.212181 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdd1b9-e423-45ca-8d4c-dd4316aeee9b None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:24.225991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-cce41c9a-6288-48ed-aed0-9feb3c906bcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:24.225991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:24.225991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:24.225991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:24.225991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:24.225991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:24.225991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:24.225991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:24.225991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:24.225991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:24.225991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:24.225991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:24.225991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:24.225991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:24.225991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:24.225991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:24.227185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:24.227185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:24.227185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:24.227185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:24.227185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:24.227185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:24.227185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:24.227185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:24.227185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:24.227185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:24.227185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:24.227185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:24.227185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:24.227185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:24.227185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:24.227185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:24.227185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:24.228304 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:24.228304 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:24.228304 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:24.231121 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 318/594] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:24.233004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce41c9a-6288-48ed-aed0-9feb3c906bcd None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:24.328610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdd1b9-e423-45ca-8d4c-dd4316aeee9b None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:24.367858 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32ec23-31d1-443c-b650-5e5cebf5ef4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:24.368740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32ec23-31d1-443c-b650-5e5cebf5ef4f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:24.369130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32ec23-31d1-443c-b650-5e5cebf5ef4f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:24.369506 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32ec23-31d1-443c-b650-5e5cebf5ef4f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:24.371009 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce41c9a-6288-48ed-aed0-9feb3c906bcd None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:24.377941 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32ec23-31d1-443c-b650-5e5cebf5ef4f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:24.379835 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32ec23-31d1-443c-b650-5e5cebf5ef4f None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:24.391524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-7c32ec23-31d1-443c-b650-5e5cebf5ef4f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 16:17:24.391524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:24.391524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:24.391524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:24.391524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:24.391524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:24.391524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:24.391524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:24.391524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:24.391524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:24.391524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:24.391524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:24.391524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:24.391524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:24.391524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:24.391524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:24.392730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:24.392730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:24.392730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:24.392730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:24.392730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:24.392730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:24.392730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:24.392730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:24.392730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:24.392730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:24.392730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:24.392730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:24.392730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:24.392730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:24.392730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:24.392730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:24.392730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:24.392730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:24.393933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:24.393933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:24.393933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:24.393933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:24.393933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:24.393933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:24.393933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:24.393933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:24.393933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 16:17:24.393933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:24.395605 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 277/595] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:24.396806 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32ec23-31d1-443c-b650-5e5cebf5ef4f None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:24.416401 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ddd1a-02e9-4283-b78f-d76f149012ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:24.417265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ddd1a-02e9-4283-b78f-d76f149012ba None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:24.418104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ddd1a-02e9-4283-b78f-d76f149012ba None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:24.418530 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ddd1a-02e9-4283-b78f-d76f149012ba None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:24.420170 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ddd1a-02e9-4283-b78f-d76f149012ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:24.420659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ddd1a-02e9-4283-b78f-d76f149012ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:24.422935 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ddd1a-02e9-4283-b78f-d76f149012ba None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:24.428800 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:24.449752 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 319/596] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:24.450896 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ddd1a-02e9-4283-b78f-d76f149012ba None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:24.484765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:24.522518 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32ec23-31d1-443c-b650-5e5cebf5ef4f None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:24.558817 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f4c47-467b-454e-983c-d8774ab47a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:24.559528 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f4c47-467b-454e-983c-d8774ab47a62 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:24.560435 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f4c47-467b-454e-983c-d8774ab47a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:24.560800 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f4c47-467b-454e-983c-d8774ab47a62 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:24.561515 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f4c47-467b-454e-983c-d8774ab47a62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:24.561894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f4c47-467b-454e-983c-d8774ab47a62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:24.563343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f4c47-467b-454e-983c-d8774ab47a62 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:24.576935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 278/597] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:24.577906 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f4c47-467b-454e-983c-d8774ab47a62 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:24.591035 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ddd1a-02e9-4283-b78f-d76f149012ba None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:24.638584 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad0881-3a2f-4a19-9e62-04e44f3c532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:24.639562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad0881-3a2f-4a19-9e62-04e44f3c532b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:24.639909 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad0881-3a2f-4a19-9e62-04e44f3c532b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:24.640678 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad0881-3a2f-4a19-9e62-04e44f3c532b None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:24.641790 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad0881-3a2f-4a19-9e62-04e44f3c532b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:24.642110 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad0881-3a2f-4a19-9e62-04e44f3c532b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:24.644258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad0881-3a2f-4a19-9e62-04e44f3c532b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:24.667526 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 320/598] 10.222.0.26 () {56 vars in 1139 bytes} [Tue Sep 27 16:17:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:24.668754 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad0881-3a2f-4a19-9e62-04e44f3c532b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:24.674715 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:24.686921 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f4c47-467b-454e-983c-d8774ab47a62 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:24.722699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813ee69-a646-49d6-bd3e-0e5afacd61f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:24.723369 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813ee69-a646-49d6-bd3e-0e5afacd61f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:24.723644 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813ee69-a646-49d6-bd3e-0e5afacd61f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:24.723913 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813ee69-a646-49d6-bd3e-0e5afacd61f2 None admin] PATH_INFO: `/v3/projects/ad230723d90a439daf38443915c2282f/users/edca8115256546ee8a209f1eca99d972/roles/2696068001744b38a289a59c56f56a95` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:24.740498 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813ee69-a646-49d6-bd3e-0e5afacd61f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad230723d90a439daf38443915c2282f, user_id=edca8115256546ee8a209f1eca99d972, role_id=2696068001744b38a289a59c56f56a95)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:24.742011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813ee69-a646-49d6-bd3e-0e5afacd61f2 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:24.761192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:24.792846 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad0881-3a2f-4a19-9e62-04e44f3c532b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:24.827128 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65de27-a361-4876-99aa-2545ab76c2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:24.827740 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65de27-a361-4876-99aa-2545ab76c2be None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:24.828015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65de27-a361-4876-99aa-2545ab76c2be None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:24.828288 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65de27-a361-4876-99aa-2545ab76c2be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:24.834740 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65de27-a361-4876-99aa-2545ab76c2be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:24.836172 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65de27-a361-4876-99aa-2545ab76c2be None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:24.850925 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 279/599] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:17:24 2022] PUT /identity/v3/projects/ad230723d90a439daf38443915c2282f/users/edca8115256546ee8a209f1eca99d972/roles/2696068001744b38a289a59c56f56a95 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:17:24.851293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-3e65de27-a361-4876-99aa-2545ab76c2be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:24.851293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:24.851293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:24.851293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:24.851293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:24.851293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:24.851293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:24.851293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:24.851293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:24.851293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:24.851293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:24.851293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:24.851293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:24.851293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:24.851293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:24.852191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:24.852191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:24.852191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:24.852191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:24.852191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:24.852191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:24.852191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:24.852191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:24.852191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:24.852191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:24.852191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:24.852191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:24.852191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:24.852191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:24.852191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:24.852191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:24.852191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:24.853222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:24.853222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:24.853222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:24.853222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:24.853222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:24.853222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:24.853222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:24.853222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:24.853673 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813ee69-a646-49d6-bd3e-0e5afacd61f2 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:24.856277 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 321/600] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:24.862913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65de27-a361-4876-99aa-2545ab76c2be None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:24.991386 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65de27-a361-4876-99aa-2545ab76c2be None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:25.027718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:25.034349 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6535d5c-5f1b-452c-bb3f-e826eb2ed63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:25.034978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6535d5c-5f1b-452c-bb3f-e826eb2ed63b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:25.035411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6535d5c-5f1b-452c-bb3f-e826eb2ed63b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:25.035691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6535d5c-5f1b-452c-bb3f-e826eb2ed63b None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:25.036432 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6535d5c-5f1b-452c-bb3f-e826eb2ed63b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:25.036885 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6535d5c-5f1b-452c-bb3f-e826eb2ed63b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:25.038671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6535d5c-5f1b-452c-bb3f-e826eb2ed63b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:25.055620 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 322/601] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:25.061716 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6535d5c-5f1b-452c-bb3f-e826eb2ed63b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:25.107345 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813ee69-a646-49d6-bd3e-0e5afacd61f2 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:25.145680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63bf45-67b5-4c0b-95b2-87081a993739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:25.146482 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63bf45-67b5-4c0b-95b2-87081a993739 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:25.147269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63bf45-67b5-4c0b-95b2-87081a993739 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:25.147558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63bf45-67b5-4c0b-95b2-87081a993739 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:25.156533 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:25.163226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63bf45-67b5-4c0b-95b2-87081a993739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:25.168757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63bf45-67b5-4c0b-95b2-87081a993739 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:25.194141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-3c63bf45-67b5-4c0b-95b2-87081a993739 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:25.194141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:25.194141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:25.194141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:25.194141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:25.194141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:25.194141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:25.194141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:25.194141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:25.194141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:25.194141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:25.194141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:25.194141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:25.194141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:25.194141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:25.194141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:25.196438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:25.196438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:25.196438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:25.196438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:25.196438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:25.196438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:25.196438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:25.196438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:25.196438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:25.196438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:25.196438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:25.196438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:25.196438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:25.196438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:25.196438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:25.196438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:25.196438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:25.198540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:25.198540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:25.198540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:25.202168 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 280/602] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:25.204290 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6535d5c-5f1b-452c-bb3f-e826eb2ed63b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:25.207969 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63bf45-67b5-4c0b-95b2-87081a993739 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:25.281679 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a95a7-cbab-4dcf-95c2-0ee5b9139fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:25.282269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a95a7-cbab-4dcf-95c2-0ee5b9139fa9 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:25.282546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a95a7-cbab-4dcf-95c2-0ee5b9139fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:25.282818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a95a7-cbab-4dcf-95c2-0ee5b9139fa9 None admin] PATH_INFO: `/v3/projects/ad230723d90a439daf38443915c2282f/users/e15cb1d012934ebeac53af885ca65f75/roles/2696068001744b38a289a59c56f56a95` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:25.303549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a95a7-cbab-4dcf-95c2-0ee5b9139fa9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad230723d90a439daf38443915c2282f, user_id=e15cb1d012934ebeac53af885ca65f75, role_id=2696068001744b38a289a59c56f56a95)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:25.305028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a95a7-cbab-4dcf-95c2-0ee5b9139fa9 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:25.338973 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63bf45-67b5-4c0b-95b2-87081a993739 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:25.376468 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a3943-7564-47ed-8105-133ded224169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:25.377119 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a3943-7564-47ed-8105-133ded224169 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:25.377433 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a3943-7564-47ed-8105-133ded224169 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:25.377741 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a3943-7564-47ed-8105-133ded224169 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:25.378377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a3943-7564-47ed-8105-133ded224169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:25.378711 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a3943-7564-47ed-8105-133ded224169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:25.380125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a3943-7564-47ed-8105-133ded224169 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:25.393059 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 281/603] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:25.404927 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a3943-7564-47ed-8105-133ded224169 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:25.422794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 323/604] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:17:25 2022] PUT /identity/v3/projects/ad230723d90a439daf38443915c2282f/users/e15cb1d012934ebeac53af885ca65f75/roles/2696068001744b38a289a59c56f56a95 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:17:25.547921 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:25.617276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a3943-7564-47ed-8105-133ded224169 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:25.656027 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca5716-cab0-4e93-910b-f1c989481007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:25.657042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca5716-cab0-4e93-910b-f1c989481007 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:25.657533 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca5716-cab0-4e93-910b-f1c989481007 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:25.658021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca5716-cab0-4e93-910b-f1c989481007 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:25.665236 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca5716-cab0-4e93-910b-f1c989481007 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:25.666957 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca5716-cab0-4e93-910b-f1c989481007 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:25.679875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-54ca5716-cab0-4e93-910b-f1c989481007 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:25.679875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:25.679875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:25.679875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:25.679875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:25.679875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:25.679875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:25.679875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:25.679875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:25.679875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:25.679875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:25.679875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:25.679875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:25.679875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:25.679875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:25.681314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:25.681314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:25.681314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:25.681314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:25.681314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:25.681314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:25.681314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:25.681314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:25.681314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:25.681314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:25.681314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:25.681314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:25.681314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:25.681314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:25.681314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:25.681314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:25.681314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:25.682269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:25.682269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:25.682269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:25.682269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:25.682269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:25.682269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:25.682269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:25.682269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:25.684362 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 282/605] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:25.690159 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a95a7-cbab-4dcf-95c2-0ee5b9139fa9 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:25.740592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:25.813600 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a95a7-cbab-4dcf-95c2-0ee5b9139fa9 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:25.848390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2f16c-adf9-4fd6-bb11-15c1a895313c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:25.848992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2f16c-adf9-4fd6-bb11-15c1a895313c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:25.849267 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2f16c-adf9-4fd6-bb11-15c1a895313c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:25.849537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2f16c-adf9-4fd6-bb11-15c1a895313c None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:25.850221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2f16c-adf9-4fd6-bb11-15c1a895313c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:25.850587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2f16c-adf9-4fd6-bb11-15c1a895313c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:25.852017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2f16c-adf9-4fd6-bb11-15c1a895313c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:25.854798 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a679e6-e269-4f46-af86-529783c2cecd None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:25.855074 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a679e6-e269-4f46-af86-529783c2cecd None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:25.855344 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a679e6-e269-4f46-af86-529783c2cecd None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:25.856773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 283/606] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:17:25.867885 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 324/607] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:25.873909 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a679e6-e269-4f46-af86-529783c2cecd None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:25.883127 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb6dcf-9cf5-4444-b8b2-8811eee65af6 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:25.883411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb6dcf-9cf5-4444-b8b2-8811eee65af6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:25.883681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb6dcf-9cf5-4444-b8b2-8811eee65af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:25.916471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6ccb6dcf-9cf5-4444-b8b2-8811eee65af6 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:25.918296 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6ccb6dcf-9cf5-4444-b8b2-8811eee65af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:26.033812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a679e6-e269-4f46-af86-529783c2cecd None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:26.043962 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 325/608] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:26.060829 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:26.086937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec1b3f-b067-4909-a5ab-d8338beeefc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:26.087532 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec1b3f-b067-4909-a5ab-d8338beeefc2 None admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:26.087815 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec1b3f-b067-4909-a5ab-d8338beeefc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:26.088095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec1b3f-b067-4909-a5ab-d8338beeefc2 None admin] PATH_INFO: `/v3/projects/ad230723d90a439daf38443915c2282f/users/758380280e33458f8f9112147d5a7819/roles/2696068001744b38a289a59c56f56a95` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:26.105702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec1b3f-b067-4909-a5ab-d8338beeefc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad230723d90a439daf38443915c2282f, user_id=758380280e33458f8f9112147d5a7819, role_id=2696068001744b38a289a59c56f56a95)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:26.107768 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec1b3f-b067-4909-a5ab-d8338beeefc2 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:26.172557 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78edf-248a-4e1a-8e8f-e48072d2027e None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:26.172861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78edf-248a-4e1a-8e8f-e48072d2027e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:26.173140 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78edf-248a-4e1a-8e8f-e48072d2027e None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:26.174827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 326/609] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:17:26.179895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83355125-6d2c-4cca-914b-03d2e043db34 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:26.180176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83355125-6d2c-4cca-914b-03d2e043db34 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:26.180487 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83355125-6d2c-4cca-914b-03d2e043db34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:26.181554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 284/610] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:17:25 2022] PUT /identity/v3/projects/ad230723d90a439daf38443915c2282f/users/758380280e33458f8f9112147d5a7819/roles/2696068001744b38a289a59c56f56a95 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:17:26.210735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-83355125-6d2c-4cca-914b-03d2e043db34 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:26.211928 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-83355125-6d2c-4cca-914b-03d2e043db34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:26.250090 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:26.307954 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 327/611] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:17:26.348024 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec1b3f-b067-4909-a5ab-d8338beeefc2 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:26.472906 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec1b3f-b067-4909-a5ab-d8338beeefc2 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:26.511846 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80831de-8dc0-42a4-a2b6-309306794d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:26.512572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80831de-8dc0-42a4-a2b6-309306794d2f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:26.512888 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80831de-8dc0-42a4-a2b6-309306794d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:26.513207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80831de-8dc0-42a4-a2b6-309306794d2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:26.531042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80831de-8dc0-42a4-a2b6-309306794d2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:26.536019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-f80831de-8dc0-42a4-a2b6-309306794d2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:26.536019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:26.536019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:26.536019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:26.536019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:26.536019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:26.536019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:26.536019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:26.536019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:26.536019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:26.536019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:26.536019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:26.536019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:26.536019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:26.536019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:26.536019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:26.536996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:26.536996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:26.536996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:26.536996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:26.536996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:26.536996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:26.536996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:26.536996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:26.536996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:26.536996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:26.536996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:26.536996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:26.536996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:26.536996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:26.536996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:26.536996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:26.538232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:26.538232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:26.538232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:26.538232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:26.538232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:26.538232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:26.538232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:26.538232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:26.538232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:26.538232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:26.538232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:26.538232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:26.538232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 285/612] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:26.545563 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83355125-6d2c-4cca-914b-03d2e043db34 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:26.666862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80831de-8dc0-42a4-a2b6-309306794d2f None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:26.683998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83355125-6d2c-4cca-914b-03d2e043db34 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:26.714721 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:26.722614 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1e643-ef8c-4a93-a520-92b694fcd88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:26.724178 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1e643-ef8c-4a93-a520-92b694fcd88f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:26.724707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1e643-ef8c-4a93-a520-92b694fcd88f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:26.725312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1e643-ef8c-4a93-a520-92b694fcd88f None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:26.726718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1e643-ef8c-4a93-a520-92b694fcd88f None admin] RBAC: Adding query filter params (name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:26.727392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1e643-ef8c-4a93-a520-92b694fcd88f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:26.729043 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1e643-ef8c-4a93-a520-92b694fcd88f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:26.744444 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 328/613] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:17:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:26.745985 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1e643-ef8c-4a93-a520-92b694fcd88f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:26.774995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:26.873744 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80831de-8dc0-42a4-a2b6-309306794d2f None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:26.910913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1e643-ef8c-4a93-a520-92b694fcd88f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:26.942731 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45659407-8071-4121-8798-6d26acae3ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:26.943773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45659407-8071-4121-8798-6d26acae3ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:26.944415 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45659407-8071-4121-8798-6d26acae3ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:26.945704 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45659407-8071-4121-8798-6d26acae3ae8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:26.965780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45659407-8071-4121-8798-6d26acae3ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:26.972619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-45659407-8071-4121-8798-6d26acae3ae8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:26.972619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:26.972619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:26.972619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:26.972619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:26.972619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:26.972619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:26.972619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:26.972619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:26.972619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:26.972619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:26.972619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:26.972619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:26.972619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:26.972619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:26.972619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:26.973539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:26.973539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:26.973539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:26.973539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:26.973539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:26.973539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:26.973539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:26.973539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:26.973539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:26.973539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:26.973539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:26.973539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:26.973539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:26.973539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:26.973539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:26.973539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:26.974389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:26.974389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:26.974389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:26.974389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:26.974389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:26.974389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:26.974389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:26.974389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:26.974389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:26.974389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:26.974389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:26.974389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:26.985477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 286/614] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:26.986936 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418cbb1-1d0f-4f13-ae19-875206e4d523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:26.987818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418cbb1-1d0f-4f13-ae19-875206e4d523 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:26.988306 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418cbb1-1d0f-4f13-ae19-875206e4d523 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:26.988851 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418cbb1-1d0f-4f13-ae19-875206e4d523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:26.991998 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45659407-8071-4121-8798-6d26acae3ae8 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:27.011878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418cbb1-1d0f-4f13-ae19-875206e4d523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:27.014336 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418cbb1-1d0f-4f13-ae19-875206e4d523 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:27.043148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-4418cbb1-1d0f-4f13-ae19-875206e4d523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:27.043148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:27.043148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:27.043148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:27.043148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:27.043148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:27.043148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:27.043148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:27.043148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:27.043148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:27.043148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:27.043148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:27.043148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:27.043148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:27.043148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:27.043148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:27.044484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:27.044484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:27.044484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:27.044484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:27.044484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:27.044484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:27.044484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:27.044484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:27.044484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:27.044484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:27.044484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:27.044484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:27.044484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:27.044484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:27.044484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:27.044484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:27.044484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:27.045433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:27.045433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:27.045433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:27.053970 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 329/615] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:27.060308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418cbb1-1d0f-4f13-ae19-875206e4d523 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:27.156151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:27.191416 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45659407-8071-4121-8798-6d26acae3ae8 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:27.215279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:27.264735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418cbb1-1d0f-4f13-ae19-875206e4d523 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:27.273520 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59092dae-69e0-4de5-8e3a-e88254a80d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:27.274148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59092dae-69e0-4de5-8e3a-e88254a80d73 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:27.274423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59092dae-69e0-4de5-8e3a-e88254a80d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:27.274693 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59092dae-69e0-4de5-8e3a-e88254a80d73 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:27.275371 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59092dae-69e0-4de5-8e3a-e88254a80d73 None admin] RBAC: Adding query filter params (name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:27.275674 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59092dae-69e0-4de5-8e3a-e88254a80d73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:27.277133 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59092dae-69e0-4de5-8e3a-e88254a80d73 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:27.295565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 287/616] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:17:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:27.305319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59092dae-69e0-4de5-8e3a-e88254a80d73 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:27.345058 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facec5d5-11a8-4a89-9e0d-1f94c2c2abc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:27.345711 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facec5d5-11a8-4a89-9e0d-1f94c2c2abc6 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:27.345994 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facec5d5-11a8-4a89-9e0d-1f94c2c2abc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:27.346275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facec5d5-11a8-4a89-9e0d-1f94c2c2abc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:27.346920 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facec5d5-11a8-4a89-9e0d-1f94c2c2abc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:27.347225 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facec5d5-11a8-4a89-9e0d-1f94c2c2abc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:27.348632 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facec5d5-11a8-4a89-9e0d-1f94c2c2abc6 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:27.375123 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 330/617] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:27.382838 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facec5d5-11a8-4a89-9e0d-1f94c2c2abc6 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:27.493345 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59092dae-69e0-4de5-8e3a-e88254a80d73 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:27.550028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facec5d5-11a8-4a89-9e0d-1f94c2c2abc6 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:27.551824 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cf8d1-a34b-4f41-9caf-db2c7055f432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:27.553322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cf8d1-a34b-4f41-9caf-db2c7055f432 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:27.553605 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cf8d1-a34b-4f41-9caf-db2c7055f432 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:27.553882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cf8d1-a34b-4f41-9caf-db2c7055f432 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:27.567576 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cf8d1-a34b-4f41-9caf-db2c7055f432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:27.569498 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cf8d1-a34b-4f41-9caf-db2c7055f432 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:27.571753 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:27.587617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-960cf8d1-a34b-4f41-9caf-db2c7055f432 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:27.587617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:27.587617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:27.587617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:27.587617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:27.587617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:27.587617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:27.587617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:27.587617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:27.587617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:27.587617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:27.587617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:27.587617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:27.587617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:27.587617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:27.587617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:27.588854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:27.588854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:27.588854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:27.588854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:27.588854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:27.588854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:27.588854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:27.588854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:27.588854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:27.588854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:27.588854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:27.588854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:27.588854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:27.588854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:27.588854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:27.588854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:27.588854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:27.590269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:27.590269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:27.590269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:27.592512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99155708-21f7-4a0d-9d22-e68e7dd8af63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:27.593323 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99155708-21f7-4a0d-9d22-e68e7dd8af63 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:27.593707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99155708-21f7-4a0d-9d22-e68e7dd8af63 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:27.594129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 288/618] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:27.594329 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99155708-21f7-4a0d-9d22-e68e7dd8af63 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:27.595803 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6a553-1b52-46b9-b23b-dbf2eee67d9a None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:27.596094 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6a553-1b52-46b9-b23b-dbf2eee67d9a None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:27.596389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6a553-1b52-46b9-b23b-dbf2eee67d9a None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:27.598708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 289/619] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:27.599451 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6a553-1b52-46b9-b23b-dbf2eee67d9a None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:27.603975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:27.609022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99155708-21f7-4a0d-9d22-e68e7dd8af63 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:27.610474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99155708-21f7-4a0d-9d22-e68e7dd8af63 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:27.628091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-99155708-21f7-4a0d-9d22-e68e7dd8af63 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 16:17:27.628091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:27.628091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:27.628091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:27.628091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:27.628091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:27.628091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:27.628091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:27.628091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:27.628091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:27.628091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:27.628091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:27.628091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:27.628091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:27.628091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:27.628091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:27.629182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:27.629182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:27.629182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:27.629182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:27.629182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:27.629182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:27.629182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:27.629182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:27.629182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:27.629182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:27.629182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:27.629182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:27.629182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:27.629182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:27.629182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:27.629182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:27.629182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:27.629182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:27.630364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:27.630364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:27.630364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:27.630364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:27.630364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:27.630364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:27.630364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:27.630364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:27.630364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 16:17:27.630364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:27.630364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 331/620] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Sep 27 16:17:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:27.632299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81066d23-1784-4bf8-8fde-a64f8b2b8120 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:27.632757 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81066d23-1784-4bf8-8fde-a64f8b2b8120 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:27.633101 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81066d23-1784-4bf8-8fde-a64f8b2b8120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:27.660058 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-81066d23-1784-4bf8-8fde-a64f8b2b8120 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:27.661548 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-81066d23-1784-4bf8-8fde-a64f8b2b8120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:27.720062 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6a553-1b52-46b9-b23b-dbf2eee67d9a None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:27.752965 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 332/621] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:27.754045 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81066d23-1784-4bf8-8fde-a64f8b2b8120 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:27.756517 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b8c7f-4ca6-40bc-91b2-1cc70509ed9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:27.757353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b8c7f-4ca6-40bc-91b2-1cc70509ed9d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:27.757872 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b8c7f-4ca6-40bc-91b2-1cc70509ed9d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:27.758206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b8c7f-4ca6-40bc-91b2-1cc70509ed9d None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:27.758922 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b8c7f-4ca6-40bc-91b2-1cc70509ed9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:27.759295 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b8c7f-4ca6-40bc-91b2-1cc70509ed9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:27.760759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b8c7f-4ca6-40bc-91b2-1cc70509ed9d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:27.774035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 290/622] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:27.779919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b8c7f-4ca6-40bc-91b2-1cc70509ed9d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:27.858308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:27.913421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81066d23-1784-4bf8-8fde-a64f8b2b8120 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:27.939473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b8c7f-4ca6-40bc-91b2-1cc70509ed9d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:27.960479 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:27.979229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd56154-5d86-429a-b8ca-4fc942dd5469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:27.985908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd56154-5d86-429a-b8ca-4fc942dd5469 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:27.985908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd56154-5d86-429a-b8ca-4fc942dd5469 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:27.985908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd56154-5d86-429a-b8ca-4fc942dd5469 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:27.985908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd56154-5d86-429a-b8ca-4fc942dd5469 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:27.985908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd56154-5d86-429a-b8ca-4fc942dd5469 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:27.985908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd56154-5d86-429a-b8ca-4fc942dd5469 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:27.993113 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5028c6d-19ce-4471-8ecd-be367d474c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:27.993745 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5028c6d-19ce-4471-8ecd-be367d474c38 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:27.994022 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5028c6d-19ce-4471-8ecd-be367d474c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:27.994291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5028c6d-19ce-4471-8ecd-be367d474c38 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:28.008818 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5028c6d-19ce-4471-8ecd-be367d474c38 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:28.010200 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5028c6d-19ce-4471-8ecd-be367d474c38 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:28.016439 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 333/623] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Sep 27 16:17:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:28.022292 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd56154-5d86-429a-b8ca-4fc942dd5469 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:28.026735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-d5028c6d-19ce-4471-8ecd-be367d474c38 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 16:17:28.026735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:28.026735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:28.026735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:28.026735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:28.026735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:28.026735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:28.026735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:28.026735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:28.026735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:28.026735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:28.026735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:28.026735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:28.026735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:28.026735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:28.026735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:28.027690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:28.027690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:28.027690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:28.027690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:28.027690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:28.027690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:28.027690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:28.027690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:28.027690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:28.027690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:28.027690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:28.027690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:28.027690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:28.027690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:28.027690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:28.027690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:28.027690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:28.027690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:28.029257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:28.029257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:28.029257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:28.029257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:28.029257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:28.029257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:28.029257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:28.029257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:28.029257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 27 16:17:28.029257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:28.029257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 291/624] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:17:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:28.037483 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5028c6d-19ce-4471-8ecd-be367d474c38 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:28.158928 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd56154-5d86-429a-b8ca-4fc942dd5469 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:28.196222 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5028c6d-19ce-4471-8ecd-be367d474c38 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:28.202550 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1f86b-daae-4744-9ce4-2715e40d7a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:28.203162 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1f86b-daae-4744-9ce4-2715e40d7a5d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:28.203444 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1f86b-daae-4744-9ce4-2715e40d7a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:28.203715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1f86b-daae-4744-9ce4-2715e40d7a5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:28.211677 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:28.234951 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae347826-4027-4f20-a472-37f93b15241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:28.235564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae347826-4027-4f20-a472-37f93b15241e None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:28.235893 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae347826-4027-4f20-a472-37f93b15241e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:28.236164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae347826-4027-4f20-a472-37f93b15241e None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:28.236874 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae347826-4027-4f20-a472-37f93b15241e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:28.237250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae347826-4027-4f20-a472-37f93b15241e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:28.238640 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae347826-4027-4f20-a472-37f93b15241e None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:28.257955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 292/625] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Sep 27 16:17:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:28.259097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae347826-4027-4f20-a472-37f93b15241e None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:28.268106 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:28.286228 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1f86b-daae-4744-9ce4-2715e40d7a5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:28.291035 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1f86b-daae-4744-9ce4-2715e40d7a5d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:28.362764 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae347826-4027-4f20-a472-37f93b15241e None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:28.393071 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 334/626] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:17:28.394651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbc7aa-f823-4025-8992-583e9c766a3c None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:28.395166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbc7aa-f823-4025-8992-583e9c766a3c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:28.395661 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbc7aa-f823-4025-8992-583e9c766a3c None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:28.397375 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 335/627] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:28.398297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbc7aa-f823-4025-8992-583e9c766a3c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:28.407118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb934d-0a2d-4ed0-86cd-150e8f42c153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:28.407752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb934d-0a2d-4ed0-86cd-150e8f42c153 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:28.408030 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb934d-0a2d-4ed0-86cd-150e8f42c153 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:28.408304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb934d-0a2d-4ed0-86cd-150e8f42c153 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:28.419656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb934d-0a2d-4ed0-86cd-150e8f42c153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:28.424773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-a1fb934d-0a2d-4ed0-86cd-150e8f42c153 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:28.424773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:28.424773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:28.424773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:28.424773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:28.424773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:28.424773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:28.424773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:28.424773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:28.424773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:28.424773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:28.424773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:28.424773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:28.424773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:28.424773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:28.424773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:28.425901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:28.425901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:28.425901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:28.425901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:28.425901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:28.425901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:28.425901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:28.425901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:28.425901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:28.425901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:28.425901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:28.425901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:28.425901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:28.425901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:28.425901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:28.425901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:28.426756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:28.426756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:28.426756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:28.426756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:28.426756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:28.426756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:28.426756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:28.426756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:28.426756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:28.426756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:28.426756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:28.426756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:28.426756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 293/628] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:28.427483 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb934d-0a2d-4ed0-86cd-150e8f42c153 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:28.465199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:28.491480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:28.508144 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbc7aa-f823-4025-8992-583e9c766a3c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:28.539308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb934d-0a2d-4ed0-86cd-150e8f42c153 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:28.543009 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097adacd-fd35-47e5-9dde-489a0539b6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:28.543711 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097adacd-fd35-47e5-9dde-489a0539b6bd None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:28.544062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097adacd-fd35-47e5-9dde-489a0539b6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:28.544680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097adacd-fd35-47e5-9dde-489a0539b6bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:28.555624 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097adacd-fd35-47e5-9dde-489a0539b6bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:28.557187 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097adacd-fd35-47e5-9dde-489a0539b6bd None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:28.571773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-097adacd-fd35-47e5-9dde-489a0539b6bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:28.571773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:28.571773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:28.571773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:28.571773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:28.571773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:28.571773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:28.571773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:28.571773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:28.571773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:28.571773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:28.571773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:28.571773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:28.571773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:28.571773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:28.571773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:28.572876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:28.572876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:28.572876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:28.572876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:28.572876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:28.572876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:28.572876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:28.572876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:28.572876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:28.572876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:28.572876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:28.572876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:28.572876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:28.572876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:28.572876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:28.572876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:28.572876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:28.579216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:28.579216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:28.579216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:28.579216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 336/629] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:28.579216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b2af6-52bb-46ec-aa95-535fd370f1c7 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:28.579216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b2af6-52bb-46ec-aa95-535fd370f1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:28.579216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b2af6-52bb-46ec-aa95-535fd370f1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:28.581072 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5f34e-c398-455f-bcbf-6af5c0d6ccdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:28.581708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5f34e-c398-455f-bcbf-6af5c0d6ccdc None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:28.581993 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5f34e-c398-455f-bcbf-6af5c0d6ccdc None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:28.582267 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5f34e-c398-455f-bcbf-6af5c0d6ccdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:28.593594 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5f34e-c398-455f-bcbf-6af5c0d6ccdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:28.595241 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5f34e-c398-455f-bcbf-6af5c0d6ccdc None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:28.596936 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-488b2af6-52bb-46ec-aa95-535fd370f1c7 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:28.598330 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-488b2af6-52bb-46ec-aa95-535fd370f1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:28.613897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-21b5f34e-c398-455f-bcbf-6af5c0d6ccdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:28.613897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:28.613897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:28.613897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:28.613897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:28.613897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:28.613897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:28.613897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:28.613897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:28.613897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:28.613897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:28.613897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:28.613897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:28.613897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:28.613897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:28.613897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:28.615129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:28.615129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:28.615129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:28.615129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:28.615129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:28.615129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:28.615129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:28.615129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:28.615129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:28.615129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:28.615129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:28.615129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:28.615129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:28.615129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:28.615129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:28.615129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:28.615129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:28.616255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:28.616255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:28.616255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:28.617731 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 294/630] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:28.618602 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5f34e-c398-455f-bcbf-6af5c0d6ccdc None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:28.679596 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 337/631] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:28.680259 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b2af6-52bb-46ec-aa95-535fd370f1c7 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:28.721876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:28.737758 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5f34e-c398-455f-bcbf-6af5c0d6ccdc None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:28.747765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:28.773676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0466588-a129-4ce1-9781-594a491b7682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:28.774282 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0466588-a129-4ce1-9781-594a491b7682 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:28.774556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0466588-a129-4ce1-9781-594a491b7682 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:28.774824 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0466588-a129-4ce1-9781-594a491b7682 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:28.775501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0466588-a129-4ce1-9781-594a491b7682 None admin] RBAC: Adding query filter params (name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:28.775798 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0466588-a129-4ce1-9781-594a491b7682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:28.777190 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0466588-a129-4ce1-9781-594a491b7682 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:28.787292 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 295/632] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:17:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:28.788049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b2af6-52bb-46ec-aa95-535fd370f1c7 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:28.792703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0466588-a129-4ce1-9781-594a491b7682 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:28.826797 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f71e28-6b9a-4a75-8aec-741e26df2874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:28.827512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f71e28-6b9a-4a75-8aec-741e26df2874 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:28.827885 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f71e28-6b9a-4a75-8aec-741e26df2874 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:28.828175 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f71e28-6b9a-4a75-8aec-741e26df2874 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:28.828856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f71e28-6b9a-4a75-8aec-741e26df2874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:28.829156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f71e28-6b9a-4a75-8aec-741e26df2874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:28.830598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f71e28-6b9a-4a75-8aec-741e26df2874 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:28.847006 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 338/633] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:28.848261 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f1c7e-30f0-42aa-b9f7-d156ed8f5625 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:28.848603 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f1c7e-30f0-42aa-b9f7-d156ed8f5625 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:28.848882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f1c7e-30f0-42aa-b9f7-d156ed8f5625 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:28.852453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 339/634] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:28.853677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f1c7e-30f0-42aa-b9f7-d156ed8f5625 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:28.900533 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0466588-a129-4ce1-9781-594a491b7682 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:28.936519 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616febf-7e8e-4fa5-8270-3340a0e5168c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:28.937119 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616febf-7e8e-4fa5-8270-3340a0e5168c None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:28.937393 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616febf-7e8e-4fa5-8270-3340a0e5168c None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:28.937658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616febf-7e8e-4fa5-8270-3340a0e5168c None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:28.938398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616febf-7e8e-4fa5-8270-3340a0e5168c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:28.938695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616febf-7e8e-4fa5-8270-3340a0e5168c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:28.940171 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616febf-7e8e-4fa5-8270-3340a0e5168c None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:28.953078 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 296/635] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:28.953879 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616febf-7e8e-4fa5-8270-3340a0e5168c None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:28.959163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f1c7e-30f0-42aa-b9f7-d156ed8f5625 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:28.962096 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:28.984272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:28.992455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63f1b6-9f17-4896-ac99-e17787506155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:28.993077 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63f1b6-9f17-4896-ac99-e17787506155 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:28.993355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63f1b6-9f17-4896-ac99-e17787506155 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:28.993627 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63f1b6-9f17-4896-ac99-e17787506155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:29.004510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63f1b6-9f17-4896-ac99-e17787506155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:29.005985 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63f1b6-9f17-4896-ac99-e17787506155 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:29.020112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-ca63f1b6-9f17-4896-ac99-e17787506155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:29.020112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:29.020112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:29.020112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:29.020112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:29.020112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:29.020112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:29.020112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:29.020112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:29.020112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:29.020112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:29.020112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:29.020112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:29.020112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:29.020112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:29.020112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:29.026656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:29.026656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:29.026656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:29.026656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:29.026656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:29.026656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:29.026656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:29.026656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:29.026656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:29.026656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:29.026656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:29.026656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:29.026656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:29.026656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:29.026656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:29.026656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:29.026656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:29.027562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:29.027562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:29.027562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:29.027562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 340/636] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:29.027562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a218f5-3209-4c89-9fe8-2eec23f9f641 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:29.027562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a218f5-3209-4c89-9fe8-2eec23f9f641 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:29.027562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a218f5-3209-4c89-9fe8-2eec23f9f641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:29.040472 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-46a218f5-3209-4c89-9fe8-2eec23f9f641 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:29.041674 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-46a218f5-3209-4c89-9fe8-2eec23f9f641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:29.050448 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616febf-7e8e-4fa5-8270-3340a0e5168c None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:29.083696 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e35c4-d3bb-40f8-a57b-a11125a38bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:29.084381 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e35c4-d3bb-40f8-a57b-a11125a38bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:29.084658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e35c4-d3bb-40f8-a57b-a11125a38bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:29.084926 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e35c4-d3bb-40f8-a57b-a11125a38bf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:29.091396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e35c4-d3bb-40f8-a57b-a11125a38bf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:29.092856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e35c4-d3bb-40f8-a57b-a11125a38bf1 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:29.103808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-890e35c4-d3bb-40f8-a57b-a11125a38bf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:29.103808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:29.103808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:29.103808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:29.103808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:29.103808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:29.103808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:29.103808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:29.103808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:29.103808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:29.103808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:29.103808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:29.103808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:29.103808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:29.103808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:29.104965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:29.104965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:29.104965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:29.104965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:29.104965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:29.104965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:29.104965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:29.104965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:29.104965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:29.104965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:29.104965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:29.104965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:29.104965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:29.104965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:29.104965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:29.104965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:29.104965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:29.105898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:29.105898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:29.105898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:29.105898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:29.105898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:29.105898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:29.105898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:29.105898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:29.105898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 297/637] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:29.105898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e35c4-d3bb-40f8-a57b-a11125a38bf1 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:29.110075 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 341/638] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:29.110910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a218f5-3209-4c89-9fe8-2eec23f9f641 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:29.185890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:29.215156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a218f5-3209-4c89-9fe8-2eec23f9f641 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:29.220033 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e35c4-d3bb-40f8-a57b-a11125a38bf1 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:29.225277 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:29.251015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8027207-aaa4-44ec-ae8f-ed65d49b9c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:29.251951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8027207-aaa4-44ec-ae8f-ed65d49b9c02 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:29.252233 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8027207-aaa4-44ec-ae8f-ed65d49b9c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:29.252620 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8027207-aaa4-44ec-ae8f-ed65d49b9c02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:29.254227 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78664626-2e4f-4103-97e9-ba02d080ace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:29.254849 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78664626-2e4f-4103-97e9-ba02d080ace9 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:29.255127 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78664626-2e4f-4103-97e9-ba02d080ace9 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:29.255398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78664626-2e4f-4103-97e9-ba02d080ace9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:29.259684 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8027207-aaa4-44ec-ae8f-ed65d49b9c02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:29.261310 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8027207-aaa4-44ec-ae8f-ed65d49b9c02 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:29.266313 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78664626-2e4f-4103-97e9-ba02d080ace9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:29.272589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-78664626-2e4f-4103-97e9-ba02d080ace9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:29.272589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:29.272589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:29.272589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:29.272589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:29.272589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:29.272589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:29.272589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:29.272589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:29.272589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:29.272589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:29.272589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:29.272589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:29.272589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:29.272589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:29.272589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:29.273733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:29.273733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:29.273733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:29.273733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:29.273733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:29.273733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:29.273733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:29.273733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:29.273733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:29.273733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:29.273733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:29.273733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:29.273733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:29.273733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:29.273733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:29.273733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:29.274599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:29.274599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:29.274599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:29.274599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:29.274599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:29.274599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:29.274599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:29.274599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:29.274599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:29.274599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:29.274599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:29.274599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:29.274599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 298/639] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:29.275328 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78664626-2e4f-4103-97e9-ba02d080ace9 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:29.276862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-f8027207-aaa4-44ec-ae8f-ed65d49b9c02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:29.276862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:29.276862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:29.276862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:29.276862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:29.276862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:29.276862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:29.276862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:29.276862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:29.276862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:29.276862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:29.276862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:29.276862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:29.276862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:29.276862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:29.277834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:29.277834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:29.277834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:29.277834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:29.277834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:29.277834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:29.277834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:29.277834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:29.277834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:29.277834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:29.277834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:29.277834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:29.277834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:29.277834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:29.277834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:29.277834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:29.277834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:29.278858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:29.278858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:29.278858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:29.278858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:29.278858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:29.278858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:29.278858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:29.278858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:29.281848 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 342/640] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:29.282800 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8027207-aaa4-44ec-ae8f-ed65d49b9c02 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:29.382590 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78664626-2e4f-4103-97e9-ba02d080ace9 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:29.394093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8027207-aaa4-44ec-ae8f-ed65d49b9c02 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:29.407616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:29.416195 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa111a-f671-43d5-b6d5-64c712f7dc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:29.416827 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa111a-f671-43d5-b6d5-64c712f7dc41 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:29.421308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa111a-f671-43d5-b6d5-64c712f7dc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:29.421308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa111a-f671-43d5-b6d5-64c712f7dc41 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:29.421308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa111a-f671-43d5-b6d5-64c712f7dc41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:29.421308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa111a-f671-43d5-b6d5-64c712f7dc41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:29.421308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa111a-f671-43d5-b6d5-64c712f7dc41 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:29.428386 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603265f-db22-4c96-9097-c894574e1579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:29.428976 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603265f-db22-4c96-9097-c894574e1579 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:29.429256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603265f-db22-4c96-9097-c894574e1579 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:29.429525 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603265f-db22-4c96-9097-c894574e1579 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:29.430194 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603265f-db22-4c96-9097-c894574e1579 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:29.430494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603265f-db22-4c96-9097-c894574e1579 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:29.431646 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 299/641] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:29.431890 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603265f-db22-4c96-9097-c894574e1579 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:29.432461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa111a-f671-43d5-b6d5-64c712f7dc41 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:29.443773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 343/642] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:29.444601 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603265f-db22-4c96-9097-c894574e1579 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:29.472180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:29.531723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa111a-f671-43d5-b6d5-64c712f7dc41 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:29.544976 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603265f-db22-4c96-9097-c894574e1579 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:29.565333 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b520fb-f63a-409c-bed0-2767dc0f30fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:29.565929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b520fb-f63a-409c-bed0-2767dc0f30fa None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:29.566204 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b520fb-f63a-409c-bed0-2767dc0f30fa None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:29.566472 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b520fb-f63a-409c-bed0-2767dc0f30fa None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:29.567119 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b520fb-f63a-409c-bed0-2767dc0f30fa None admin] RBAC: Adding query filter params (name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:29.567418 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b520fb-f63a-409c-bed0-2767dc0f30fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:29.568812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b520fb-f63a-409c-bed0-2767dc0f30fa None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:29.577965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 300/643] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:17:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:29.577965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b520fb-f63a-409c-bed0-2767dc0f30fa None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:29.579067 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101eea7-6f62-4c20-9748-d64e21d4ee0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:29.579671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101eea7-6f62-4c20-9748-d64e21d4ee0c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:29.579950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101eea7-6f62-4c20-9748-d64e21d4ee0c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:29.580224 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101eea7-6f62-4c20-9748-d64e21d4ee0c None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:29.581033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101eea7-6f62-4c20-9748-d64e21d4ee0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:29.581344 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101eea7-6f62-4c20-9748-d64e21d4ee0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:29.582759 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101eea7-6f62-4c20-9748-d64e21d4ee0c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:29.595962 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 344/644] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:29.596805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101eea7-6f62-4c20-9748-d64e21d4ee0c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:29.628302 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:29.678307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b520fb-f63a-409c-bed0-2767dc0f30fa None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:29.681386 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:29.692911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101eea7-6f62-4c20-9748-d64e21d4ee0c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:29.711254 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf25318-89de-42fc-b295-25f389d7009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:29.711879 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf25318-89de-42fc-b295-25f389d7009f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:29.712160 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf25318-89de-42fc-b295-25f389d7009f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:29.712466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf25318-89de-42fc-b295-25f389d7009f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:29.723056 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf25318-89de-42fc-b295-25f389d7009f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:29.726271 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39015a40-1615-4cf6-afb8-91e2ccb0b7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:29.726885 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39015a40-1615-4cf6-afb8-91e2ccb0b7d8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:29.727163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39015a40-1615-4cf6-afb8-91e2ccb0b7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:29.727433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39015a40-1615-4cf6-afb8-91e2ccb0b7d8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:29.728263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-3cf25318-89de-42fc-b295-25f389d7009f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:29.728263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:29.728263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:29.728263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:29.728263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:29.728263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:29.728263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:29.728263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:29.728263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:29.728263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:29.728263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:29.728263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:29.728263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:29.728263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:29.728263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:29.728263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:29.729430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:29.729430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:29.729430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:29.729430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:29.729430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:29.729430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:29.729430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:29.729430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:29.729430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:29.729430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:29.729430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:29.729430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:29.729430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:29.729430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:29.729430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:29.729430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:29.730420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:29.730420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:29.730420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:29.730420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:29.730420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:29.730420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:29.730420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:29.730420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:29.730420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:29.730420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:29.730420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:29.730420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:29.730420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 301/645] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:29.730420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf25318-89de-42fc-b295-25f389d7009f None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:29.740041 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39015a40-1615-4cf6-afb8-91e2ccb0b7d8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:29.741509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39015a40-1615-4cf6-afb8-91e2ccb0b7d8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:29.752874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-39015a40-1615-4cf6-afb8-91e2ccb0b7d8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 16:17:29.752874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:29.752874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:29.752874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:29.752874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:29.752874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:29.752874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:29.752874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:29.752874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:29.752874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:29.752874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:29.752874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:29.752874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:29.752874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:29.752874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:29.752874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:29.754093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:29.754093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:29.754093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:29.754093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:29.754093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:29.754093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:29.754093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:29.754093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:29.754093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:29.754093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:29.754093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:29.754093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:29.754093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:29.754093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:29.754093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:29.754093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:29.754093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:29.754093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:29.755393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:29.755393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:29.755393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:29.755393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:29.755393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:29.755393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:29.755393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:29.755393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:29.755393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 16:17:29.755393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:29.757583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 345/646] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:17:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:29.757583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39015a40-1615-4cf6-afb8-91e2ccb0b7d8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:29.834412 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf25318-89de-42fc-b295-25f389d7009f None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:29.843566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:29.855679 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39015a40-1615-4cf6-afb8-91e2ccb0b7d8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:29.867408 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cb95b-4c47-45b4-89fc-b6f675b0d0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:29.868074 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cb95b-4c47-45b4-89fc-b6f675b0d0dc None admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:29.868384 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cb95b-4c47-45b4-89fc-b6f675b0d0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:29.868660 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cb95b-4c47-45b4-89fc-b6f675b0d0dc None admin] PATH_INFO: `/v3/projects/ad230723d90a439daf38443915c2282f/users/e70b85e430004a8b865622354c1d1ed4/roles/2696068001744b38a289a59c56f56a95` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:29.883816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522cb95b-4c47-45b4-89fc-b6f675b0d0dc None admin] RBAC: Authorizing `identity:create_grant(project_id=ad230723d90a439daf38443915c2282f, user_id=e70b85e430004a8b865622354c1d1ed4, role_id=2696068001744b38a289a59c56f56a95)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:29.885286 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522cb95b-4c47-45b4-89fc-b6f675b0d0dc None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:29.889195 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0930395-5cca-4649-819e-d04949f8c97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:29.889815 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0930395-5cca-4649-819e-d04949f8c97f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:29.890091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0930395-5cca-4649-819e-d04949f8c97f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:29.890361 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0930395-5cca-4649-819e-d04949f8c97f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:29.900466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0930395-5cca-4649-819e-d04949f8c97f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:29.901889 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0930395-5cca-4649-819e-d04949f8c97f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:29.910436 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:29.916598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-c0930395-5cca-4649-819e-d04949f8c97f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:29.916598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:29.916598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:29.916598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:29.916598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:29.916598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:29.916598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:29.916598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:29.916598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:29.916598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:29.916598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:29.916598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:29.916598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:29.916598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:29.916598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:29.916598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:29.917729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:29.917729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:29.917729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:29.917729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:29.917729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:29.917729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:29.917729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:29.917729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:29.917729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:29.917729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:29.917729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:29.917729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:29.917729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:29.917729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:29.917729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:29.917729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:29.917729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:29.918697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:29.918697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:29.918697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:29.918697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 346/647] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:29.918697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0930395-5cca-4649-819e-d04949f8c97f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:29.993788 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 302/648] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:17:29 2022] PUT /identity/v3/projects/ad230723d90a439daf38443915c2282f/users/e70b85e430004a8b865622354c1d1ed4/roles/2696068001744b38a289a59c56f56a95 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:17:29.994678 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cb95b-4c47-45b4-89fc-b6f675b0d0dc None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:30.018803 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0930395-5cca-4649-819e-d04949f8c97f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:30.056471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80155c2a-b382-4414-ae38-aa34964a0999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:30.057092 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80155c2a-b382-4414-ae38-aa34964a0999 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:30.057373 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80155c2a-b382-4414-ae38-aa34964a0999 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:30.057643 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80155c2a-b382-4414-ae38-aa34964a0999 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:30.058374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80155c2a-b382-4414-ae38-aa34964a0999 None admin] RBAC: Adding query filter params (role.id=2696068001744b38a289a59c56f56a95, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=e71fea96b2b949f9abca12172e69284b) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:30.058683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80155c2a-b382-4414-ae38-aa34964a0999 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:30.060575 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80155c2a-b382-4414-ae38-aa34964a0999 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:30.067913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 347/649] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:17:29 2022] GET /identity/v3/role_assignments?user.id=e71fea96b2b949f9abca12172e69284b&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=2696068001744b38a289a59c56f56a95 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:30.068648 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80155c2a-b382-4414-ae38-aa34964a0999 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:30.146384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:30.168109 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cb95b-4c47-45b4-89fc-b6f675b0d0dc None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:30.194739 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80155c2a-b382-4414-ae38-aa34964a0999 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:30.220420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50981901-0b3b-4c8d-acc3-0f8171228123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:30.221060 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50981901-0b3b-4c8d-acc3-0f8171228123 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:30.221340 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50981901-0b3b-4c8d-acc3-0f8171228123 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:30.221616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50981901-0b3b-4c8d-acc3-0f8171228123 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:30.222302 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50981901-0b3b-4c8d-acc3-0f8171228123 None admin] RBAC: Adding query filter params (name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:30.222607 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50981901-0b3b-4c8d-acc3-0f8171228123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:30.224014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50981901-0b3b-4c8d-acc3-0f8171228123 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:30.234046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 303/650] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:17:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:30.235301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50981901-0b3b-4c8d-acc3-0f8171228123 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:30.240119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b9bd4-d3bc-49d3-a3e0-be9567c59415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:30.240721 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b9bd4-d3bc-49d3-a3e0-be9567c59415 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:30.241000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b9bd4-d3bc-49d3-a3e0-be9567c59415 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:30.241275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b9bd4-d3bc-49d3-a3e0-be9567c59415 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:30.242005 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b9bd4-d3bc-49d3-a3e0-be9567c59415 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:30.242318 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b9bd4-d3bc-49d3-a3e0-be9567c59415 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:30.243766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b9bd4-d3bc-49d3-a3e0-be9567c59415 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:30.264182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 348/651] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Sep 27 16:17:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:30.264930 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b9bd4-d3bc-49d3-a3e0-be9567c59415 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:30.272503 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:30.359286 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50981901-0b3b-4c8d-acc3-0f8171228123 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:30.391046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b9bd4-d3bc-49d3-a3e0-be9567c59415 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:30.400203 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f25c0-e935-4406-926a-9dcb8f800f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:30.400854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f25c0-e935-4406-926a-9dcb8f800f21 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:30.401132 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f25c0-e935-4406-926a-9dcb8f800f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:30.401403 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f25c0-e935-4406-926a-9dcb8f800f21 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:30.402109 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f25c0-e935-4406-926a-9dcb8f800f21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:30.402527 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f25c0-e935-4406-926a-9dcb8f800f21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:30.404573 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f25c0-e935-4406-926a-9dcb8f800f21 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:30.418257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 304/652] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:30.419169 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f25c0-e935-4406-926a-9dcb8f800f21 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:30.421178 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:30.438250 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345e016-d061-4472-b052-4c393d1c5abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:30.438896 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345e016-d061-4472-b052-4c393d1c5abf None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:30.439177 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345e016-d061-4472-b052-4c393d1c5abf None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:30.439465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345e016-d061-4472-b052-4c393d1c5abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:30.452449 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345e016-d061-4472-b052-4c393d1c5abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:30.453920 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345e016-d061-4472-b052-4c393d1c5abf None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:30.471146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-4345e016-d061-4472-b052-4c393d1c5abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:30.471146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:30.471146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:30.471146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:30.471146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:30.471146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:30.471146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:30.471146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:30.471146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:30.471146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:30.471146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:30.471146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:30.471146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:30.471146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:30.471146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:30.471146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:30.472156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:30.472156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:30.472156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:30.472156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:30.472156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:30.472156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:30.472156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:30.472156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:30.472156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:30.472156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:30.472156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:30.472156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:30.472156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:30.472156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:30.472156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:30.472156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:30.472156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:30.473192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:30.473192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:30.473192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:30.473778 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 349/653] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:30.474543 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345e016-d061-4472-b052-4c393d1c5abf None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:30.518149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:30.545550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f25c0-e935-4406-926a-9dcb8f800f21 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:30.583017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dd1c7-82e1-4f86-be01-998bb894c8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:30.583629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dd1c7-82e1-4f86-be01-998bb894c8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:30.583908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dd1c7-82e1-4f86-be01-998bb894c8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:30.584234 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dd1c7-82e1-4f86-be01-998bb894c8b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:30.604160 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345e016-d061-4472-b052-4c393d1c5abf None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:30.642824 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a0edd-7f96-4fdb-a5e6-d86636c82d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:30.643457 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a0edd-7f96-4fdb-a5e6-d86636c82d39 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:30.643745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a0edd-7f96-4fdb-a5e6-d86636c82d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:30.644008 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a0edd-7f96-4fdb-a5e6-d86636c82d39 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:30.652419 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a0edd-7f96-4fdb-a5e6-d86636c82d39 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:30.654129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a0edd-7f96-4fdb-a5e6-d86636c82d39 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:30.666534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-684a0edd-7f96-4fdb-a5e6-d86636c82d39 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 27 16:17:30.666534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:30.666534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:30.666534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:30.666534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:30.666534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:30.666534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:30.666534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:30.666534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:30.666534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:30.666534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:30.666534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:30.666534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:30.666534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:30.666534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:30.666534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:30.667715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:30.667715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:30.667715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:30.667715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:30.667715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:30.667715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:30.667715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:30.667715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:30.667715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:30.667715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:30.667715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:30.667715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:30.667715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:30.667715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:30.667715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:30.667715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:30.667715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:30.667715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:30.668878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:30.668878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:30.668878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:30.668878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:30.668878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:30.668878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:30.668878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:30.668878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:30.668878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 27 16:17:30.668878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:30.670708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dd1c7-82e1-4f86-be01-998bb894c8b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:30.672301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dd1c7-82e1-4f86-be01-998bb894c8b3 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:30.672443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 350/654] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:17:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:30.673274 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a0edd-7f96-4fdb-a5e6-d86636c82d39 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:30.711056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:30.776042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:30.789472 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a0edd-7f96-4fdb-a5e6-d86636c82d39 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:30.805765 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 305/655] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:17:30.806946 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dd1c7-82e1-4f86-be01-998bb894c8b3 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:30.837028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995d531-535c-48df-8561-4caea1d7e266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:30.838256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995d531-535c-48df-8561-4caea1d7e266 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:30.838543 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995d531-535c-48df-8561-4caea1d7e266 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:30.838875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995d531-535c-48df-8561-4caea1d7e266 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:30.839575 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995d531-535c-48df-8561-4caea1d7e266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:30.839814 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995d531-535c-48df-8561-4caea1d7e266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:30.841508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995d531-535c-48df-8561-4caea1d7e266 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:30.855447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 351/656] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:30.857105 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995d531-535c-48df-8561-4caea1d7e266 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:30.934442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dd1c7-82e1-4f86-be01-998bb894c8b3 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:30.959628 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:30.968077 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995d531-535c-48df-8561-4caea1d7e266 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:30.978820 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817df86-6905-4252-af3a-742601888567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:30.979518 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817df86-6905-4252-af3a-742601888567 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:30.979807 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817df86-6905-4252-af3a-742601888567 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:30.980083 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817df86-6905-4252-af3a-742601888567 None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:30.981204 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817df86-6905-4252-af3a-742601888567 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:30.982043 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817df86-6905-4252-af3a-742601888567 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:30.983825 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817df86-6905-4252-af3a-742601888567 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:31.008133 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 306/657] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Sep 27 16:17:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:31.010461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817df86-6905-4252-af3a-742601888567 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:31.018837 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed17a0-2ead-4002-b3c6-afe7bd5aecf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:31.019771 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed17a0-2ead-4002-b3c6-afe7bd5aecf4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:31.020252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed17a0-2ead-4002-b3c6-afe7bd5aecf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:31.020735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed17a0-2ead-4002-b3c6-afe7bd5aecf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:31.032062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed17a0-2ead-4002-b3c6-afe7bd5aecf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:31.033879 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed17a0-2ead-4002-b3c6-afe7bd5aecf4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:31.050403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-abed17a0-2ead-4002-b3c6-afe7bd5aecf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:31.050403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:31.050403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:31.050403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:31.050403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:31.050403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:31.050403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:31.050403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:31.050403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:31.050403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:31.050403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:31.050403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:31.050403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:31.050403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:31.050403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:31.050403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:31.051427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:31.051427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:31.051427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:31.051427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:31.051427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:31.051427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:31.051427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:31.051427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:31.051427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:31.051427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:31.051427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:31.051427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:31.051427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:31.051427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:31.051427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:31.051427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:31.051427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:31.052433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:31.052433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:31.052433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:31.058826 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 352/658] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:31.060488 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:31.061493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed17a0-2ead-4002-b3c6-afe7bd5aecf4 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:31.141483 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817df86-6905-4252-af3a-742601888567 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:31.171611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed17a0-2ead-4002-b3c6-afe7bd5aecf4 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:31.184787 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfdba4-b961-4a34-985f-6787780cfaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:31.185710 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfdba4-b961-4a34-985f-6787780cfaa3 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:31.186182 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfdba4-b961-4a34-985f-6787780cfaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:31.186653 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfdba4-b961-4a34-985f-6787780cfaa3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:31.194610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfdba4-b961-4a34-985f-6787780cfaa3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:31.196402 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfdba4-b961-4a34-985f-6787780cfaa3 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:31.208571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-d8bfdba4-b961-4a34-985f-6787780cfaa3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 16:17:31.208571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:31.208571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:31.208571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:31.208571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:31.208571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:31.208571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:31.208571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:31.208571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:31.208571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:31.208571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:31.208571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:31.208571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:31.208571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:31.208571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:31.208571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:31.209562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:31.209562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:31.209562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:31.209562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:31.209562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:31.209562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:31.209562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:31.209562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:31.209562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:31.209562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:31.209562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:31.209562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:31.209562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:31.209562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:31.209562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:31.209562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:31.209562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:31.209562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:31.210567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:31.210567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:31.210567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:31.210567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:31.210567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:31.210567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:31.210567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:31.210567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:31.210567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 16:17:31.210567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:31.211144 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe34cbb-aa37-4bc4-84cb-1c0c797c8200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:31.211529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe34cbb-aa37-4bc4-84cb-1c0c797c8200 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:31.211710 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe34cbb-aa37-4bc4-84cb-1c0c797c8200 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:31.211983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe34cbb-aa37-4bc4-84cb-1c0c797c8200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:31.213111 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 307/659] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:31.214030 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfdba4-b961-4a34-985f-6787780cfaa3 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:31.230338 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:31.286325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe34cbb-aa37-4bc4-84cb-1c0c797c8200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:31.287701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe34cbb-aa37-4bc4-84cb-1c0c797c8200 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:31.319402 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfdba4-b961-4a34-985f-6787780cfaa3 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:31.340754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:31.355549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0869e-f8cc-4255-83d0-019a6c39abe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:31.356484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0869e-f8cc-4255-83d0-019a6c39abe9 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:31.356969 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0869e-f8cc-4255-83d0-019a6c39abe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:31.357413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0869e-f8cc-4255-83d0-019a6c39abe9 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:31.358325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0869e-f8cc-4255-83d0-019a6c39abe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:31.358832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0869e-f8cc-4255-83d0-019a6c39abe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:31.360460 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0869e-f8cc-4255-83d0-019a6c39abe9 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:31.374149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 308/660] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:31.375243 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0869e-f8cc-4255-83d0-019a6c39abe9 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:31.401229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 353/661] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:17:31.405948 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe34cbb-aa37-4bc4-84cb-1c0c797c8200 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:31.450869 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:31.490007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0869e-f8cc-4255-83d0-019a6c39abe9 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:31.506096 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe34cbb-aa37-4bc4-84cb-1c0c797c8200 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:31.528298 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fc9ec-e55a-4e3a-9d36-86cd4acc4b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:31.529336 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fc9ec-e55a-4e3a-9d36-86cd4acc4b46 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:31.529887 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fc9ec-e55a-4e3a-9d36-86cd4acc4b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:31.530470 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fc9ec-e55a-4e3a-9d36-86cd4acc4b46 None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:31.531502 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fc9ec-e55a-4e3a-9d36-86cd4acc4b46 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:31.532017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fc9ec-e55a-4e3a-9d36-86cd4acc4b46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:31.533805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fc9ec-e55a-4e3a-9d36-86cd4acc4b46 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:31.541782 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6717bc2-9920-4cd7-a367-75efd51c440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:31.542349 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6717bc2-9920-4cd7-a367-75efd51c440f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:31.542627 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6717bc2-9920-4cd7-a367-75efd51c440f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:31.542898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6717bc2-9920-4cd7-a367-75efd51c440f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:31.552988 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6717bc2-9920-4cd7-a367-75efd51c440f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:31.554424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6717bc2-9920-4cd7-a367-75efd51c440f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:31.554909 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 309/662] 10.222.0.26 () {56 vars in 1139 bytes} [Tue Sep 27 16:17:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:31.555963 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fc9ec-e55a-4e3a-9d36-86cd4acc4b46 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:31.566587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-d6717bc2-9920-4cd7-a367-75efd51c440f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:31.566587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:31.566587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:31.566587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:31.566587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:31.566587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:31.566587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:31.566587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:31.566587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:31.566587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:31.566587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:31.566587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:31.566587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:31.566587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:31.566587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:31.567534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:31.567534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:31.567534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:31.567534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:31.567534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:31.567534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:31.567534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:31.567534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:31.567534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:31.567534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:31.567534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:31.567534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:31.567534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:31.567534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:31.567534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:31.567534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:31.567534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:31.568493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:31.568493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:31.568493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:31.568493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:31.568493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:31.568493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:31.568493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:31.568493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:31.568493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 354/663] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:31.568493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6717bc2-9920-4cd7-a367-75efd51c440f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:31.578420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:31.669819 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fc9ec-e55a-4e3a-9d36-86cd4acc4b46 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:31.678014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6717bc2-9920-4cd7-a367-75efd51c440f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:31.685393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:31.709250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe12fca-aaec-4817-97bb-0ed9be9791a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:31.710833 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe12fca-aaec-4817-97bb-0ed9be9791a7 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:31.711405 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe12fca-aaec-4817-97bb-0ed9be9791a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:31.711906 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe12fca-aaec-4817-97bb-0ed9be9791a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:31.714521 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675f4c7-bf3a-4746-be47-2b3c1c739aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:31.715239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675f4c7-bf3a-4746-be47-2b3c1c739aae None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:31.715493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675f4c7-bf3a-4746-be47-2b3c1c739aae None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:31.715790 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675f4c7-bf3a-4746-be47-2b3c1c739aae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:31.729444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe12fca-aaec-4817-97bb-0ed9be9791a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:31.733261 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe12fca-aaec-4817-97bb-0ed9be9791a7 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:31.756009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-ffe12fca-aaec-4817-97bb-0ed9be9791a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:31.756009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:31.756009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:31.756009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:31.756009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:31.756009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:31.756009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:31.756009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:31.756009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:31.756009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:31.756009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:31.756009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:31.756009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:31.756009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:31.756009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:31.756009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:31.757029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:31.757029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:31.757029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:31.757029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:31.757029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:31.757029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:31.757029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:31.757029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:31.757029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:31.757029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:31.757029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:31.757029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:31.757029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:31.757029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:31.757029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:31.757029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:31.757029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:31.757938 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:31.757938 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:31.757938 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:31.765211 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 310/664] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:31.765211 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe12fca-aaec-4817-97bb-0ed9be9791a7 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:31.798263 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675f4c7-bf3a-4746-be47-2b3c1c739aae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:31.799727 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675f4c7-bf3a-4746-be47-2b3c1c739aae None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:31.866750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:31.912158 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 355/665] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:17:31.913173 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675f4c7-bf3a-4746-be47-2b3c1c739aae None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:31.915525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe12fca-aaec-4817-97bb-0ed9be9791a7 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:31.922283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:31.955187 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f8dc6-8c16-4855-8897-4df0dd4dfafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:31.955821 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f8dc6-8c16-4855-8897-4df0dd4dfafc None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:31.956095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f8dc6-8c16-4855-8897-4df0dd4dfafc None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:31.957095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f8dc6-8c16-4855-8897-4df0dd4dfafc None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:31.957224 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f8dc6-8c16-4855-8897-4df0dd4dfafc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:31.957458 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f8dc6-8c16-4855-8897-4df0dd4dfafc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:31.958882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f8dc6-8c16-4855-8897-4df0dd4dfafc None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:31.971972 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 311/666] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:31.972863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f8dc6-8c16-4855-8897-4df0dd4dfafc None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:32.047002 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675f4c7-bf3a-4746-be47-2b3c1c739aae None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:32.083288 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675d8c3-b680-4035-880a-5719b3d1c0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:32.083813 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675d8c3-b680-4035-880a-5719b3d1c0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:32.084094 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675d8c3-b680-4035-880a-5719b3d1c0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:32.084391 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675d8c3-b680-4035-880a-5719b3d1c0c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:32.085035 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675d8c3-b680-4035-880a-5719b3d1c0c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:32.085337 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675d8c3-b680-4035-880a-5719b3d1c0c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:32.086698 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675d8c3-b680-4035-880a-5719b3d1c0c7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:32.087633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f8dc6-8c16-4855-8897-4df0dd4dfafc None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:32.099131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 356/667] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:32.100082 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675d8c3-b680-4035-880a-5719b3d1c0c7 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:32.116053 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:32.125573 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcad45-ef95-4380-9cde-5505948f3eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:32.130154 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcad45-ef95-4380-9cde-5505948f3eaf None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:32.130154 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcad45-ef95-4380-9cde-5505948f3eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:32.130154 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcad45-ef95-4380-9cde-5505948f3eaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:32.141584 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcad45-ef95-4380-9cde-5505948f3eaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:32.143184 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcad45-ef95-4380-9cde-5505948f3eaf None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:32.160659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-d2bcad45-ef95-4380-9cde-5505948f3eaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:32.160659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:32.160659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:32.160659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:32.160659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:32.160659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:32.160659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:32.160659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:32.160659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:32.160659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:32.160659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:32.160659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:32.160659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:32.160659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:32.160659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:32.160659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:32.161691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:32.161691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:32.161691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:32.161691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:32.161691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:32.161691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:32.161691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:32.161691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:32.161691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:32.161691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:32.161691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:32.161691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:32.161691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:32.161691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:32.161691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:32.161691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:32.161691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:32.162608 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:32.162608 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:32.162608 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:32.162608 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 312/668] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:32.163261 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcad45-ef95-4380-9cde-5505948f3eaf None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:32.172159 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:32.210702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675d8c3-b680-4035-880a-5719b3d1c0c7 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:32.245950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae0527-5073-480e-a783-65de327f8eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:32.246165 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae0527-5073-480e-a783-65de327f8eba None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:32.246422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae0527-5073-480e-a783-65de327f8eba None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:32.246693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae0527-5073-480e-a783-65de327f8eba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:32.247970 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae0527-5073-480e-a783-65de327f8eba None admin] RBAC: Adding query filter params (role.id=2696068001744b38a289a59c56f56a95, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=edca8115256546ee8a209f1eca99d972) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:32.248276 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae0527-5073-480e-a783-65de327f8eba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:32.249725 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae0527-5073-480e-a783-65de327f8eba None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:32.260473 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 357/669] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:17:32 2022] GET /identity/v3/role_assignments?user.id=edca8115256546ee8a209f1eca99d972&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=2696068001744b38a289a59c56f56a95 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:32.261422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae0527-5073-480e-a783-65de327f8eba None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:32.280094 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcad45-ef95-4380-9cde-5505948f3eaf None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:32.321852 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b8006-d62d-48c2-8dd6-33484deb76ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:32.322855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b8006-d62d-48c2-8dd6-33484deb76ac None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:32.323284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b8006-d62d-48c2-8dd6-33484deb76ac None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:32.323728 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b8006-d62d-48c2-8dd6-33484deb76ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:32.333022 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b8006-d62d-48c2-8dd6-33484deb76ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:32.335005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b8006-d62d-48c2-8dd6-33484deb76ac None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:32.349410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-040b8006-d62d-48c2-8dd6-33484deb76ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:32.349410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:32.349410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:32.349410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:32.349410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:32.349410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:32.349410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:32.349410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:32.349410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:32.349410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:32.349410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:32.349410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:32.349410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:32.349410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:32.349410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:32.350565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:32.350565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:32.350565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:32.350565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:32.350565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:32.350565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:32.350565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:32.350565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:32.350565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:32.350565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:32.350565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:32.350565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:32.350565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:32.350565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:32.350565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:32.350565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:32.350565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:32.351533 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:32.351533 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:32.351533 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:32.351533 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:32.351533 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:32.351533 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:32.351533 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:32.351533 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:32.353999 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 313/670] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:32.355538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d0670-c1a6-44f9-a2e1-94d03c9ce54e None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:32.359261 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d0670-c1a6-44f9-a2e1-94d03c9ce54e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:32.359261 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d0670-c1a6-44f9-a2e1-94d03c9ce54e None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:32.359261 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 314/671] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:32.368402 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65860e-2fad-4a7b-8b09-36ba18353049 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:32.368402 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65860e-2fad-4a7b-8b09-36ba18353049 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:32.368402 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65860e-2fad-4a7b-8b09-36ba18353049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:32.388145 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-df65860e-2fad-4a7b-8b09-36ba18353049 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:32.389800 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-df65860e-2fad-4a7b-8b09-36ba18353049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:32.394036 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae0527-5073-480e-a783-65de327f8eba None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:32.427079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:32.433521 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a4e97-d81a-4b25-bbc8-1a412e07fd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:32.434148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a4e97-d81a-4b25-bbc8-1a412e07fd02 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:32.434426 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a4e97-d81a-4b25-bbc8-1a412e07fd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:32.435315 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a4e97-d81a-4b25-bbc8-1a412e07fd02 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:32.435969 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a4e97-d81a-4b25-bbc8-1a412e07fd02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:32.436272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a4e97-d81a-4b25-bbc8-1a412e07fd02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:32.437750 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a4e97-d81a-4b25-bbc8-1a412e07fd02 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:32.439196 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:32.451476 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 358/672] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:32.452480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a4e97-d81a-4b25-bbc8-1a412e07fd02 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:32.470444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 315/673] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:32.471559 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65860e-2fad-4a7b-8b09-36ba18353049 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:32.570471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a4e97-d81a-4b25-bbc8-1a412e07fd02 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:32.588529 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65860e-2fad-4a7b-8b09-36ba18353049 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:32.615530 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6c348-81e8-423b-87df-6a9021942f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:32.616293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6c348-81e8-423b-87df-6a9021942f33 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:32.616595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6c348-81e8-423b-87df-6a9021942f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:32.617209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6c348-81e8-423b-87df-6a9021942f33 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:32.618158 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6c348-81e8-423b-87df-6a9021942f33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:32.618464 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6c348-81e8-423b-87df-6a9021942f33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:32.620387 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6c348-81e8-423b-87df-6a9021942f33 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:32.625081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54f920-4c44-4312-a773-c43bc77df955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:32.625721 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54f920-4c44-4312-a773-c43bc77df955 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:32.625998 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54f920-4c44-4312-a773-c43bc77df955 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:32.626271 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54f920-4c44-4312-a773-c43bc77df955 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:32.634096 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 359/674] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:32.634268 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54f920-4c44-4312-a773-c43bc77df955 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:32.635964 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54f920-4c44-4312-a773-c43bc77df955 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:32.636169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760cda3-052e-4547-8223-fc50e9390aa3 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:32.636720 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760cda3-052e-4547-8223-fc50e9390aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:32.637194 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760cda3-052e-4547-8223-fc50e9390aa3 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:32.640467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 360/675] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:32.641224 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760cda3-052e-4547-8223-fc50e9390aa3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:32.648961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-3c54f920-4c44-4312-a773-c43bc77df955 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:32.648961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:32.648961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:32.648961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:32.648961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:32.648961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:32.648961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:32.648961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:32.648961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:32.648961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:32.648961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:32.648961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:32.648961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:32.648961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:32.648961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:32.650048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:32.650048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:32.650048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:32.650048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:32.650048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:32.650048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:32.650048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:32.650048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:32.650048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:32.650048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:32.650048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:32.650048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:32.650048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:32.650048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:32.650048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:32.650048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:32.650048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:32.651125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:32.651125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:32.651125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:32.651125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:32.651125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:32.651125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:32.651125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:32.651125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:32.651125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 316/676] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:32.651642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b8ac2-3792-46d2-bf57-c1f63161a1ec None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:32.654863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b8ac2-3792-46d2-bf57-c1f63161a1ec None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:32.654863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b8ac2-3792-46d2-bf57-c1f63161a1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:32.672979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-3f7b8ac2-3792-46d2-bf57-c1f63161a1ec None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:32.674172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3f7b8ac2-3792-46d2-bf57-c1f63161a1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:32.700160 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:32.701929 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:32.748221 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 317/677] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:32.749463 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b8ac2-3792-46d2-bf57-c1f63161a1ec None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:32.764499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760cda3-052e-4547-8223-fc50e9390aa3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:32.809862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cd422-afff-4c02-8fc2-685d7979a2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:32.810472 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cd422-afff-4c02-8fc2-685d7979a2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:32.810750 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cd422-afff-4c02-8fc2-685d7979a2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:32.811024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cd422-afff-4c02-8fc2-685d7979a2c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:32.812050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cd422-afff-4c02-8fc2-685d7979a2c5 None admin] RBAC: Adding query filter params (role.id=2696068001744b38a289a59c56f56a95, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=e15cb1d012934ebeac53af885ca65f75) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:32.812373 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cd422-afff-4c02-8fc2-685d7979a2c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:32.814091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cd422-afff-4c02-8fc2-685d7979a2c5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:32.821678 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 361/678] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:17:32 2022] GET /identity/v3/role_assignments?user.id=e15cb1d012934ebeac53af885ca65f75&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=2696068001744b38a289a59c56f56a95 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:32.822904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cd422-afff-4c02-8fc2-685d7979a2c5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:32.920210 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b8ac2-3792-46d2-bf57-c1f63161a1ec None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:32.951266 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cd422-afff-4c02-8fc2-685d7979a2c5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:32.971557 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:32.994482 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0bfed6-97da-4354-8cda-c7a028ba53e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:33.000359 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bfed6-97da-4354-8cda-c7a028ba53e2 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:33.000359 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bfed6-97da-4354-8cda-c7a028ba53e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:33.000359 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bfed6-97da-4354-8cda-c7a028ba53e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:33.002484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3897014-1ddc-4df2-8e86-7bc5fc46aaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:33.003345 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3897014-1ddc-4df2-8e86-7bc5fc46aaaa None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:33.003967 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3897014-1ddc-4df2-8e86-7bc5fc46aaaa None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:33.004493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3897014-1ddc-4df2-8e86-7bc5fc46aaaa None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:33.005411 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3897014-1ddc-4df2-8e86-7bc5fc46aaaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:33.005919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3897014-1ddc-4df2-8e86-7bc5fc46aaaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:33.007571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3897014-1ddc-4df2-8e86-7bc5fc46aaaa None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:33.008851 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0bfed6-97da-4354-8cda-c7a028ba53e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:33.015718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-6f0bfed6-97da-4354-8cda-c7a028ba53e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:33.015718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:33.015718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:33.015718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:33.015718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:33.015718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:33.015718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:33.015718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:33.015718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:33.015718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:33.015718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:33.015718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:33.015718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:33.015718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:33.015718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:33.015718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:33.017063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:33.017063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:33.017063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:33.017063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:33.017063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:33.017063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:33.017063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:33.017063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:33.017063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:33.017063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:33.017063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:33.017063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:33.017063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:33.017063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:33.017063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:33.017063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:33.017939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:33.017939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:33.017939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:33.017939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:33.017939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:33.017939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:33.017939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:33.017939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:33.017939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:33.017939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:33.017939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:33.017939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:33.017939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 362/679] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:33.025732 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0bfed6-97da-4354-8cda-c7a028ba53e2 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:33.028367 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 318/680] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:33.029241 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3897014-1ddc-4df2-8e86-7bc5fc46aaaa None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:33.058030 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:33.150402 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0bfed6-97da-4354-8cda-c7a028ba53e2 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:33.161254 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3897014-1ddc-4df2-8e86-7bc5fc46aaaa None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:33.188467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f269f3c-34b2-490b-9823-516f99d4de93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:33.188990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f269f3c-34b2-490b-9823-516f99d4de93 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:33.189264 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f269f3c-34b2-490b-9823-516f99d4de93 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:33.190496 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f269f3c-34b2-490b-9823-516f99d4de93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:33.202378 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f269f3c-34b2-490b-9823-516f99d4de93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:33.207027 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236be308-6405-4efa-addd-81d77245ee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:33.207646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-7f269f3c-34b2-490b-9823-516f99d4de93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:17:33.207646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:33.207646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:33.207646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:33.207646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:33.207646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:33.207646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:33.207646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:33.207646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:33.207646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:33.207646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:33.207646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:33.207646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:33.207646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:33.207646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:33.207646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:33.208599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:33.208599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:33.208599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:33.208599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:33.208599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:33.208599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:33.208599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:33.208599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:33.208599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:33.208599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:33.208599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:33.208599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:33.208599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:33.208599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:33.208599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:33.208599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:33.209465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:33.209465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:33.209465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:33.209465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:33.209465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:33.209465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:33.209465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:33.209465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:33.209465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:33.209465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:33.209465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:17:33.209465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:33.210149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236be308-6405-4efa-addd-81d77245ee85 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:33.210149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236be308-6405-4efa-addd-81d77245ee85 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:33.210149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236be308-6405-4efa-addd-81d77245ee85 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:33.210149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236be308-6405-4efa-addd-81d77245ee85 None admin] RBAC: Adding query filter params (name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:33.210396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 363/681] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:17:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:33.210467 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236be308-6405-4efa-addd-81d77245ee85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:33.210543 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f269f3c-34b2-490b-9823-516f99d4de93 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:33.211157 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236be308-6405-4efa-addd-81d77245ee85 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:33.221492 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 319/682] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:17:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:33.224819 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236be308-6405-4efa-addd-81d77245ee85 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:33.268420 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:33.323092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:33.342140 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236be308-6405-4efa-addd-81d77245ee85 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:33.361642 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f269f3c-34b2-490b-9823-516f99d4de93 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:33.377724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c750d-5c7e-408e-8899-8aa868dc8e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:33.378511 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c750d-5c7e-408e-8899-8aa868dc8e99 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:33.378864 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c750d-5c7e-408e-8899-8aa868dc8e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:33.379198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c750d-5c7e-408e-8899-8aa868dc8e99 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:33.379924 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c750d-5c7e-408e-8899-8aa868dc8e99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:33.380316 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c750d-5c7e-408e-8899-8aa868dc8e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:33.382163 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c750d-5c7e-408e-8899-8aa868dc8e99 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:33.394298 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 320/683] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:17:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:33.395328 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c750d-5c7e-408e-8899-8aa868dc8e99 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:33.414765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566bba6-43e4-4e31-97ed-2bf0cd927f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:33.415764 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566bba6-43e4-4e31-97ed-2bf0cd927f06 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:33.416206 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566bba6-43e4-4e31-97ed-2bf0cd927f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:33.416703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566bba6-43e4-4e31-97ed-2bf0cd927f06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:33.417744 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566bba6-43e4-4e31-97ed-2bf0cd927f06 None admin] RBAC: Adding query filter params (role.id=2696068001744b38a289a59c56f56a95, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=758380280e33458f8f9112147d5a7819) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:33.418312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566bba6-43e4-4e31-97ed-2bf0cd927f06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:33.420432 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566bba6-43e4-4e31-97ed-2bf0cd927f06 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:33.436795 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 364/684] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:17:33 2022] GET /identity/v3/role_assignments?user.id=758380280e33458f8f9112147d5a7819&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=2696068001744b38a289a59c56f56a95 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:33.438172 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566bba6-43e4-4e31-97ed-2bf0cd927f06 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:33.554291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c750d-5c7e-408e-8899-8aa868dc8e99 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:33.554896 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:33.560262 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566bba6-43e4-4e31-97ed-2bf0cd927f06 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:33.602300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4747f-0456-428f-84bd-82736a178ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:33.604173 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4747f-0456-428f-84bd-82736a178ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:33.605498 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4747f-0456-428f-84bd-82736a178ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:33.606094 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4747f-0456-428f-84bd-82736a178ce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:33.629069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4747f-0456-428f-84bd-82736a178ce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:33.629980 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ece293-143f-4166-9347-45b024967783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:33.630807 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ece293-143f-4166-9347-45b024967783 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:33.631236 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ece293-143f-4166-9347-45b024967783 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:33.633161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ece293-143f-4166-9347-45b024967783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:33.634084 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4747f-0456-428f-84bd-82736a178ce9 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:33.656806 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ece293-143f-4166-9347-45b024967783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:33.659715 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ece293-143f-4166-9347-45b024967783 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:33.664229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-93b4747f-0456-428f-84bd-82736a178ce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:33.664229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:33.664229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:33.664229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:33.664229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:33.664229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:33.664229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:33.664229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:33.664229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:33.664229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:33.664229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:33.664229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:33.664229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:33.664229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:33.664229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:33.664229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:33.665398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:33.665398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:33.665398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:33.665398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:33.665398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:33.665398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:33.665398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:33.665398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:33.665398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:33.665398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:33.665398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:33.665398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:33.665398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:33.665398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:33.665398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:33.665398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:33.665398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:33.666323 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:33.666323 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:33.666323 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:33.668059 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 365/685] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:33.674290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:33.675698 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4747f-0456-428f-84bd-82736a178ce9 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:33.698984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-93ece293-143f-4166-9347-45b024967783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:33.698984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:33.698984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:33.698984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:33.698984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:33.698984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:33.698984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:33.698984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:33.698984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:33.698984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:33.698984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:33.698984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:33.698984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:33.698984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:33.698984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:33.698984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:33.700304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:33.700304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:33.700304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:33.700304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:33.700304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:33.700304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:33.700304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:33.700304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:33.700304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:33.700304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:33.700304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:33.700304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:33.700304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:33.700304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:33.700304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:33.700304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:33.700304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:33.701431 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:33.701431 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:33.701431 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:33.701431 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 321/686] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:33.707803 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ece293-143f-4166-9347-45b024967783 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:33.816676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4747f-0456-428f-84bd-82736a178ce9 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:33.837129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ece293-143f-4166-9347-45b024967783 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:33.856081 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb9736-d25d-4397-ad4e-4b1c90824b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:33.857507 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb9736-d25d-4397-ad4e-4b1c90824b42 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:33.857971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb9736-d25d-4397-ad4e-4b1c90824b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:33.858426 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb9736-d25d-4397-ad4e-4b1c90824b42 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:33.859305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb9736-d25d-4397-ad4e-4b1c90824b42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:33.859832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb9736-d25d-4397-ad4e-4b1c90824b42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:33.861416 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb9736-d25d-4397-ad4e-4b1c90824b42 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:33.875955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406f930-f44b-4f2c-b324-e636d9c184e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:33.876749 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406f930-f44b-4f2c-b324-e636d9c184e7 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:33.876880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 366/687] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:33.880366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406f930-f44b-4f2c-b324-e636d9c184e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:33.880366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406f930-f44b-4f2c-b324-e636d9c184e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:33.880366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406f930-f44b-4f2c-b324-e636d9c184e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:33.880366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406f930-f44b-4f2c-b324-e636d9c184e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:33.880366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406f930-f44b-4f2c-b324-e636d9c184e7 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:33.883130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb9736-d25d-4397-ad4e-4b1c90824b42 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:33.896486 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:33.898407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 322/688] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:33.899811 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406f930-f44b-4f2c-b324-e636d9c184e7 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:33.964722 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:34.006130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb9736-d25d-4397-ad4e-4b1c90824b42 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:34.010211 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406f930-f44b-4f2c-b324-e636d9c184e7 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:34.044847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f4db2-c464-4b25-be4a-fcfc8ed4ee46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:34.045641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f4db2-c464-4b25-be4a-fcfc8ed4ee46 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:34.046029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37dc77-e108-4d3a-8ad6-e186c4e990db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:34.046191 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f4db2-c464-4b25-be4a-fcfc8ed4ee46 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:34.046488 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f4db2-c464-4b25-be4a-fcfc8ed4ee46 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:34.047101 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37dc77-e108-4d3a-8ad6-e186c4e990db None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:34.047524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37dc77-e108-4d3a-8ad6-e186c4e990db None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:34.047941 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37dc77-e108-4d3a-8ad6-e186c4e990db None admin] PATH_INFO: `/v3/users/nova` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:34.054274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f4db2-c464-4b25-be4a-fcfc8ed4ee46 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:34.055579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37dc77-e108-4d3a-8ad6-e186c4e990db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:34.056017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f4db2-c464-4b25-be4a-fcfc8ed4ee46 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:34.057343 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37dc77-e108-4d3a-8ad6-e186c4e990db None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:34.068724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-096f4db2-c464-4b25-be4a-fcfc8ed4ee46 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 16:17:34.068724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:34.068724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:34.068724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:34.068724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:34.068724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:34.068724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:34.068724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:34.068724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:34.068724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:34.068724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:34.068724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:34.068724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:34.068724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:34.068724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:34.068724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:34.069908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:34.069908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:34.069908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:34.069908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:34.069908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:34.069908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:34.069908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:34.069908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:34.069908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:34.069908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:34.069908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:34.069908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:34.069908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:34.069908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:34.069908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:34.069908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:34.069908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:34.069908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:34.070889 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:34.070889 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:34.070889 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:34.070889 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:34.070889 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:34.070889 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:34.070889 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:34.070889 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:34.070889 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 27 16:17:34.070889 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:34.074072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-4b37dc77-e108-4d3a-8ad6-e186c4e990db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 16:17:34.074072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:34.074072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:34.074072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:34.074072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:34.074072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:34.074072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:34.074072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:34.074072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:34.074072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:34.074072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:34.074072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:34.074072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:34.074072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:34.074072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:34.074072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:34.074978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:34.074978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:34.074978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:34.074978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:34.074978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:34.074978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:34.074978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:34.074978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:34.074978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:34.074978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:34.074978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:34.074978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:34.074978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:34.074978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:34.074978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:34.074978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:34.074978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:34.074978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:34.075975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:34.075975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:34.075975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:34.075975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:34.075975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:34.075975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:34.075975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:34.075975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:34.075975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 16:17:34.075975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:34.076532 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 323/689] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:17:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:34.077478 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f4db2-c464-4b25-be4a-fcfc8ed4ee46 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:34.078769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 367/690] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Sep 27 16:17:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:34.084457 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37dc77-e108-4d3a-8ad6-e186c4e990db None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:34.159555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:34.195177 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37dc77-e108-4d3a-8ad6-e186c4e990db None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:34.234147 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f246b-12e1-4e82-a22b-92641375006f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:34.235304 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f246b-12e1-4e82-a22b-92641375006f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:34.235795 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f246b-12e1-4e82-a22b-92641375006f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:34.236443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f246b-12e1-4e82-a22b-92641375006f None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:34.237342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f246b-12e1-4e82-a22b-92641375006f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:34.238244 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f246b-12e1-4e82-a22b-92641375006f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:34.239872 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f246b-12e1-4e82-a22b-92641375006f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:34.262028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 368/691] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Sep 27 16:17:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:34.267936 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f246b-12e1-4e82-a22b-92641375006f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:34.290365 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f4db2-c464-4b25-be4a-fcfc8ed4ee46 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:34.320785 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:34.363822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d11f71-7f96-4b1d-8322-cf2035b6304d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:34.364650 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d11f71-7f96-4b1d-8322-cf2035b6304d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:34.365032 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d11f71-7f96-4b1d-8322-cf2035b6304d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:34.365361 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d11f71-7f96-4b1d-8322-cf2035b6304d None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:34.366166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d11f71-7f96-4b1d-8322-cf2035b6304d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:34.366545 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d11f71-7f96-4b1d-8322-cf2035b6304d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:34.368125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d11f71-7f96-4b1d-8322-cf2035b6304d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:34.386589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f246b-12e1-4e82-a22b-92641375006f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:34.390432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 324/692] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Sep 27 16:17:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:34.391783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d11f71-7f96-4b1d-8322-cf2035b6304d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:34.418098 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:34.429300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948c5c1-9460-4c2a-99b6-19d017c47b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:34.430255 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948c5c1-9460-4c2a-99b6-19d017c47b67 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:34.430715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948c5c1-9460-4c2a-99b6-19d017c47b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:34.431168 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948c5c1-9460-4c2a-99b6-19d017c47b67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:34.508616 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948c5c1-9460-4c2a-99b6-19d017c47b67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:34.510345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948c5c1-9460-4c2a-99b6-19d017c47b67 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:34.618582 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 369/693] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 16:17:34.624366 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948c5c1-9460-4c2a-99b6-19d017c47b67 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:34.658246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d11f71-7f96-4b1d-8322-cf2035b6304d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:34.660174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:34.734670 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948c5c1-9460-4c2a-99b6-19d017c47b67 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:34.758396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054926c-9332-4d9a-8e82-6a452846a6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:34.759015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054926c-9332-4d9a-8e82-6a452846a6cf None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:34.759374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054926c-9332-4d9a-8e82-6a452846a6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:34.759551 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054926c-9332-4d9a-8e82-6a452846a6cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:34.771690 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4f6a7-5889-4604-921e-4cb8a427f33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:34.772709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4f6a7-5889-4604-921e-4cb8a427f33b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:34.773192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4f6a7-5889-4604-921e-4cb8a427f33b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:34.773665 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4f6a7-5889-4604-921e-4cb8a427f33b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:34.792203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4f6a7-5889-4604-921e-4cb8a427f33b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:34.794078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4f6a7-5889-4604-921e-4cb8a427f33b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:34.811565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-c0b4f6a7-5889-4604-921e-4cb8a427f33b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:34.811565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:34.811565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:34.811565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:34.811565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:34.811565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:34.811565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:34.811565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:34.811565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:34.811565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:34.811565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:34.811565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:34.811565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:34.811565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:34.811565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:34.811565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:34.812585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:34.812585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:34.812585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:34.812585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:34.812585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:34.812585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:34.812585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:34.812585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:34.812585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:34.812585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:34.812585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:34.812585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:34.812585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:34.812585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:34.812585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:34.812585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:34.812585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:34.813499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:34.813499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:34.813499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:34.815558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 370/694] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:34.821592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4f6a7-5889-4604-921e-4cb8a427f33b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:34.841908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:34.869211 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054926c-9332-4d9a-8e82-6a452846a6cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:34.871032 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054926c-9332-4d9a-8e82-6a452846a6cf None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:34.914862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:34.938306 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4f6a7-5889-4604-921e-4cb8a427f33b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:34.978198 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718aabc2-9788-4d7e-890e-37ddf5791273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:34.979175 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718aabc2-9788-4d7e-890e-37ddf5791273 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:34.979664 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718aabc2-9788-4d7e-890e-37ddf5791273 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:34.980160 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718aabc2-9788-4d7e-890e-37ddf5791273 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:34.981025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718aabc2-9788-4d7e-890e-37ddf5791273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:34.981178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 325/695] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 16:17:34.982127 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718aabc2-9788-4d7e-890e-37ddf5791273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:34.982396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb848a0c-88b5-4cb0-98d5-f4875675f46b None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:34.982684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb848a0c-88b5-4cb0-98d5-f4875675f46b None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:34.982961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb848a0c-88b5-4cb0-98d5-f4875675f46b None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:34.988368 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 326/696] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:34.988368 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb848a0c-88b5-4cb0-98d5-f4875675f46b None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:34.988763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718aabc2-9788-4d7e-890e-37ddf5791273 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:35.007772 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 371/697] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:35.010009 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92524e-7a99-46bb-b408-e9647530874d None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:35.010617 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92524e-7a99-46bb-b408-e9647530874d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:35.011099 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92524e-7a99-46bb-b408-e9647530874d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:35.032071 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-5f92524e-7a99-46bb-b408-e9647530874d None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:35.033678 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5f92524e-7a99-46bb-b408-e9647530874d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:35.064133 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:35.089920 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb848a0c-88b5-4cb0-98d5-f4875675f46b None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:35.116623 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 372/698] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:35.118040 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92524e-7a99-46bb-b408-e9647530874d None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:35.126431 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db595c6-8791-49b2-9d9b-fb63295cb3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:35.127056 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db595c6-8791-49b2-9d9b-fb63295cb3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:35.127333 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db595c6-8791-49b2-9d9b-fb63295cb3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:35.127608 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db595c6-8791-49b2-9d9b-fb63295cb3f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:35.138717 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db595c6-8791-49b2-9d9b-fb63295cb3f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:35.140488 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db595c6-8791-49b2-9d9b-fb63295cb3f9 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:35.155953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-8db595c6-8791-49b2-9d9b-fb63295cb3f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:35.155953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:35.155953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:35.155953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:35.155953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:35.155953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:35.155953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:35.155953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:35.155953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:35.155953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:35.155953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:35.155953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:35.155953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:35.155953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:35.155953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:35.155953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:35.157037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:35.157037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:35.157037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:35.157037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:35.157037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:35.157037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:35.157037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:35.157037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:35.157037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:35.157037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:35.157037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:35.157037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:35.157037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:35.157037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:35.157037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:35.157037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:35.157037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:35.157960 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:35.157960 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:35.157960 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:35.157960 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 327/699] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:35.165279 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db595c6-8791-49b2-9d9b-fb63295cb3f9 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:35.242772 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:35.305398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92524e-7a99-46bb-b408-e9647530874d None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:35.317974 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db595c6-8791-49b2-9d9b-fb63295cb3f9 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:35.371091 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:35.384001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73957830-b683-4f15-9201-d306074a70f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:35.384001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73957830-b683-4f15-9201-d306074a70f4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:35.384001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73957830-b683-4f15-9201-d306074a70f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:35.384001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73957830-b683-4f15-9201-d306074a70f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:35.389845 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a315e-c026-43d5-8420-1acdcbd39b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:35.390453 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a315e-c026-43d5-8420-1acdcbd39b21 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:35.390789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a315e-c026-43d5-8420-1acdcbd39b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:35.391067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a315e-c026-43d5-8420-1acdcbd39b21 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:35.391759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a315e-c026-43d5-8420-1acdcbd39b21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:35.392063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a315e-c026-43d5-8420-1acdcbd39b21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:35.393686 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73957830-b683-4f15-9201-d306074a70f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:35.395124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73957830-b683-4f15-9201-d306074a70f4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:35.396213 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a315e-c026-43d5-8420-1acdcbd39b21 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:35.415921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-73957830-b683-4f15-9201-d306074a70f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:35.415921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:35.415921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:35.415921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:35.415921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:35.415921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:35.415921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:35.415921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:35.415921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:35.415921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:35.415921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:35.415921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:35.415921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:35.415921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:35.415921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:35.416942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:35.416942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:35.416942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:35.416942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:35.416942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:35.416942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:35.416942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:35.416942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:35.416942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:35.416942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:35.416942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:35.416942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:35.416942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:35.416942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:35.416942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:35.416942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:35.416942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:35.417893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:35.417893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:35.417893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:35.417893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:35.417893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:35.417893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:35.417893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:35.417893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:35.417893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 373/700] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:35.425229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73957830-b683-4f15-9201-d306074a70f4 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:35.430336 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 328/701] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:35.441735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a315e-c026-43d5-8420-1acdcbd39b21 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:35.551862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73957830-b683-4f15-9201-d306074a70f4 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:35.558921 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a315e-c026-43d5-8420-1acdcbd39b21 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:35.582957 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:35.587693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fac91-b0ef-4f60-a840-47e94123c244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:35.588254 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fac91-b0ef-4f60-a840-47e94123c244 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:35.588570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fac91-b0ef-4f60-a840-47e94123c244 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:35.588843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fac91-b0ef-4f60-a840-47e94123c244 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:35.591954 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fac91-b0ef-4f60-a840-47e94123c244 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:35.591954 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fac91-b0ef-4f60-a840-47e94123c244 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:35.591954 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fac91-b0ef-4f60-a840-47e94123c244 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:35.598570 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22700495-ac5d-47ee-97f8-bd86fe185cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:35.598904 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22700495-ac5d-47ee-97f8-bd86fe185cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:35.599177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22700495-ac5d-47ee-97f8-bd86fe185cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:35.599444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22700495-ac5d-47ee-97f8-bd86fe185cc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:35.608963 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 374/702] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:35.608963 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874cb87-efec-448e-a7f4-e46a542f465c None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:35.608963 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874cb87-efec-448e-a7f4-e46a542f465c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:35.608963 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874cb87-efec-448e-a7f4-e46a542f465c None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:35.609319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22700495-ac5d-47ee-97f8-bd86fe185cc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:35.609319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22700495-ac5d-47ee-97f8-bd86fe185cc8 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:35.611688 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 375/703] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:35.612555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874cb87-efec-448e-a7f4-e46a542f465c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:35.620937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-22700495-ac5d-47ee-97f8-bd86fe185cc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:35.620937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:35.620937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:35.620937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:35.620937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:35.620937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:35.620937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:35.620937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:35.620937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:35.620937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:35.620937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:35.620937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:35.620937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:35.620937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:35.620937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:35.621884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:35.621884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:35.621884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:35.621884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:35.621884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:35.621884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:35.621884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:35.621884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:35.621884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:35.621884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:35.621884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:35.621884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:35.621884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:35.621884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:35.621884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:35.621884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:35.621884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:35.622882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:35.622882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:35.622882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:35.622882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:35.622882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:35.622882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:35.622882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:35.622882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:35.622882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 329/704] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:35.622882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22700495-ac5d-47ee-97f8-bd86fe185cc8 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:35.670411 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:35.725039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22700495-ac5d-47ee-97f8-bd86fe185cc8 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:35.727880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874cb87-efec-448e-a7f4-e46a542f465c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:35.760595 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21491b-d84e-4009-bd9f-5b288579682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:35.761203 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21491b-d84e-4009-bd9f-5b288579682a None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:35.761485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21491b-d84e-4009-bd9f-5b288579682a None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:35.761759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21491b-d84e-4009-bd9f-5b288579682a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:35.762473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21491b-d84e-4009-bd9f-5b288579682a None admin] RBAC: Adding query filter params (role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=e71fea96b2b949f9abca12172e69284b) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:35.763329 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21491b-d84e-4009-bd9f-5b288579682a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:35.764228 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36677beb-7bc3-4b37-9715-95f27b7196c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:35.764815 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21491b-d84e-4009-bd9f-5b288579682a None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:35.764931 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36677beb-7bc3-4b37-9715-95f27b7196c2 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:35.765144 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36677beb-7bc3-4b37-9715-95f27b7196c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:35.765415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36677beb-7bc3-4b37-9715-95f27b7196c2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:35.765990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36677beb-7bc3-4b37-9715-95f27b7196c2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:35.767329 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36677beb-7bc3-4b37-9715-95f27b7196c2 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:35.778639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 330/705] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:17:35 2022] GET /identity/v3/role_assignments?user.id=e71fea96b2b949f9abca12172e69284b&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:35.778639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecf2f1-eaf5-44d2-a520-48d7bff41244 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:35.778639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecf2f1-eaf5-44d2-a520-48d7bff41244 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:35.778639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecf2f1-eaf5-44d2-a520-48d7bff41244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:35.792232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-afecf2f1-eaf5-44d2-a520-48d7bff41244 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:35.793659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-afecf2f1-eaf5-44d2-a520-48d7bff41244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:35.798410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-36677beb-7bc3-4b37-9715-95f27b7196c2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 16:17:35.798410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:35.798410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:17:35.798410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:17:35.798410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:17:35.798410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:17:35.798410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:17:35.798410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:35.798410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 16:17:35.798410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:35.798410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:17:35.798410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:35.798410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:35.798410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:35.798410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:35.798410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:35.798410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:35.799631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:35.799631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:35.799631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:35.799631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:35.799631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:35.799631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:35.799631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:17:35.799631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:17:35.799631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:17:35.799631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:17:35.799631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:35.799631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:35.799631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:35.799631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:35.799631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:35.799631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:35.800691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:35.800691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:35.800691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:35.800691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:35.800691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:35.800691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:35.800691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:35.800691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:35.800691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:35.800691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:35.800691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:17:35.800691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:35.800691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 16:17:35.800691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:35.800691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 376/706] 10.222.0.26 () {56 vars in 1129 bytes} [Tue Sep 27 16:17:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:35.801765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36677beb-7bc3-4b37-9715-95f27b7196c2 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:35.881271 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:35.908502 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 331/707] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:35.909419 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecf2f1-eaf5-44d2-a520-48d7bff41244 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:35.959210 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36677beb-7bc3-4b37-9715-95f27b7196c2 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:35.989513 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:36.028017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9318977-f261-46d1-bac1-cc9d79b108c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:36.028793 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9318977-f261-46d1-bac1-cc9d79b108c8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:36.028990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9318977-f261-46d1-bac1-cc9d79b108c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:36.029266 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9318977-f261-46d1-bac1-cc9d79b108c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:36.029955 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9318977-f261-46d1-bac1-cc9d79b108c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:36.030261 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9318977-f261-46d1-bac1-cc9d79b108c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:36.031804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9318977-f261-46d1-bac1-cc9d79b108c8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:36.051584 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecf2f1-eaf5-44d2-a520-48d7bff41244 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:36.056828 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 377/708] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:36.068356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9318977-f261-46d1-bac1-cc9d79b108c8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:36.120026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbcc28-ed25-43d3-a4f6-9682ab4bfcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:36.120727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbcc28-ed25-43d3-a4f6-9682ab4bfcee None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:36.121000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbcc28-ed25-43d3-a4f6-9682ab4bfcee None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:36.121319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbcc28-ed25-43d3-a4f6-9682ab4bfcee None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:36.121990 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbcc28-ed25-43d3-a4f6-9682ab4bfcee None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:36.122296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbcc28-ed25-43d3-a4f6-9682ab4bfcee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:36.123668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbcc28-ed25-43d3-a4f6-9682ab4bfcee None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:36.140916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 332/709] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Sep 27 16:17:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:36.145772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbcc28-ed25-43d3-a4f6-9682ab4bfcee None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:36.236070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9318977-f261-46d1-bac1-cc9d79b108c8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:36.251221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:36.272841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33da78-ee45-4174-9157-af3896d0aa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:36.273453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33da78-ee45-4174-9157-af3896d0aa0b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:36.273732 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33da78-ee45-4174-9157-af3896d0aa0b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:36.274010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33da78-ee45-4174-9157-af3896d0aa0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:36.274752 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33da78-ee45-4174-9157-af3896d0aa0b None admin] RBAC: Adding query filter params (role.id=2696068001744b38a289a59c56f56a95, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=e70b85e430004a8b865622354c1d1ed4) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:36.275153 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33da78-ee45-4174-9157-af3896d0aa0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:36.276668 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33da78-ee45-4174-9157-af3896d0aa0b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:36.283050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 378/710] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:17:36 2022] GET /identity/v3/role_assignments?user.id=e70b85e430004a8b865622354c1d1ed4&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=2696068001744b38a289a59c56f56a95 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:36.284348 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf7e02-bcc7-4949-8f24-d45d92920353 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:36.284631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf7e02-bcc7-4949-8f24-d45d92920353 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:36.284903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf7e02-bcc7-4949-8f24-d45d92920353 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:36.286361 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 379/711] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:36.287079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf7e02-bcc7-4949-8f24-d45d92920353 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:36.301218 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbcc28-ed25-43d3-a4f6-9682ab4bfcee None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:36.304763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:36.348151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4b441-79b8-47f2-8d84-1c2a48fb63f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:36.348151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4b441-79b8-47f2-8d84-1c2a48fb63f0 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:36.348151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4b441-79b8-47f2-8d84-1c2a48fb63f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:36.348151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4b441-79b8-47f2-8d84-1c2a48fb63f0 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:36.348615 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4b441-79b8-47f2-8d84-1c2a48fb63f0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:36.348615 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4b441-79b8-47f2-8d84-1c2a48fb63f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:36.350809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4b441-79b8-47f2-8d84-1c2a48fb63f0 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:36.362306 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 333/712] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Sep 27 16:17:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:36.363907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561cde1-592d-4b33-adc4-0224552a3f8c None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:36.364273 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561cde1-592d-4b33-adc4-0224552a3f8c None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:36.364674 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561cde1-592d-4b33-adc4-0224552a3f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:36.407709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf7e02-bcc7-4949-8f24-d45d92920353 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:36.409216 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-9561cde1-592d-4b33-adc4-0224552a3f8c None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:36.410556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-9561cde1-592d-4b33-adc4-0224552a3f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:36.448387 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd51ba-6ffe-440d-8755-c08735bb343d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:36.449060 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd51ba-6ffe-440d-8755-c08735bb343d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:36.449383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd51ba-6ffe-440d-8755-c08735bb343d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:36.450317 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd51ba-6ffe-440d-8755-c08735bb343d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:36.463221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd51ba-6ffe-440d-8755-c08735bb343d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:36.464772 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd51ba-6ffe-440d-8755-c08735bb343d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:36.484010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-77fd51ba-6ffe-440d-8755-c08735bb343d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:36.484010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:36.484010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:36.484010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:36.484010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:36.484010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:36.484010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:36.484010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:36.484010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:36.484010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:36.484010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:36.484010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:36.484010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:36.484010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:36.484010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:36.484010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:36.485188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:36.485188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:36.485188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:36.485188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:36.485188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:36.485188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:36.485188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:36.485188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:36.485188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:36.485188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:36.485188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:36.485188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:36.485188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:36.485188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:36.485188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:36.485188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:36.485188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:36.486446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:36.486446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:36.486446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:36.486446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 380/713] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:36.493246 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd51ba-6ffe-440d-8755-c08735bb343d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:36.532154 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:36.540267 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 334/714] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:36.607154 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd51ba-6ffe-440d-8755-c08735bb343d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:36.643818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c0f5f-6d74-4fbe-ba09-5677abab7db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:36.645101 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c0f5f-6d74-4fbe-ba09-5677abab7db7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:36.645101 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c0f5f-6d74-4fbe-ba09-5677abab7db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:36.645101 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c0f5f-6d74-4fbe-ba09-5677abab7db7 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:36.645666 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c0f5f-6d74-4fbe-ba09-5677abab7db7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:36.645974 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c0f5f-6d74-4fbe-ba09-5677abab7db7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:36.647566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c0f5f-6d74-4fbe-ba09-5677abab7db7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:36.661484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 381/715] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:36.668136 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561cde1-592d-4b33-adc4-0224552a3f8c None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:36.782227 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:36.785834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561cde1-592d-4b33-adc4-0224552a3f8c None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:36.830452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c0f5f-6d74-4fbe-ba09-5677abab7db7 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:36.845753 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb81482-2dcd-4fb5-9f1e-2dd806391320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:36.846381 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81482-2dcd-4fb5-9f1e-2dd806391320 None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:36.846663 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81482-2dcd-4fb5-9f1e-2dd806391320 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:36.846940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81482-2dcd-4fb5-9f1e-2dd806391320 None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:36.847599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb81482-2dcd-4fb5-9f1e-2dd806391320 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:36.851624 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb81482-2dcd-4fb5-9f1e-2dd806391320 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:36.948091 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 335/716] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 27 16:17:36 2022] POST /identity/v3/users => generated 254 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:17:36.960184 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:36.971846 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c0f5f-6d74-4fbe-ba09-5677abab7db7 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:37.010296 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34b8e6-b4ce-4a50-b158-ae5d5a04555e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:37.011079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34b8e6-b4ce-4a50-b158-ae5d5a04555e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:37.011367 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34b8e6-b4ce-4a50-b158-ae5d5a04555e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:37.011646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34b8e6-b4ce-4a50-b158-ae5d5a04555e None admin] PATH_INFO: `/v3/services/network` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:37.012231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34b8e6-b4ce-4a50-b158-ae5d5a04555e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:37.013757 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34b8e6-b4ce-4a50-b158-ae5d5a04555e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:37.023719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-8e34b8e6-b4ce-4a50-b158-ae5d5a04555e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 16:17:37.023719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:37.023719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:17:37.023719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:17:37.023719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:17:37.023719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:17:37.023719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:17:37.023719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:37.023719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 16:17:37.023719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:37.023719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:17:37.023719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:37.023719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:37.023719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:37.023719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:37.023719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:37.023719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:37.024847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:37.024847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:37.024847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:37.024847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:37.024847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:37.024847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:37.024847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:17:37.024847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:17:37.024847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:17:37.024847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:17:37.024847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:37.024847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:37.024847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:37.024847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:37.024847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:37.024847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:37.026321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:37.026321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:37.026321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:37.026321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:37.026321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:37.026321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:37.026321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:37.026321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:37.026321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:37.026321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:37.026321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:17:37.026321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:37.026321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 16:17:37.026321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:37.026321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 382/717] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:36 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:37.031451 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb81482-2dcd-4fb5-9f1e-2dd806391320 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:37.147009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb81482-2dcd-4fb5-9f1e-2dd806391320 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:37.185060 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80741a14-b6b1-4037-9675-ad92cd06473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:37.185686 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80741a14-b6b1-4037-9675-ad92cd06473e None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:37.185968 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80741a14-b6b1-4037-9675-ad92cd06473e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:37.186241 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80741a14-b6b1-4037-9675-ad92cd06473e None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:37.186884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80741a14-b6b1-4037-9675-ad92cd06473e None admin] RBAC: Adding query filter params (name=network) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:37.187188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80741a14-b6b1-4037-9675-ad92cd06473e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:37.188637 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80741a14-b6b1-4037-9675-ad92cd06473e None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:37.194199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 336/718] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 27 16:17:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:37.201857 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34b8e6-b4ce-4a50-b158-ae5d5a04555e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:37.308928 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34b8e6-b4ce-4a50-b158-ae5d5a04555e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:37.351866 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb65b4-b713-4295-b848-76c523a70f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:37.352900 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb65b4-b713-4295-b848-76c523a70f61 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:37.353447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb65b4-b713-4295-b848-76c523a70f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:37.353931 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb65b4-b713-4295-b848-76c523a70f61 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:37.354766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb65b4-b713-4295-b848-76c523a70f61 None admin] RBAC: Adding query filter params (type=network) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:37.355288 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb65b4-b713-4295-b848-76c523a70f61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:37.356939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb65b4-b713-4295-b848-76c523a70f61 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:37.363750 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 383/719] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 27 16:17:37 2022] GET /identity/v3/services?type=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:38.304904 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efece8-8568-43a8-8b91-87309a751410 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:38.305454 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efece8-8568-43a8-8b91-87309a751410 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:38.305454 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efece8-8568-43a8-8b91-87309a751410 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:38.307059 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 337/720] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:38.313120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428044eb-fc57-4b52-ac10-0bd7c796f98b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:38.313930 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428044eb-fc57-4b52-ac10-0bd7c796f98b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:38.314415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428044eb-fc57-4b52-ac10-0bd7c796f98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:38.340716 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-428044eb-fc57-4b52-ac10-0bd7c796f98b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:38.341901 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-428044eb-fc57-4b52-ac10-0bd7c796f98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:38.356138 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:38.426621 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 384/721] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:38.812761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efece8-8568-43a8-8b91-87309a751410 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:38.837062 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:38.956032 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efece8-8568-43a8-8b91-87309a751410 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:39.006415 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7642054-9bb8-4008-8a00-136283b46c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:39.007061 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7642054-9bb8-4008-8a00-136283b46c46 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:39.007344 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7642054-9bb8-4008-8a00-136283b46c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:39.007621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7642054-9bb8-4008-8a00-136283b46c46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:39.022792 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7642054-9bb8-4008-8a00-136283b46c46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:39.028794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-f7642054-9bb8-4008-8a00-136283b46c46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:17:39.028794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:39.028794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:39.028794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:39.028794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:39.028794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:39.028794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:39.028794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:39.028794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:39.028794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:39.028794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:39.028794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:39.028794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:39.028794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:39.028794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:39.028794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:39.029991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:39.029991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:39.029991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:39.029991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:39.029991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:39.029991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:39.029991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:39.029991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:39.029991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:39.029991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:39.029991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:39.029991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:39.029991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:39.029991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:39.029991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:39.029991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:39.030860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:39.030860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:39.030860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:39.030860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:39.030860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:39.030860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:39.030860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:39.030860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:39.030860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:39.030860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:39.030860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:17:39.030860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:39.030860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 338/722] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:17:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:39.036232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428044eb-fc57-4b52-ac10-0bd7c796f98b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:39.101159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce544f-0e40-4dfe-9205-d0a92efabe11 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:39.101459 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce544f-0e40-4dfe-9205-d0a92efabe11 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:39.101643 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce544f-0e40-4dfe-9205-d0a92efabe11 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:39.103240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 339/723] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:39.108635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdec797-05c9-4776-a3c0-04d3aa33c62b None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:39.108922 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdec797-05c9-4776-a3c0-04d3aa33c62b None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:39.109202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdec797-05c9-4776-a3c0-04d3aa33c62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:39.144727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-8cdec797-05c9-4776-a3c0-04d3aa33c62b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:39.145817 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-8cdec797-05c9-4776-a3c0-04d3aa33c62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:39.159735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428044eb-fc57-4b52-ac10-0bd7c796f98b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:39.199596 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafabf95-7ca2-406e-adc1-d1c8548b6500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:39.200950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafabf95-7ca2-406e-adc1-d1c8548b6500 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:39.201443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafabf95-7ca2-406e-adc1-d1c8548b6500 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:39.201913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafabf95-7ca2-406e-adc1-d1c8548b6500 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:39.203135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafabf95-7ca2-406e-adc1-d1c8548b6500 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:39.203677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafabf95-7ca2-406e-adc1-d1c8548b6500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:39.205861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafabf95-7ca2-406e-adc1-d1c8548b6500 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:39.215527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 385/724] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:17:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:39.217022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda77b0-40ea-4002-876d-1b6a1c1f1b68 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:39.217530 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda77b0-40ea-4002-876d-1b6a1c1f1b68 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:39.218004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda77b0-40ea-4002-876d-1b6a1c1f1b68 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:39.219619 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 386/725] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:39.224022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda77b0-40ea-4002-876d-1b6a1c1f1b68 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:39.239149 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:39.256543 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 340/726] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 16:17:39.258212 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d5884-1859-4762-bc0a-c60feb357e52 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:39.258704 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d5884-1859-4762-bc0a-c60feb357e52 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:39.259186 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d5884-1859-4762-bc0a-c60feb357e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:39.296413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-d07d5884-1859-4762-bc0a-c60feb357e52 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:39.297598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-d07d5884-1859-4762-bc0a-c60feb357e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:39.312658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:39.383472 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda77b0-40ea-4002-876d-1b6a1c1f1b68 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:39.423732 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc273df6-3299-4898-adb5-ec4df26c8fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:39.424399 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc273df6-3299-4898-adb5-ec4df26c8fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:39.424682 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc273df6-3299-4898-adb5-ec4df26c8fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:39.424956 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc273df6-3299-4898-adb5-ec4df26c8fb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:39.436666 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 341/727] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:39.443708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc273df6-3299-4898-adb5-ec4df26c8fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:39.445481 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc273df6-3299-4898-adb5-ec4df26c8fb7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:39.460411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-dc273df6-3299-4898-adb5-ec4df26c8fb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:39.460411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:39.460411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:39.460411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:39.460411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:39.460411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:39.460411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:39.460411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:39.460411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:39.460411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:39.460411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:39.460411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:39.460411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:39.460411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:39.460411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:39.460411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:39.461622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:39.461622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:39.461622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:39.461622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:39.461622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:39.461622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:39.461622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:39.461622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:39.461622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:39.461622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:39.461622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:39.461622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:39.461622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:39.461622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:39.461622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:39.461622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:39.461622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:39.462761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:39.462761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:39.462761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:39.468481 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 387/728] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:39.470968 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d5884-1859-4762-bc0a-c60feb357e52 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:39.597981 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d5884-1859-4762-bc0a-c60feb357e52 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:39.639586 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a68b29-0f34-4d8b-9a35-eb047ea68902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:39.640445 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a68b29-0f34-4d8b-9a35-eb047ea68902 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:39.640874 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a68b29-0f34-4d8b-9a35-eb047ea68902 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:39.641316 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a68b29-0f34-4d8b-9a35-eb047ea68902 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:39.642101 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a68b29-0f34-4d8b-9a35-eb047ea68902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:39.642620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a68b29-0f34-4d8b-9a35-eb047ea68902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:39.644179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a68b29-0f34-4d8b-9a35-eb047ea68902 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:39.651579 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:39.661821 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 342/729] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:39.663432 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc273df6-3299-4898-adb5-ec4df26c8fb7 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:39.691062 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a68b29-0f34-4d8b-9a35-eb047ea68902 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:39.731905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:39.772758 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc273df6-3299-4898-adb5-ec4df26c8fb7 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:39.819537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5525289-7b47-4ed6-ade6-750316d726ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:39.820547 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5525289-7b47-4ed6-ade6-750316d726ff None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:39.821070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5525289-7b47-4ed6-ade6-750316d726ff None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:39.821565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5525289-7b47-4ed6-ade6-750316d726ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:39.829079 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a68b29-0f34-4d8b-9a35-eb047ea68902 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:39.830335 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5525289-7b47-4ed6-ade6-750316d726ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:39.832101 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5525289-7b47-4ed6-ade6-750316d726ff None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:39.844539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-c5525289-7b47-4ed6-ade6-750316d726ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 16:17:39.844539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:39.844539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:39.844539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:39.844539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:39.844539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:39.844539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:39.844539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:39.844539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:39.844539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:39.844539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:39.844539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:39.844539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:39.844539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:39.844539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:39.844539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:39.845558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:39.845558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:39.845558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:39.845558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:39.845558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:39.845558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:39.845558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:39.845558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:39.845558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:39.845558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:39.845558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:39.845558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:39.845558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:39.845558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:39.845558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:39.845558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:39.845558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:39.845558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:39.846542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:39.846542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:39.846542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:39.846542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:39.846542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:39.846542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:39.846542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:39.846542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:39.846542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 16:17:39.846542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:39.853470 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 388/730] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Sep 27 16:17:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:39.854516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5525289-7b47-4ed6-ade6-750316d726ff None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:39.864654 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdc4b1-c51a-4669-bb23-55c3422f72e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:39.865299 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc4b1-c51a-4669-bb23-55c3422f72e3 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:39.865576 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc4b1-c51a-4669-bb23-55c3422f72e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:39.865844 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc4b1-c51a-4669-bb23-55c3422f72e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:39.877652 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdc4b1-c51a-4669-bb23-55c3422f72e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:39.883404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-3dfdc4b1-c51a-4669-bb23-55c3422f72e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:17:39.883404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:39.883404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:39.883404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:39.883404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:39.883404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:39.883404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:39.883404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:39.883404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:39.883404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:39.883404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:39.883404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:39.883404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:39.883404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:39.883404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:39.883404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:39.884499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:39.884499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:39.884499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:39.884499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:39.884499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:39.884499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:39.884499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:39.884499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:39.884499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:39.884499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:39.884499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:39.884499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:39.884499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:39.884499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:39.884499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:39.884499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:39.885809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:39.885809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:39.885809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:39.885809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:39.885809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:39.885809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:39.885809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:39.885809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:39.885809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:39.885809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:39.885809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:17:39.885809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:39.885809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 343/731] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:17:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:39.885809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdc4b1-c51a-4669-bb23-55c3422f72e3 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:39.958467 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:39.973454 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5525289-7b47-4ed6-ade6-750316d726ff None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:40.001723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:40.015492 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdc4b1-c51a-4669-bb23-55c3422f72e3 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:40.016047 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca5a9d-c735-4bb4-87be-4a0d4a70b101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:40.016714 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca5a9d-c735-4bb4-87be-4a0d4a70b101 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:40.016998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca5a9d-c735-4bb4-87be-4a0d4a70b101 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:40.017299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca5a9d-c735-4bb4-87be-4a0d4a70b101 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:40.022887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca5a9d-c735-4bb4-87be-4a0d4a70b101 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:40.022887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca5a9d-c735-4bb4-87be-4a0d4a70b101 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:40.053077 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e248b5b-d231-4a42-aad5-33fca61e1c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:40.053681 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e248b5b-d231-4a42-aad5-33fca61e1c07 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:40.053960 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e248b5b-d231-4a42-aad5-33fca61e1c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:40.054232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e248b5b-d231-4a42-aad5-33fca61e1c07 None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:40.054954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e248b5b-d231-4a42-aad5-33fca61e1c07 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:40.055259 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e248b5b-d231-4a42-aad5-33fca61e1c07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:40.056715 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e248b5b-d231-4a42-aad5-33fca61e1c07 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:40.073909 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 344/732] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Sep 27 16:17:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:40.074708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e248b5b-d231-4a42-aad5-33fca61e1c07 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:40.143599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 389/733] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 27 16:17:39 2022] POST /identity/v3/services => generated 251 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:17:40.145291 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cda2d3-9ead-4ff6-86e9-cc4af0f2a3d2 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:40.145771 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cda2d3-9ead-4ff6-86e9-cc4af0f2a3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:40.146053 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cda2d3-9ead-4ff6-86e9-cc4af0f2a3d2 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:40.151536 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 390/734] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:40.151536 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cda2d3-9ead-4ff6-86e9-cc4af0f2a3d2 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:40.181919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e248b5b-d231-4a42-aad5-33fca61e1c07 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:40.203051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:40.232393 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbf96a-ea76-4dbb-88a1-edb2b5bf15b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:40.233029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbf96a-ea76-4dbb-88a1-edb2b5bf15b1 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:40.233315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbf96a-ea76-4dbb-88a1-edb2b5bf15b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:40.233593 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbf96a-ea76-4dbb-88a1-edb2b5bf15b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:40.234267 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbf96a-ea76-4dbb-88a1-edb2b5bf15b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:40.234575 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbf96a-ea76-4dbb-88a1-edb2b5bf15b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:40.236044 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbf96a-ea76-4dbb-88a1-edb2b5bf15b1 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:40.246119 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 345/735] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:17:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:40.247944 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99722f-ae25-4dd8-b619-c279f23dfb66 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:40.248221 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99722f-ae25-4dd8-b619-c279f23dfb66 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:40.248522 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99722f-ae25-4dd8-b619-c279f23dfb66 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:40.249939 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 346/736] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:40.250820 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208cafd-f103-4aaa-9dcd-072989e53fed None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:40.251104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208cafd-f103-4aaa-9dcd-072989e53fed None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:40.251381 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208cafd-f103-4aaa-9dcd-072989e53fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:40.275721 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-b208cafd-f103-4aaa-9dcd-072989e53fed None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:40.277005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b208cafd-f103-4aaa-9dcd-072989e53fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:40.280739 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cda2d3-9ead-4ff6-86e9-cc4af0f2a3d2 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:40.318450 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80835e-9c19-44ac-840a-c20105bd8124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:40.319087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80835e-9c19-44ac-840a-c20105bd8124 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:40.319363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80835e-9c19-44ac-840a-c20105bd8124 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:40.319631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80835e-9c19-44ac-840a-c20105bd8124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:40.331703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80835e-9c19-44ac-840a-c20105bd8124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:40.333176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80835e-9c19-44ac-840a-c20105bd8124 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:40.350715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-ed80835e-9c19-44ac-840a-c20105bd8124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:40.350715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:40.350715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:40.350715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:40.350715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:40.350715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:40.350715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:40.350715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:40.350715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:40.350715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:40.350715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:40.350715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:40.350715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:40.350715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:40.350715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:40.350715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:40.351791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:40.351791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:40.351791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:40.351791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:40.351791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:40.351791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:40.351791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:40.351791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:40.351791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:40.351791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:40.351791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:40.351791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:40.351791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:40.351791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:40.351791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:40.351791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:40.351791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:40.353183 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:40.353183 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:40.353183 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:40.353183 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 391/737] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:40.353592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80835e-9c19-44ac-840a-c20105bd8124 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:40.354812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 347/738] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:40.355263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1b131-83aa-497f-875f-264be2774e6f None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:40.355444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1b131-83aa-497f-875f-264be2774e6f None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:40.356365 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1b131-83aa-497f-875f-264be2774e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:40.376660 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-23d1b131-83aa-497f-875f-264be2774e6f None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:40.378597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-23d1b131-83aa-497f-875f-264be2774e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:40.400735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:40.466458 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 348/739] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 16:17:40.468181 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1b131-83aa-497f-875f-264be2774e6f None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:40.474378 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80835e-9c19-44ac-840a-c20105bd8124 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:40.510182 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:40.516363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee2540-f9dc-4d9f-81d1-8e361f09326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:40.516363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee2540-f9dc-4d9f-81d1-8e361f09326d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:40.516363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee2540-f9dc-4d9f-81d1-8e361f09326d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:40.516363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee2540-f9dc-4d9f-81d1-8e361f09326d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:40.533121 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee2540-f9dc-4d9f-81d1-8e361f09326d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:40.535144 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee2540-f9dc-4d9f-81d1-8e361f09326d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:40.552509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-8cee2540-f9dc-4d9f-81d1-8e361f09326d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:40.552509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:40.552509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:40.552509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:40.552509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:40.552509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:40.552509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:40.552509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:40.552509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:40.552509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:40.552509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:40.552509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:40.552509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:40.552509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:40.552509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:40.552509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:40.553702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:40.553702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:40.553702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:40.553702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:40.553702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:40.553702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:40.553702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:40.553702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:40.553702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:40.553702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:40.553702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:40.553702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:40.553702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:40.553702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:40.553702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:40.553702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:40.553702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:40.554818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:40.554818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:40.554818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:40.555782 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 392/740] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:40.568582 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee2540-f9dc-4d9f-81d1-8e361f09326d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:40.623202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1b131-83aa-497f-875f-264be2774e6f None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:40.666219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d8a8a-24ed-4bed-ba46-d24c5759a159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:40.666834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d8a8a-24ed-4bed-ba46-d24c5759a159 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:40.667117 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d8a8a-24ed-4bed-ba46-d24c5759a159 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:40.667393 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d8a8a-24ed-4bed-ba46-d24c5759a159 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:40.668037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d8a8a-24ed-4bed-ba46-d24c5759a159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:40.668401 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d8a8a-24ed-4bed-ba46-d24c5759a159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:40.670692 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d8a8a-24ed-4bed-ba46-d24c5759a159 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:40.682713 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 349/741] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:40.683545 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d8a8a-24ed-4bed-ba46-d24c5759a159 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:40.705886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:40.723534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee2540-f9dc-4d9f-81d1-8e361f09326d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:40.764498 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644523a-037d-4e52-bb5b-dab748e45aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:40.765033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644523a-037d-4e52-bb5b-dab748e45aaf None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:40.765312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644523a-037d-4e52-bb5b-dab748e45aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:40.765586 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644523a-037d-4e52-bb5b-dab748e45aaf None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:40.766227 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644523a-037d-4e52-bb5b-dab748e45aaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:40.766527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644523a-037d-4e52-bb5b-dab748e45aaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:40.768052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644523a-037d-4e52-bb5b-dab748e45aaf None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:40.784707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 393/742] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:40.787878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644523a-037d-4e52-bb5b-dab748e45aaf None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:40.803521 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:40.810543 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d8a8a-24ed-4bed-ba46-d24c5759a159 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:40.844847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16230c87-a0bb-4bbf-8a50-1bfdd14bbc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:40.845675 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16230c87-a0bb-4bbf-8a50-1bfdd14bbc76 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:40.846356 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16230c87-a0bb-4bbf-8a50-1bfdd14bbc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:40.846641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16230c87-a0bb-4bbf-8a50-1bfdd14bbc76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:40.857385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16230c87-a0bb-4bbf-8a50-1bfdd14bbc76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:40.862564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-16230c87-a0bb-4bbf-8a50-1bfdd14bbc76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:40.862564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:40.862564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:40.862564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:40.862564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:40.862564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:40.862564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:40.862564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:40.862564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:40.862564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:40.862564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:40.862564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:40.862564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:40.862564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:40.862564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:40.862564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:40.863724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:40.863724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:40.863724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:40.863724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:40.863724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:40.863724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:40.863724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:40.863724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:40.863724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:40.863724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:40.863724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:40.863724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:40.863724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:40.863724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:40.863724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:40.863724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:40.864628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:40.864628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:40.864628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:40.864628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:40.864628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:40.864628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:40.864628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:40.864628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:40.864628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:40.864628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:40.864628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:40.864628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:40.864628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 350/743] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:40.865358 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16230c87-a0bb-4bbf-8a50-1bfdd14bbc76 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:40.914367 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644523a-037d-4e52-bb5b-dab748e45aaf None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:40.949654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c23b8-5e17-458b-b836-3cd816188891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:40.950313 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c23b8-5e17-458b-b836-3cd816188891 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:40.950595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c23b8-5e17-458b-b836-3cd816188891 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:40.950866 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c23b8-5e17-458b-b836-3cd816188891 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:40.957504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c23b8-5e17-458b-b836-3cd816188891 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:40.958939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c23b8-5e17-458b-b836-3cd816188891 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:40.970781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-7d7c23b8-5e17-458b-b836-3cd816188891 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:40.970781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:40.970781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:40.970781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:40.970781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:40.970781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:40.970781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:40.970781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:40.970781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:40.970781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:40.970781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:40.970781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:40.970781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:40.970781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:40.970781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:40.971692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:40.971692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:40.971692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:40.971692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:40.971692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:40.971692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:40.971692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:40.971692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:40.971692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:40.971692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:40.971692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:40.971692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:40.971692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:40.971692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:40.971692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:40.971692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:40.971692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:40.972865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:40.972865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:40.972865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:40.972865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:40.972865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:40.972865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:40.972865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:40.972865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:40.972865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 394/744] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:40.972865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c23b8-5e17-458b-b836-3cd816188891 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:40.973826 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16230c87-a0bb-4bbf-8a50-1bfdd14bbc76 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:40.985081 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:41.010534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c24f78-7a67-44d1-9f4d-da2d1665dbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:41.011395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c24f78-7a67-44d1-9f4d-da2d1665dbd9 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:41.011823 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c24f78-7a67-44d1-9f4d-da2d1665dbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:41.012301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c24f78-7a67-44d1-9f4d-da2d1665dbd9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:41.020442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c24f78-7a67-44d1-9f4d-da2d1665dbd9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:41.021885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c24f78-7a67-44d1-9f4d-da2d1665dbd9 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:41.033847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-19c24f78-7a67-44d1-9f4d-da2d1665dbd9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 16:17:41.033847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:41.033847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:41.033847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:41.033847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:41.033847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:41.033847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:41.033847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:41.033847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:41.033847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:41.033847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:41.033847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:41.033847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:41.033847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:41.033847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:41.033847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:41.034809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:41.034809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:41.034809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:41.034809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:41.034809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:41.034809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:41.034809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:41.034809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:41.034809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:41.034809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:41.034809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:41.034809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:41.034809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:41.034809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:41.034809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:41.034809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:41.034809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:41.034809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:41.035750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:41.035750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:41.035750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:41.035750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:41.035750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:41.035750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:41.035750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:41.035750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:41.035750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 27 16:17:41.035750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:41.035750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 351/745] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:17:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:41.035750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c24f78-7a67-44d1-9f4d-da2d1665dbd9 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:41.055981 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:41.091778 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c23b8-5e17-458b-b836-3cd816188891 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:41.128070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de77ab-4178-4f66-8fe9-049e147e7b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:41.128706 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de77ab-4178-4f66-8fe9-049e147e7b90 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:41.129001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de77ab-4178-4f66-8fe9-049e147e7b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:41.129272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de77ab-4178-4f66-8fe9-049e147e7b90 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:41.129926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de77ab-4178-4f66-8fe9-049e147e7b90 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:41.131286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de77ab-4178-4f66-8fe9-049e147e7b90 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:41.146856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c24f78-7a67-44d1-9f4d-da2d1665dbd9 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:41.180208 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a4ba3-79e0-419f-b2d4-3d0233df1892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:41.180855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a4ba3-79e0-419f-b2d4-3d0233df1892 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:41.181106 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a4ba3-79e0-419f-b2d4-3d0233df1892 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:41.181373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a4ba3-79e0-419f-b2d4-3d0233df1892 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:41.182017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a4ba3-79e0-419f-b2d4-3d0233df1892 None admin] RBAC: Adding query filter params (name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:41.182315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a4ba3-79e0-419f-b2d4-3d0233df1892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:41.185999 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a4ba3-79e0-419f-b2d4-3d0233df1892 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:41.191329 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 352/746] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:17:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:41.192087 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a4ba3-79e0-419f-b2d4-3d0233df1892 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:41.212371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 395/747] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 27 16:17:40 2022] POST /identity/v3/services => generated 240 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:17:41.212371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de77ab-4178-4f66-8fe9-049e147e7b90 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:41.294779 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:41.297052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:41.322225 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a4ba3-79e0-419f-b2d4-3d0233df1892 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:41.351269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de77ab-4178-4f66-8fe9-049e147e7b90 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:41.368140 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92424162-d0e5-4d7e-ae13-5ff0c289ab70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:41.368930 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92424162-d0e5-4d7e-ae13-5ff0c289ab70 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:41.369276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92424162-d0e5-4d7e-ae13-5ff0c289ab70 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:41.369617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92424162-d0e5-4d7e-ae13-5ff0c289ab70 None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:41.370699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92424162-d0e5-4d7e-ae13-5ff0c289ab70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:41.371070 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92424162-d0e5-4d7e-ae13-5ff0c289ab70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:41.373178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92424162-d0e5-4d7e-ae13-5ff0c289ab70 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:41.396492 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 353/748] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:41.397620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92424162-d0e5-4d7e-ae13-5ff0c289ab70 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:41.405540 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef512b-e4e2-49d6-b3a5-f76de586cf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:41.405540 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef512b-e4e2-49d6-b3a5-f76de586cf9b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:41.405540 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef512b-e4e2-49d6-b3a5-f76de586cf9b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:41.406200 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef512b-e4e2-49d6-b3a5-f76de586cf9b None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:41.406450 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef512b-e4e2-49d6-b3a5-f76de586cf9b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:41.408279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef512b-e4e2-49d6-b3a5-f76de586cf9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:41.408279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef512b-e4e2-49d6-b3a5-f76de586cf9b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:41.429697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 396/749] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Sep 27 16:17:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:41.430546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef512b-e4e2-49d6-b3a5-f76de586cf9b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:41.512240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92424162-d0e5-4d7e-ae13-5ff0c289ab70 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:41.555569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef512b-e4e2-49d6-b3a5-f76de586cf9b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:41.556002 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e509a1-8c42-42df-aac6-4abf6c149899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:41.556646 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e509a1-8c42-42df-aac6-4abf6c149899 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:41.557065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e509a1-8c42-42df-aac6-4abf6c149899 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:41.557329 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e509a1-8c42-42df-aac6-4abf6c149899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:41.561735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:41.571588 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e509a1-8c42-42df-aac6-4abf6c149899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:41.573819 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e509a1-8c42-42df-aac6-4abf6c149899 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:41.581962 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:41.595320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-73e509a1-8c42-42df-aac6-4abf6c149899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:41.595320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:41.595320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:41.595320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:41.595320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:41.595320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:41.595320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:41.595320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:41.595320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:41.595320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:41.595320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:41.595320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:41.595320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:41.595320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:41.595320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:41.595320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:41.596516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:41.596516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:41.596516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:41.596516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:41.596516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:41.596516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:41.596516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:41.596516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:41.596516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:41.596516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:41.596516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:41.596516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:41.596516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:41.596516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:41.596516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:41.596516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:41.596516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:41.597670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:41.597670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:41.597670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:41.599867 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 354/750] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:41.600858 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e509a1-8c42-42df-aac6-4abf6c149899 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:41.601717 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d54325-8cd9-40fe-abb5-00cf1b4e9281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:41.602604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d54325-8cd9-40fe-abb5-00cf1b4e9281 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:41.603087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d54325-8cd9-40fe-abb5-00cf1b4e9281 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:41.603639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d54325-8cd9-40fe-abb5-00cf1b4e9281 None admin] PATH_INFO: `/v3/projects/ad230723d90a439daf38443915c2282f/users/e71fea96b2b949f9abca12172e69284b/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:41.606725 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d54325-8cd9-40fe-abb5-00cf1b4e9281 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad230723d90a439daf38443915c2282f, user_id=e71fea96b2b949f9abca12172e69284b, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:41.608377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d54325-8cd9-40fe-abb5-00cf1b4e9281 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:41.692988 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 397/751] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:17:41 2022] PUT /identity/v3/projects/ad230723d90a439daf38443915c2282f/users/e71fea96b2b949f9abca12172e69284b/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:17:41.694809 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d54325-8cd9-40fe-abb5-00cf1b4e9281 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:41.728897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e509a1-8c42-42df-aac6-4abf6c149899 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:41.828920 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2bce9-a002-4ccf-b9bb-288aa8abe02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:41.829464 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2bce9-a002-4ccf-b9bb-288aa8abe02d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:41.829750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2bce9-a002-4ccf-b9bb-288aa8abe02d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:41.830027 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2bce9-a002-4ccf-b9bb-288aa8abe02d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:41.900507 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d54325-8cd9-40fe-abb5-00cf1b4e9281 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:41.947856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:41.966367 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060f702-cad4-4eef-b859-842e0c31b413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:41.967587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060f702-cad4-4eef-b859-842e0c31b413 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:41.967789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2bce9-a002-4ccf-b9bb-288aa8abe02d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:41.968289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060f702-cad4-4eef-b859-842e0c31b413 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:41.968806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060f702-cad4-4eef-b859-842e0c31b413 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:41.969303 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2bce9-a002-4ccf-b9bb-288aa8abe02d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:41.969882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060f702-cad4-4eef-b859-842e0c31b413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:41.970387 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060f702-cad4-4eef-b859-842e0c31b413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:41.971956 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060f702-cad4-4eef-b859-842e0c31b413 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:41.986340 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 398/752] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:41.991473 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060f702-cad4-4eef-b859-842e0c31b413 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:42.050770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:42.116475 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060f702-cad4-4eef-b859-842e0c31b413 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:42.154032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe2434-6f6b-454e-956d-a483b74ef4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:42.154839 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe2434-6f6b-454e-956d-a483b74ef4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:42.155224 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe2434-6f6b-454e-956d-a483b74ef4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:42.155597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe2434-6f6b-454e-956d-a483b74ef4f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:42.165531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe2434-6f6b-454e-956d-a483b74ef4f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:42.167288 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe2434-6f6b-454e-956d-a483b74ef4f9 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:42.172166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 355/753] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 16:17:42.177887 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2bce9-a002-4ccf-b9bb-288aa8abe02d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:42.180602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-e2fe2434-6f6b-454e-956d-a483b74ef4f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 16:17:42.180602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:42.180602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:42.180602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:42.180602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:42.180602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:42.180602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:42.180602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:42.180602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:42.180602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:42.180602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:42.180602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:42.180602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:42.180602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:42.180602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:42.180602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:42.181768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:42.181768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:42.181768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:42.181768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:42.181768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:42.181768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:42.181768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:42.181768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:42.181768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:42.181768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:42.181768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:42.181768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:42.181768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:42.181768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:42.181768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:42.181768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:42.181768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:42.181768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:42.182871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:42.182871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:42.182871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:42.182871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:42.182871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:42.182871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:42.182871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:42.182871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:42.182871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 16:17:42.182871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:42.183791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 399/754] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 27 16:17:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:42.189685 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe2434-6f6b-454e-956d-a483b74ef4f9 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:42.371489 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:42.386574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:42.389582 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe2434-6f6b-454e-956d-a483b74ef4f9 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:42.389981 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2bce9-a002-4ccf-b9bb-288aa8abe02d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:42.432464 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a876c9-5d70-4d82-8129-7bbbc1f4d8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:42.433320 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a876c9-5d70-4d82-8129-7bbbc1f4d8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:42.433609 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a876c9-5d70-4d82-8129-7bbbc1f4d8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:42.434162 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a876c9-5d70-4d82-8129-7bbbc1f4d8c6 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:42.435937 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a876c9-5d70-4d82-8129-7bbbc1f4d8c6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:42.436298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a876c9-5d70-4d82-8129-7bbbc1f4d8c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:42.438027 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a876c9-5d70-4d82-8129-7bbbc1f4d8c6 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:42.444834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e09721-f239-47c4-bedc-91aab3d1a97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:42.445467 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e09721-f239-47c4-bedc-91aab3d1a97a None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:42.445741 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e09721-f239-47c4-bedc-91aab3d1a97a None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:42.446011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e09721-f239-47c4-bedc-91aab3d1a97a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:42.456796 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e09721-f239-47c4-bedc-91aab3d1a97a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:42.458246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e09721-f239-47c4-bedc-91aab3d1a97a None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:42.459788 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 400/755] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Sep 27 16:17:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:42.461821 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d9df6-753a-412f-8624-fcb5caf51f27 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:42.462111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d9df6-753a-412f-8624-fcb5caf51f27 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:42.462392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d9df6-753a-412f-8624-fcb5caf51f27 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:42.463861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 401/756] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:42.469337 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d9df6-753a-412f-8624-fcb5caf51f27 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:42.479046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-05e09721-f239-47c4-bedc-91aab3d1a97a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:42.479046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:42.479046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:42.479046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:42.479046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:42.479046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:42.479046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:42.479046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:42.479046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:42.479046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:42.479046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:42.479046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:42.479046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:42.479046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:42.479046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:42.479046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:42.480114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:42.480114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:42.480114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:42.480114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:42.480114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:42.480114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:42.480114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:42.480114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:42.480114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:42.480114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:42.480114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:42.480114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:42.480114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:42.480114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:42.480114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:42.480114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:42.480114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:42.481798 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:42.481798 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:42.481798 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:42.481798 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 356/757] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:42.482716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a988fa4-329a-42eb-91a0-fe2eb7885f46 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:42.483001 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a988fa4-329a-42eb-91a0-fe2eb7885f46 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:42.483276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a988fa4-329a-42eb-91a0-fe2eb7885f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:42.505828 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-7a988fa4-329a-42eb-91a0-fe2eb7885f46 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:42.507048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-7a988fa4-329a-42eb-91a0-fe2eb7885f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:42.570839 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d9df6-753a-412f-8624-fcb5caf51f27 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:42.578000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 357/758] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:17:42.578865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a988fa4-329a-42eb-91a0-fe2eb7885f46 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:42.638275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004b486-fd2a-48a7-b142-e0eb8cd2ba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:42.638820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004b486-fd2a-48a7-b142-e0eb8cd2ba51 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:42.639090 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004b486-fd2a-48a7-b142-e0eb8cd2ba51 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:42.639357 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004b486-fd2a-48a7-b142-e0eb8cd2ba51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:42.653284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:42.686618 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:42.687599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a988fa4-329a-42eb-91a0-fe2eb7885f46 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:42.736504 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fc2b4-ae9d-4afb-a120-cd5069e3c70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:42.737131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fc2b4-ae9d-4afb-a120-cd5069e3c70f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:42.737412 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fc2b4-ae9d-4afb-a120-cd5069e3c70f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:42.737684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fc2b4-ae9d-4afb-a120-cd5069e3c70f None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:42.738337 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fc2b4-ae9d-4afb-a120-cd5069e3c70f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:42.738641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fc2b4-ae9d-4afb-a120-cd5069e3c70f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:42.740021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fc2b4-ae9d-4afb-a120-cd5069e3c70f None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:42.742878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004b486-fd2a-48a7-b142-e0eb8cd2ba51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:42.744318 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004b486-fd2a-48a7-b142-e0eb8cd2ba51 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:42.758365 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 358/759] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:42.763493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fc2b4-ae9d-4afb-a120-cd5069e3c70f None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:42.845284 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 402/760] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 16:17:42.857716 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004b486-fd2a-48a7-b142-e0eb8cd2ba51 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:42.929076 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:42.956457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fc2b4-ae9d-4afb-a120-cd5069e3c70f None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:42.973161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004b486-fd2a-48a7-b142-e0eb8cd2ba51 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:43.007581 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bf98c-113c-450c-a2ae-8a8cb0539267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:43.008211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bf98c-113c-450c-a2ae-8a8cb0539267 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:43.008517 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bf98c-113c-450c-a2ae-8a8cb0539267 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:43.008789 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bf98c-113c-450c-a2ae-8a8cb0539267 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:43.014737 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:43.019951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bf98c-113c-450c-a2ae-8a8cb0539267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:43.021466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bf98c-113c-450c-a2ae-8a8cb0539267 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:43.021886 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d25a6-70ff-49d6-b078-8d320b7159b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:43.022823 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d25a6-70ff-49d6-b078-8d320b7159b4 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:43.023306 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d25a6-70ff-49d6-b078-8d320b7159b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:43.023787 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d25a6-70ff-49d6-b078-8d320b7159b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:43.031126 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d25a6-70ff-49d6-b078-8d320b7159b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:43.032947 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d25a6-70ff-49d6-b078-8d320b7159b4 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:43.036669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-e64bf98c-113c-450c-a2ae-8a8cb0539267 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:43.036669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:43.036669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:43.036669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:43.036669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:43.036669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:43.036669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:43.036669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:43.036669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:43.036669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:43.036669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:43.036669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:43.036669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:43.036669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:43.036669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:43.036669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:43.037641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:43.037641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:43.037641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:43.037641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:43.037641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:43.037641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:43.037641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:43.037641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:43.037641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:43.037641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:43.037641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:43.037641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:43.037641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:43.037641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:43.037641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:43.037641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:43.037641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:43.039131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:43.039131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:43.039131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:43.039131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 403/761] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:43.039131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bf98c-113c-450c-a2ae-8a8cb0539267 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:43.049756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-644d25a6-70ff-49d6-b078-8d320b7159b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:43.049756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:43.049756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:43.049756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:43.049756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:43.049756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:43.049756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:43.049756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:43.049756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:43.049756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:43.049756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:43.049756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:43.049756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:43.049756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:43.049756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:43.050668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:43.050668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:43.050668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:43.050668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:43.050668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:43.050668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:43.050668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:43.050668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:43.050668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:43.050668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:43.050668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:43.050668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:43.050668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:43.050668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:43.050668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:43.050668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:43.050668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:43.051572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:43.051572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:43.051572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:43.051572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:43.051572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:43.051572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:43.051572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:43.051572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:43.053955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 359/762] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:43.055042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d25a6-70ff-49d6-b078-8d320b7159b4 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:43.170405 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d25a6-70ff-49d6-b078-8d320b7159b4 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:43.209378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a00a32-9ace-4acb-ad55-fd4af343897e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:43.209996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a00a32-9ace-4acb-ad55-fd4af343897e None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:43.210284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a00a32-9ace-4acb-ad55-fd4af343897e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:43.210562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a00a32-9ace-4acb-ad55-fd4af343897e None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:43.211221 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a00a32-9ace-4acb-ad55-fd4af343897e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:43.211529 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a00a32-9ace-4acb-ad55-fd4af343897e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:43.212987 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a00a32-9ace-4acb-ad55-fd4af343897e None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:43.227535 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 360/763] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:43.228492 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a00a32-9ace-4acb-ad55-fd4af343897e None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:43.269855 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bf98c-113c-450c-a2ae-8a8cb0539267 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:43.283821 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:43.290917 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:43.315039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86471e2b-b9c0-4beb-822a-41482297d5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:43.316326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86471e2b-b9c0-4beb-822a-41482297d5db None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:43.316817 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86471e2b-b9c0-4beb-822a-41482297d5db None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:43.317546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86471e2b-b9c0-4beb-822a-41482297d5db None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:43.318880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86471e2b-b9c0-4beb-822a-41482297d5db None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:43.321272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86471e2b-b9c0-4beb-822a-41482297d5db None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:43.334141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-86471e2b-b9c0-4beb-822a-41482297d5db None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 16:17:43.334141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:43.334141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:17:43.334141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:17:43.334141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:17:43.334141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:17:43.334141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:17:43.334141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:43.334141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 16:17:43.334141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:43.334141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:17:43.334141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:43.334141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:43.334141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:43.334141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:43.334141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:43.334141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:43.335180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:43.335180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:43.335180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:43.335180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:43.335180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:43.335180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:43.335180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:17:43.335180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:17:43.335180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:17:43.335180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:17:43.335180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:43.335180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:43.335180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:43.335180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:43.335180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:43.335180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:43.336039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:43.336039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:43.336039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:43.336039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:43.336039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:43.336039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:43.336039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:43.336039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:43.336039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:43.336039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:43.336039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:17:43.336039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:43.336039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 16:17:43.336039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:43.337587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 404/764] 10.222.0.26 () {56 vars in 1129 bytes} [Tue Sep 27 16:17:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:43.339244 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86471e2b-b9c0-4beb-822a-41482297d5db None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:43.346546 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a00a32-9ace-4acb-ad55-fd4af343897e None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:43.383757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4fcac-9f10-4e4c-9e1e-3fb184892470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:43.385238 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4fcac-9f10-4e4c-9e1e-3fb184892470 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:43.385717 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4fcac-9f10-4e4c-9e1e-3fb184892470 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:43.386213 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4fcac-9f10-4e4c-9e1e-3fb184892470 None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:43.387112 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4fcac-9f10-4e4c-9e1e-3fb184892470 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:43.388169 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4fcac-9f10-4e4c-9e1e-3fb184892470 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:43.389811 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4fcac-9f10-4e4c-9e1e-3fb184892470 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:43.402919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 361/765] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:43.404117 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4fcac-9f10-4e4c-9e1e-3fb184892470 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:43.445854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86471e2b-b9c0-4beb-822a-41482297d5db None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:43.483470 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09c613-26c3-4c85-8a17-ca8554f164c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:43.484149 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09c613-26c3-4c85-8a17-ca8554f164c8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:43.484501 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09c613-26c3-4c85-8a17-ca8554f164c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:43.484799 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09c613-26c3-4c85-8a17-ca8554f164c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:43.492691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09c613-26c3-4c85-8a17-ca8554f164c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:43.494088 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09c613-26c3-4c85-8a17-ca8554f164c8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:43.507111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-fa09c613-26c3-4c85-8a17-ca8554f164c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:43.507111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:43.507111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:43.507111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:43.507111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:43.507111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:43.507111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:43.507111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:43.507111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:43.507111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:43.507111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:43.507111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:43.507111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:43.507111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:43.507111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:43.508073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:43.508073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:43.508073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:43.508073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:43.508073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:43.508073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:43.508073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:43.508073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:43.508073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:43.508073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:43.508073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:43.508073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:43.508073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:43.508073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:43.508073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:43.508073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:43.508073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:43.509015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:43.509015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:43.509015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:43.509015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:43.509015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:43.509015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:43.509015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:43.509015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:43.509015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 405/766] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:43.509504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09c613-26c3-4c85-8a17-ca8554f164c8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:43.519054 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4fcac-9f10-4e4c-9e1e-3fb184892470 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:43.530316 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:43.545912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:43.555718 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593db2a-a2bb-41ef-bfe0-464e9031f008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:43.556613 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593db2a-a2bb-41ef-bfe0-464e9031f008 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:43.557128 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593db2a-a2bb-41ef-bfe0-464e9031f008 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:43.557654 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593db2a-a2bb-41ef-bfe0-464e9031f008 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:43.558479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593db2a-a2bb-41ef-bfe0-464e9031f008 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:43.559037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593db2a-a2bb-41ef-bfe0-464e9031f008 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:43.560681 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593db2a-a2bb-41ef-bfe0-464e9031f008 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:43.565986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 362/767] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Sep 27 16:17:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:43.567038 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593db2a-a2bb-41ef-bfe0-464e9031f008 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:43.613439 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09c613-26c3-4c85-8a17-ca8554f164c8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:43.650743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46a8ea-5c8c-43aa-bbf9-d9e28028c339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:43.651337 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46a8ea-5c8c-43aa-bbf9-d9e28028c339 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:43.651608 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46a8ea-5c8c-43aa-bbf9-d9e28028c339 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:43.651879 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46a8ea-5c8c-43aa-bbf9-d9e28028c339 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:43.652619 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46a8ea-5c8c-43aa-bbf9-d9e28028c339 None admin] RBAC: Adding query filter params (role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=e70b85e430004a8b865622354c1d1ed4) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:43.652924 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46a8ea-5c8c-43aa-bbf9-d9e28028c339 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:43.654969 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46a8ea-5c8c-43aa-bbf9-d9e28028c339 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:43.664385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 406/768] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:17:43 2022] GET /identity/v3/role_assignments?user.id=e70b85e430004a8b865622354c1d1ed4&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:43.664385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46a8ea-5c8c-43aa-bbf9-d9e28028c339 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:43.686509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593db2a-a2bb-41ef-bfe0-464e9031f008 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:43.734902 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d495a-6c2b-4727-97d4-8cc66e971ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:43.735450 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d495a-6c2b-4727-97d4-8cc66e971ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:43.735984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d495a-6c2b-4727-97d4-8cc66e971ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:43.736261 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d495a-6c2b-4727-97d4-8cc66e971ff8 None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:43.736994 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d495a-6c2b-4727-97d4-8cc66e971ff8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:43.737302 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d495a-6c2b-4727-97d4-8cc66e971ff8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:43.739693 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d495a-6c2b-4727-97d4-8cc66e971ff8 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:43.758243 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 363/769] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:43.759612 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c23273-3ee5-47da-93b3-87aa4b24de95 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:43.759897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c23273-3ee5-47da-93b3-87aa4b24de95 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:43.760169 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c23273-3ee5-47da-93b3-87aa4b24de95 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:43.762936 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 364/770] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:43.768115 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe2dec-e304-4cce-a19c-658b13adf52c None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:43.768576 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe2dec-e304-4cce-a19c-658b13adf52c None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:43.769229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe2dec-e304-4cce-a19c-658b13adf52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:43.798198 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:43.803192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46a8ea-5c8c-43aa-bbf9-d9e28028c339 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:43.803378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-0cbe2dec-e304-4cce-a19c-658b13adf52c None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:43.804475 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-0cbe2dec-e304-4cce-a19c-658b13adf52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:43.842367 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:43.843617 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34eae0-e3bd-4a30-b532-86d2faf6c62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:43.844237 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34eae0-e3bd-4a30-b532-86d2faf6c62f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:43.844542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34eae0-e3bd-4a30-b532-86d2faf6c62f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:43.844830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34eae0-e3bd-4a30-b532-86d2faf6c62f None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:43.845505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34eae0-e3bd-4a30-b532-86d2faf6c62f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:43.845875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34eae0-e3bd-4a30-b532-86d2faf6c62f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:43.847279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34eae0-e3bd-4a30-b532-86d2faf6c62f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:43.852927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 407/771] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Sep 27 16:17:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:43.854348 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34eae0-e3bd-4a30-b532-86d2faf6c62f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:43.908437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 365/772] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:17:43.911077 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe2dec-e304-4cce-a19c-658b13adf52c None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:44.024842 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34eae0-e3bd-4a30-b532-86d2faf6c62f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:44.090683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ed0ef-08a3-400c-9b6b-56e96e5daf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:44.091296 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ed0ef-08a3-400c-9b6b-56e96e5daf77 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:44.091571 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ed0ef-08a3-400c-9b6b-56e96e5daf77 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:44.091842 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ed0ef-08a3-400c-9b6b-56e96e5daf77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:44.092581 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ed0ef-08a3-400c-9b6b-56e96e5daf77 None admin] RBAC: Adding query filter params (role.id=2696068001744b38a289a59c56f56a95, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=0c8d0a718e8347b5af397f866056266e) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:44.092888 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ed0ef-08a3-400c-9b6b-56e96e5daf77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:44.094305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ed0ef-08a3-400c-9b6b-56e96e5daf77 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:44.103768 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe2dec-e304-4cce-a19c-658b13adf52c None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:44.108685 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 408/773] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:17:43 2022] GET /identity/v3/role_assignments?user.id=0c8d0a718e8347b5af397f866056266e&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=2696068001744b38a289a59c56f56a95 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:44.147403 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7a8cb-0e86-4447-b123-0bb6eeae6527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:44.148036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7a8cb-0e86-4447-b123-0bb6eeae6527 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:44.148319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7a8cb-0e86-4447-b123-0bb6eeae6527 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:44.148676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7a8cb-0e86-4447-b123-0bb6eeae6527 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:44.149485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7a8cb-0e86-4447-b123-0bb6eeae6527 None admin] RBAC: Adding query filter params (interface=public, service_id=92f06073a60a4f1289422aa546915c1a, region_id=RegionOne) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:44.149976 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7a8cb-0e86-4447-b123-0bb6eeae6527 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:44.151472 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7a8cb-0e86-4447-b123-0bb6eeae6527 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:44.160493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 366/774] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Sep 27 16:17:43 2022] GET /identity/v3/endpoints?service_id=92f06073a60a4f1289422aa546915c1a&interface=public®ion_id=RegionOne => generated 194 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:44.166564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ed0ef-08a3-400c-9b6b-56e96e5daf77 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:44.202063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:44.284161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ed0ef-08a3-400c-9b6b-56e96e5daf77 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:44.302739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8188dc-cf7e-43fa-b5fd-b6813df56d3c None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:44.303081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8188dc-cf7e-43fa-b5fd-b6813df56d3c None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:44.303303 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8188dc-cf7e-43fa-b5fd-b6813df56d3c None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:44.305033 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 367/775] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:17:44.312088 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebc20c-d1e9-4f26-9ca0-583eb730a683 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:44.312397 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebc20c-d1e9-4f26-9ca0-583eb730a683 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:44.312848 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebc20c-d1e9-4f26-9ca0-583eb730a683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:44.329107 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37dc6f-1912-45f3-b273-95e27a07afe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:44.329717 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37dc6f-1912-45f3-b273-95e27a07afe1 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:44.332196 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37dc6f-1912-45f3-b273-95e27a07afe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:44.332196 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37dc6f-1912-45f3-b273-95e27a07afe1 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:44.332196 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37dc6f-1912-45f3-b273-95e27a07afe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:44.332465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37dc6f-1912-45f3-b273-95e27a07afe1 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:44.338163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 409/776] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Sep 27 16:17:44 2022] GET /identity/v3/services => generated 772 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:44.339075 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37dc6f-1912-45f3-b273-95e27a07afe1 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:44.365566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-80ebc20c-d1e9-4f26-9ca0-583eb730a683 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:44.366807 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-80ebc20c-d1e9-4f26-9ca0-583eb730a683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:44.420634 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:44.453015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:44.477816 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37dc6f-1912-45f3-b273-95e27a07afe1 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:44.493866 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 368/777] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:17:44.517912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fc477-8ed5-4836-9dbc-39dcd11803d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:44.518556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fc477-8ed5-4836-9dbc-39dcd11803d5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:44.518831 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fc477-8ed5-4836-9dbc-39dcd11803d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:44.519102 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fc477-8ed5-4836-9dbc-39dcd11803d5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:44.519741 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fc477-8ed5-4836-9dbc-39dcd11803d5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:44.521131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fc477-8ed5-4836-9dbc-39dcd11803d5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:44.530832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-787fc477-8ed5-4836-9dbc-39dcd11803d5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 16:17:44.530832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:44.530832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:17:44.530832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:17:44.530832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:17:44.530832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:17:44.530832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:17:44.530832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:44.530832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 16:17:44.530832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:44.530832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:17:44.530832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:44.530832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:44.530832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:44.530832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:44.530832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:44.530832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:44.531912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:44.531912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:44.531912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:44.531912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:44.531912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:44.531912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:44.531912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:17:44.531912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:17:44.531912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:17:44.531912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:17:44.531912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:44.531912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:44.531912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:44.531912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:44.531912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:44.531912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:44.533280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:44.533280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:44.533280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:44.533280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:44.533280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:44.533280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:44.533280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:44.533280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:44.533280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:44.533280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:44.533280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:17:44.533280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:44.533280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 16:17:44.533280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:44.533280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 410/778] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:44 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:44.538149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebc20c-d1e9-4f26-9ca0-583eb730a683 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:44.646855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebc20c-d1e9-4f26-9ca0-583eb730a683 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:44.683831 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d25381-6742-41f3-9989-a71d43b59358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:44.685372 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d25381-6742-41f3-9989-a71d43b59358 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:44.685860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d25381-6742-41f3-9989-a71d43b59358 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:44.686389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d25381-6742-41f3-9989-a71d43b59358 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:44.687234 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d25381-6742-41f3-9989-a71d43b59358 None admin] RBAC: Adding query filter params (name=network) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:44.687739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d25381-6742-41f3-9989-a71d43b59358 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:44.689333 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d25381-6742-41f3-9989-a71d43b59358 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:44.694541 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 369/779] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 27 16:17:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:44.699871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fc477-8ed5-4836-9dbc-39dcd11803d5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:44.812910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fc477-8ed5-4836-9dbc-39dcd11803d5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:44.820632 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d25381-6742-41f3-9989-a71d43b59358 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:44.861222 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:44.895577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e08b6-e083-4a62-9d0a-dcc768b67903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:44.896187 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e08b6-e083-4a62-9d0a-dcc768b67903 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:44.896537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e08b6-e083-4a62-9d0a-dcc768b67903 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:44.896815 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e08b6-e083-4a62-9d0a-dcc768b67903 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:44.897500 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e08b6-e083-4a62-9d0a-dcc768b67903 None admin] RBAC: Adding query filter params (type=network) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:44.897807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e08b6-e083-4a62-9d0a-dcc768b67903 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:44.900297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e08b6-e083-4a62-9d0a-dcc768b67903 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:44.912031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 411/780] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 27 16:17:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:44.917450 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e08b6-e083-4a62-9d0a-dcc768b67903 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:44.961464 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:44.982107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d25381-6742-41f3-9989-a71d43b59358 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:45.019359 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab17be-9713-4602-8297-e2d9165ff45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:45.020051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab17be-9713-4602-8297-e2d9165ff45b None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:45.020461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab17be-9713-4602-8297-e2d9165ff45b None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:45.020736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab17be-9713-4602-8297-e2d9165ff45b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:45.032181 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab17be-9713-4602-8297-e2d9165ff45b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:45.037395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-14ab17be-9713-4602-8297-e2d9165ff45b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:17:45.037395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:45.037395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:45.037395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:45.037395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:45.037395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:45.037395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:45.037395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:45.037395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:45.037395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:45.037395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:45.037395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:45.037395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:45.037395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:45.037395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:45.037395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:45.038363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:45.038363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:45.038363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:45.038363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:45.038363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:45.038363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:45.038363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:45.038363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:45.038363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:45.038363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:45.038363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:45.038363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:45.038363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:45.038363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:45.038363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:45.038363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:45.039439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:45.039439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:45.039439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:45.039439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:45.039439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:45.039439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:45.039439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:45.039439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:45.039439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:45.039439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:45.039439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:17:45.039439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:45.039439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 370/781] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:17:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:45.044231 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab17be-9713-4602-8297-e2d9165ff45b None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:45.117494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e08b6-e083-4a62-9d0a-dcc768b67903 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:45.158327 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6c0ac-152b-41a9-ab48-440b5ec97ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:45.159221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6c0ac-152b-41a9-ab48-440b5ec97ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:45.159642 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6c0ac-152b-41a9-ab48-440b5ec97ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:45.160049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6c0ac-152b-41a9-ab48-440b5ec97ef4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:45.160906 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6c0ac-152b-41a9-ab48-440b5ec97ef4 None admin] RBAC: Adding query filter params (interface=public, service_id=99bd58a18a184864a0745a4ea34732f7, region_id=RegionOne) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:45.161561 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6c0ac-152b-41a9-ab48-440b5ec97ef4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:45.164052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6c0ac-152b-41a9-ab48-440b5ec97ef4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:45.178250 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 412/782] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Sep 27 16:17:44 2022] GET /identity/v3/endpoints?service_id=99bd58a18a184864a0745a4ea34732f7&interface=public®ion_id=RegionOne => generated 194 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:45.184010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6c0ac-152b-41a9-ab48-440b5ec97ef4 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:45.230986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:45.284889 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:45.291046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab17be-9713-4602-8297-e2d9165ff45b None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:45.305435 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6c0ac-152b-41a9-ab48-440b5ec97ef4 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:45.352934 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef6f30-01a0-463d-a8e5-762c33c6ea26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:45.353540 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef6f30-01a0-463d-a8e5-762c33c6ea26 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:45.353813 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef6f30-01a0-463d-a8e5-762c33c6ea26 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:45.354082 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef6f30-01a0-463d-a8e5-762c33c6ea26 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:45.354908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef6f30-01a0-463d-a8e5-762c33c6ea26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:45.356863 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef6f30-01a0-463d-a8e5-762c33c6ea26 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:45.367115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 413/783] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Sep 27 16:17:45 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:45.370420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d4693-6787-456f-9d71-d6ec559986a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:45.371235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d4693-6787-456f-9d71-d6ec559986a3 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:45.371693 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d4693-6787-456f-9d71-d6ec559986a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:45.372111 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d4693-6787-456f-9d71-d6ec559986a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:45.373021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d4693-6787-456f-9d71-d6ec559986a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:45.373473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d4693-6787-456f-9d71-d6ec559986a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:45.375036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d4693-6787-456f-9d71-d6ec559986a3 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:45.385603 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 371/784] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:17:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:45.393457 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef6f30-01a0-463d-a8e5-762c33c6ea26 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:45.527820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef6f30-01a0-463d-a8e5-762c33c6ea26 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:45.567191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20452336-093a-4f64-aff2-fda1951462b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:45.568102 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20452336-093a-4f64-aff2-fda1951462b7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:45.568549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20452336-093a-4f64-aff2-fda1951462b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:45.568980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20452336-093a-4f64-aff2-fda1951462b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:45.579483 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20452336-093a-4f64-aff2-fda1951462b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:45.581168 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20452336-093a-4f64-aff2-fda1951462b7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:45.594046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:45.609239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-20452336-093a-4f64-aff2-fda1951462b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:45.609239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:45.609239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:45.609239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:45.609239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:45.609239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:45.609239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:45.609239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:45.609239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:45.609239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:45.609239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:45.609239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:45.609239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:45.609239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:45.609239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:45.609239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:45.619354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:45.619354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:45.619354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:45.619354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:45.619354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:45.619354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:45.619354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:45.619354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:45.619354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:45.619354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:45.619354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:45.619354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:45.619354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:45.619354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:45.619354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:45.619354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:45.619354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:45.620309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:45.620309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:45.620309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:45.620309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 414/785] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:45.620621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d4693-6787-456f-9d71-d6ec559986a3 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:45.743848 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d4693-6787-456f-9d71-d6ec559986a3 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:45.780441 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ad629-92ae-45d2-8472-821be2b26780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:45.781351 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ad629-92ae-45d2-8472-821be2b26780 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:45.781813 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ad629-92ae-45d2-8472-821be2b26780 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:45.782264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ad629-92ae-45d2-8472-821be2b26780 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:45.783102 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ad629-92ae-45d2-8472-821be2b26780 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:45.783596 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ad629-92ae-45d2-8472-821be2b26780 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:45.785173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ad629-92ae-45d2-8472-821be2b26780 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:45.798729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 372/786] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:45.803891 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20452336-093a-4f64-aff2-fda1951462b7 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:45.917088 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20452336-093a-4f64-aff2-fda1951462b7 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:45.961083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8966e3-a0eb-4775-9088-25627fcde389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:45.962022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8966e3-a0eb-4775-9088-25627fcde389 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:45.962482 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8966e3-a0eb-4775-9088-25627fcde389 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:45.962968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8966e3-a0eb-4775-9088-25627fcde389 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:45.974239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8966e3-a0eb-4775-9088-25627fcde389 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:45.975880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8966e3-a0eb-4775-9088-25627fcde389 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:45.987396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-ca8966e3-a0eb-4775-9088-25627fcde389 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 16:17:45.987396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:45.987396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:45.987396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:45.987396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:45.987396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:45.987396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:45.987396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:45.987396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:45.987396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:45.987396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:45.987396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:45.987396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:45.987396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:45.987396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:45.987396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:45.988452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:45.988452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:45.988452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:45.988452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:45.988452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:45.988452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:45.988452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:45.988452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:45.988452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:45.988452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:45.988452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:45.988452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:45.988452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:45.988452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:45.988452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:45.988452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:45.988452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:45.988452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:45.989424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:45.989424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:45.989424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:45.989424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:45.989424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:45.989424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:45.989424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:45.989424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:45.989424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 16:17:45.989424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:45.991592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 415/787] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Sep 27 16:17:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:45.996874 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ad629-92ae-45d2-8472-821be2b26780 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:46.000999 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:46.133284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ad629-92ae-45d2-8472-821be2b26780 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:46.179560 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32aca4-6c73-4f7a-9334-b65d5494e169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:46.180466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32aca4-6c73-4f7a-9334-b65d5494e169 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:46.180897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32aca4-6c73-4f7a-9334-b65d5494e169 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:46.181319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32aca4-6c73-4f7a-9334-b65d5494e169 None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:46.182193 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32aca4-6c73-4f7a-9334-b65d5494e169 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:46.182648 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32aca4-6c73-4f7a-9334-b65d5494e169 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:46.184800 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32aca4-6c73-4f7a-9334-b65d5494e169 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:46.207505 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 373/788] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Sep 27 16:17:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:46.212356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e261b05-9690-4ab4-85bb-264e3356450b None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:46.212356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e261b05-9690-4ab4-85bb-264e3356450b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:46.212356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e261b05-9690-4ab4-85bb-264e3356450b None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:46.213577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32aca4-6c73-4f7a-9334-b65d5494e169 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:46.213984 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 416/789] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:46.219203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f5399-0358-4376-820f-49b07b621384 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:46.219595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f5399-0358-4376-820f-49b07b621384 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:46.219978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f5399-0358-4376-820f-49b07b621384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:46.260779 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a64f5399-0358-4376-820f-49b07b621384 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:46.261965 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a64f5399-0358-4376-820f-49b07b621384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:46.284719 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:46.355219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:46.359180 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32aca4-6c73-4f7a-9334-b65d5494e169 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:46.374749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 417/790] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:17:46.455295 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9feb4-75a0-466e-b9d6-b3c7c15aac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:46.455811 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9feb4-75a0-466e-b9d6-b3c7c15aac63 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:46.456085 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9feb4-75a0-466e-b9d6-b3c7c15aac63 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:46.456377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9feb4-75a0-466e-b9d6-b3c7c15aac63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:46.550204 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9feb4-75a0-466e-b9d6-b3c7c15aac63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:46.551653 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9feb4-75a0-466e-b9d6-b3c7c15aac63 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:46.633099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:46.683961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 374/791] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 16:17:46.689536 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f5399-0358-4376-820f-49b07b621384 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:46.754516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9feb4-75a0-466e-b9d6-b3c7c15aac63 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:46.804375 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f5399-0358-4376-820f-49b07b621384 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:46.842215 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795f505-e3ad-4c08-a7e8-2082fb36685a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:46.842847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795f505-e3ad-4c08-a7e8-2082fb36685a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:46.843122 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795f505-e3ad-4c08-a7e8-2082fb36685a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:46.843822 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795f505-e3ad-4c08-a7e8-2082fb36685a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:46.854438 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795f505-e3ad-4c08-a7e8-2082fb36685a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:46.856751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795f505-e3ad-4c08-a7e8-2082fb36685a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:46.871531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-f795f505-e3ad-4c08-a7e8-2082fb36685a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:46.871531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:46.871531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:46.871531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:46.871531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:46.871531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:46.871531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:46.871531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:46.871531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:46.871531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:46.871531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:46.871531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:46.871531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:46.871531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:46.871531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:46.871531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:46.872611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:46.872611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:46.872611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:46.872611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:46.872611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:46.872611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:46.872611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:46.872611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:46.872611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:46.872611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:46.872611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:46.872611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:46.872611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:46.872611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:46.872611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:46.872611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:46.872611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:46.874127 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:46.874127 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:46.874127 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:46.874127 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 418/792] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:46.878657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795f505-e3ad-4c08-a7e8-2082fb36685a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:46.927037 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:46.972859 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9feb4-75a0-466e-b9d6-b3c7c15aac63 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:46.998025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795f505-e3ad-4c08-a7e8-2082fb36685a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:47.015377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d904983-a806-46d5-94ba-31f0b7a45503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:47.015935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d904983-a806-46d5-94ba-31f0b7a45503 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:47.016212 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d904983-a806-46d5-94ba-31f0b7a45503 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:47.016507 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d904983-a806-46d5-94ba-31f0b7a45503 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:47.030935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d904983-a806-46d5-94ba-31f0b7a45503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:47.031523 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14044a9-fb91-43a1-bcd1-e096df4e3fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:47.032123 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14044a9-fb91-43a1-bcd1-e096df4e3fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:47.032457 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14044a9-fb91-43a1-bcd1-e096df4e3fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:47.032891 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14044a9-fb91-43a1-bcd1-e096df4e3fc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:47.033541 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14044a9-fb91-43a1-bcd1-e096df4e3fc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:47.033842 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14044a9-fb91-43a1-bcd1-e096df4e3fc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:47.035263 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14044a9-fb91-43a1-bcd1-e096df4e3fc8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:47.035671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-3d904983-a806-46d5-94ba-31f0b7a45503 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:17:47.035671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:47.035671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:47.035671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:47.035671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:47.035671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:47.035671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:47.035671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:47.035671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:47.035671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:47.035671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:47.035671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:47.035671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:47.035671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:47.035671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:47.035671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:47.036641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:47.036641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:47.036641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:47.036641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:47.036641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:47.036641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:47.036641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:47.036641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:47.036641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:47.036641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:47.036641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:47.036641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:47.036641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:47.036641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:47.036641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:47.036641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:47.037497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:47.037497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:47.037497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:47.037497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:47.037497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:47.037497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:47.037497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:47.037497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:47.037497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:47.037497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:47.037497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:17:47.037497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:47.037497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 375/793] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:17:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:47.044614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f103a-e201-4231-8af7-92cc2ee86c2e None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:47.044614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f103a-e201-4231-8af7-92cc2ee86c2e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:47.044614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f103a-e201-4231-8af7-92cc2ee86c2e None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:47.044614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 376/794] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:47.047592 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b9331-bfc0-4017-825e-6f2724293130 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:47.047873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b9331-bfc0-4017-825e-6f2724293130 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:47.048146 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b9331-bfc0-4017-825e-6f2724293130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:47.050610 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 419/795] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:47.051524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14044a9-fb91-43a1-bcd1-e096df4e3fc8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:47.069932 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-ad4b9331-bfc0-4017-825e-6f2724293130 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:47.071683 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ad4b9331-bfc0-4017-825e-6f2724293130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:47.088958 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:47.149363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 377/796] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:17:47.157874 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b9331-bfc0-4017-825e-6f2724293130 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:47.160016 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:47.162971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14044a9-fb91-43a1-bcd1-e096df4e3fc8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:47.198958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02c645-afca-4ecb-bcca-0374c2fa2369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:47.199557 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02c645-afca-4ecb-bcca-0374c2fa2369 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:47.200422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02c645-afca-4ecb-bcca-0374c2fa2369 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:47.200706 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02c645-afca-4ecb-bcca-0374c2fa2369 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:47.201357 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02c645-afca-4ecb-bcca-0374c2fa2369 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:47.201637 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02c645-afca-4ecb-bcca-0374c2fa2369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:47.203022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02c645-afca-4ecb-bcca-0374c2fa2369 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:47.212026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 420/797] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:17:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:47.213272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96dae3-8f94-4558-b9cc-f04f398e83c3 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:47.213552 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96dae3-8f94-4558-b9cc-f04f398e83c3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:47.213825 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96dae3-8f94-4558-b9cc-f04f398e83c3 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:47.215238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 421/798] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:47.217059 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96dae3-8f94-4558-b9cc-f04f398e83c3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:47.289078 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b9331-bfc0-4017-825e-6f2724293130 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:47.325624 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103e8ef-84bd-45ce-aabd-8d93e670ee92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:47.326247 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103e8ef-84bd-45ce-aabd-8d93e670ee92 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:47.326522 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103e8ef-84bd-45ce-aabd-8d93e670ee92 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:47.326786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103e8ef-84bd-45ce-aabd-8d93e670ee92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:47.333970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103e8ef-84bd-45ce-aabd-8d93e670ee92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:47.335397 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103e8ef-84bd-45ce-aabd-8d93e670ee92 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:47.347290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-a103e8ef-84bd-45ce-aabd-8d93e670ee92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:47.347290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:47.347290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:47.347290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:47.347290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:47.347290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:47.347290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:47.347290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:47.347290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:47.347290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:47.347290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:47.347290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:47.347290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:47.347290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:47.347290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:47.348198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:47.348198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:47.348198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:47.348198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:47.348198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:47.348198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:47.348198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:47.348198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:47.348198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:47.348198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:47.348198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:47.348198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:47.348198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:47.348198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:47.348198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:47.348198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:47.348198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:47.349149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:47.349149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:47.349149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:47.349149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:47.349149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:47.349149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:47.349149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:47.349149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:47.353309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 378/799] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:47.354636 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4569f22-7c96-4487-aa1e-6f85b7b0a964 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:47.354914 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4569f22-7c96-4487-aa1e-6f85b7b0a964 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:47.355181 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4569f22-7c96-4487-aa1e-6f85b7b0a964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:47.361424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96dae3-8f94-4558-b9cc-f04f398e83c3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:47.373414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-b4569f22-7c96-4487-aa1e-6f85b7b0a964 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:47.374753 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b4569f22-7c96-4487-aa1e-6f85b7b0a964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:47.382655 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:47.408863 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591e1fc-45c9-4c2a-9741-cc08dedfe470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:47.410705 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591e1fc-45c9-4c2a-9741-cc08dedfe470 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:47.411175 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591e1fc-45c9-4c2a-9741-cc08dedfe470 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:47.411657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591e1fc-45c9-4c2a-9741-cc08dedfe470 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:47.427879 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591e1fc-45c9-4c2a-9741-cc08dedfe470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:47.429883 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591e1fc-45c9-4c2a-9741-cc08dedfe470 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:47.443606 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 379/800] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:17:47.448079 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4569f22-7c96-4487-aa1e-6f85b7b0a964 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:47.448232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-0591e1fc-45c9-4c2a-9741-cc08dedfe470 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:47.448232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:47.448232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:47.448232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:47.448232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:47.448232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:47.448232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:47.448232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:47.448232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:47.448232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:47.448232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:47.448232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:47.448232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:47.448232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:47.448232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:47.448232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:47.449180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:47.449180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:47.449180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:47.449180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:47.449180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:47.449180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:47.449180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:47.449180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:47.449180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:47.449180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:47.449180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:47.449180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:47.449180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:47.449180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:47.449180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:47.449180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:47.449180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:47.450235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:47.450235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:47.450235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:47.450235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 422/801] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:47.450235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591e1fc-45c9-4c2a-9741-cc08dedfe470 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:47.469200 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:47.551712 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4569f22-7c96-4487-aa1e-6f85b7b0a964 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:47.574523 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591e1fc-45c9-4c2a-9741-cc08dedfe470 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:47.586127 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a9870-09c8-427d-bf1b-0968f0c3304c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:47.586727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a9870-09c8-427d-bf1b-0968f0c3304c None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:47.587001 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a9870-09c8-427d-bf1b-0968f0c3304c None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:47.587272 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a9870-09c8-427d-bf1b-0968f0c3304c None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:47.588008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a9870-09c8-427d-bf1b-0968f0c3304c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:47.588310 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a9870-09c8-427d-bf1b-0968f0c3304c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:47.589810 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a9870-09c8-427d-bf1b-0968f0c3304c None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:47.607118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 380/802] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:47.608025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a9870-09c8-427d-bf1b-0968f0c3304c None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:47.610862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:47.618241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6c165-b614-4359-a80c-f36b834169e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:47.618938 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6c165-b614-4359-a80c-f36b834169e9 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:47.621204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6c165-b614-4359-a80c-f36b834169e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:47.621204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6c165-b614-4359-a80c-f36b834169e9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:47.621204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6c165-b614-4359-a80c-f36b834169e9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:47.621516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6c165-b614-4359-a80c-f36b834169e9 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:47.631597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-cdd6c165-b614-4359-a80c-f36b834169e9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 16:17:47.631597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:47.631597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:17:47.631597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:17:47.631597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:17:47.631597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:17:47.631597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:17:47.631597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:47.631597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 16:17:47.631597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:47.631597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:17:47.631597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:47.631597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:47.631597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:47.631597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:47.631597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:47.631597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:47.632671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:47.632671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:47.632671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:47.632671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:47.632671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:47.632671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:47.632671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:17:47.632671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:17:47.632671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:17:47.632671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:17:47.632671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:47.632671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:47.632671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:47.632671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:47.632671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:47.632671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:47.633531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:47.633531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:47.633531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:47.633531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:47.633531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:47.633531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:47.633531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:47.633531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:47.633531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:47.633531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:47.633531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:17:47.633531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:47.633531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 16:17:47.633531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:47.633531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 423/803] 10.222.0.26 () {56 vars in 1129 bytes} [Tue Sep 27 16:17:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:47.634346 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6c165-b614-4359-a80c-f36b834169e9 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:47.721040 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:47.744803 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a9870-09c8-427d-bf1b-0968f0c3304c None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:47.751381 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6c165-b614-4359-a80c-f36b834169e9 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:47.781397 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd8dea-dc2c-4831-bfff-c52d5c12b1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:47.782093 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd8dea-dc2c-4831-bfff-c52d5c12b1bb None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:47.782304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd8dea-dc2c-4831-bfff-c52d5c12b1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:47.782552 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd8dea-dc2c-4831-bfff-c52d5c12b1bb None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:47.783200 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd8dea-dc2c-4831-bfff-c52d5c12b1bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:47.783516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd8dea-dc2c-4831-bfff-c52d5c12b1bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:47.784919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd8dea-dc2c-4831-bfff-c52d5c12b1bb None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:47.791271 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026263f-4158-40a1-b5d6-e9d17c245c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:47.792324 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026263f-4158-40a1-b5d6-e9d17c245c95 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:47.792719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026263f-4158-40a1-b5d6-e9d17c245c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:47.793096 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026263f-4158-40a1-b5d6-e9d17c245c95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:47.793948 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026263f-4158-40a1-b5d6-e9d17c245c95 None admin] RBAC: Adding query filter params (role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=e71fea96b2b949f9abca12172e69284b) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:47.794616 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026263f-4158-40a1-b5d6-e9d17c245c95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:47.796245 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026263f-4158-40a1-b5d6-e9d17c245c95 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:47.804778 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 381/804] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:47.804778 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd8dea-dc2c-4831-bfff-c52d5c12b1bb None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:47.804997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 424/805] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:17:47 2022] GET /identity/v3/role_assignments?user.id=e71fea96b2b949f9abca12172e69284b&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:47.804997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026263f-4158-40a1-b5d6-e9d17c245c95 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:47.881028 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:47.937104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd8dea-dc2c-4831-bfff-c52d5c12b1bb None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:47.952854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026263f-4158-40a1-b5d6-e9d17c245c95 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:47.988671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564100d1-3db9-43ae-920e-f6fd451ad123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:47.989512 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564100d1-3db9-43ae-920e-f6fd451ad123 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:47.989795 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564100d1-3db9-43ae-920e-f6fd451ad123 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:47.990066 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564100d1-3db9-43ae-920e-f6fd451ad123 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:47.990952 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564100d1-3db9-43ae-920e-f6fd451ad123 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:47.991667 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564100d1-3db9-43ae-920e-f6fd451ad123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:47.993409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564100d1-3db9-43ae-920e-f6fd451ad123 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:47.997659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8207773-4e29-4f49-9e6e-6caa186987cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:47.998311 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8207773-4e29-4f49-9e6e-6caa186987cc None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:47.998591 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8207773-4e29-4f49-9e6e-6caa186987cc None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:47.998862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8207773-4e29-4f49-9e6e-6caa186987cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:47.999522 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 382/806] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Sep 27 16:17:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:48.000428 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564100d1-3db9-43ae-920e-f6fd451ad123 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:48.016503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8207773-4e29-4f49-9e6e-6caa186987cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:48.023190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-f8207773-4e29-4f49-9e6e-6caa186987cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:48.023190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:48.023190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:48.023190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:48.023190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:48.023190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:48.023190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:48.023190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:48.023190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:48.023190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:48.023190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:48.023190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:48.023190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:48.023190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:48.023190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:48.023190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:48.024231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:48.024231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:48.024231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:48.024231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:48.024231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:48.024231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:48.024231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:48.024231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:48.024231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:48.024231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:48.024231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:48.024231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:48.024231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:48.024231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:48.024231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:48.024231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:48.025169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:48.025169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:48.025169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:48.025169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:48.025169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:48.025169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:48.025169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:48.025169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:48.025169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:48.025169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:48.025169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:48.025169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:48.030731 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 425/807] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:48.031738 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8207773-4e29-4f49-9e6e-6caa186987cc None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:48.035004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:48.133576 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564100d1-3db9-43ae-920e-f6fd451ad123 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:48.161913 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:48.162102 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8207773-4e29-4f49-9e6e-6caa186987cc None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:48.173542 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4167c-285d-4e8b-ad10-2021e65062cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:48.175628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4167c-285d-4e8b-ad10-2021e65062cd None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:48.175628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4167c-285d-4e8b-ad10-2021e65062cd None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:48.175628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4167c-285d-4e8b-ad10-2021e65062cd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:48.182059 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4167c-285d-4e8b-ad10-2021e65062cd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:48.183497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4167c-285d-4e8b-ad10-2021e65062cd None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:48.196501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-27d4167c-285d-4e8b-ad10-2021e65062cd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 16:17:48.196501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:48.196501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:48.196501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:48.196501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:48.196501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:48.196501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:48.196501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:48.196501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:48.196501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:48.196501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:48.196501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:48.196501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:48.196501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:48.196501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:48.196501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:48.197461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:48.197461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:48.197461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:48.197461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:48.197461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:48.197461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:48.197461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:48.197461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:48.197461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:48.197461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:48.197461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:48.197461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:48.197461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:48.197461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:48.197461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:48.197461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:48.197461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:48.197461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:48.198417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:48.198417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:48.198417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:48.198417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:48.198417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:48.198417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:48.198417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:48.198417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:48.198417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 27 16:17:48.198417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:48.200225 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300b53a-e32f-40e4-ac35-efc5af1c9e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:48.200857 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300b53a-e32f-40e4-ac35-efc5af1c9e5b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:48.201132 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300b53a-e32f-40e4-ac35-efc5af1c9e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:48.201400 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300b53a-e32f-40e4-ac35-efc5af1c9e5b None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:48.202024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300b53a-e32f-40e4-ac35-efc5af1c9e5b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:48.202323 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300b53a-e32f-40e4-ac35-efc5af1c9e5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:48.203685 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300b53a-e32f-40e4-ac35-efc5af1c9e5b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:48.204468 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 383/808] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:17:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:48.205838 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4167c-285d-4e8b-ad10-2021e65062cd None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:48.208736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 426/809] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Sep 27 16:17:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:48.210080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f97a2-61b9-412c-b746-ee343b3edb69 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:48.210547 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f97a2-61b9-412c-b746-ee343b3edb69 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:48.210998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f97a2-61b9-412c-b746-ee343b3edb69 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:48.212752 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 427/810] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:48.213641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f97a2-61b9-412c-b746-ee343b3edb69 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:48.282815 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:48.315925 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4167c-285d-4e8b-ad10-2021e65062cd None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:48.320377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f97a2-61b9-412c-b746-ee343b3edb69 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:48.350034 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c7dee-491a-4b77-aed8-2cef87b98998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:48.350713 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c7dee-491a-4b77-aed8-2cef87b98998 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:48.350925 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c7dee-491a-4b77-aed8-2cef87b98998 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:48.351203 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c7dee-491a-4b77-aed8-2cef87b98998 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:48.351856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c7dee-491a-4b77-aed8-2cef87b98998 None admin] RBAC: Adding query filter params (name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:48.352154 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c7dee-491a-4b77-aed8-2cef87b98998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:48.353557 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c7dee-491a-4b77-aed8-2cef87b98998 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:48.356965 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5ad43-8743-4424-9eb5-d63adcca7a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:48.357736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5ad43-8743-4424-9eb5-d63adcca7a7c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:48.358158 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5ad43-8743-4424-9eb5-d63adcca7a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:48.366510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5ad43-8743-4424-9eb5-d63adcca7a7c None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:48.366510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5ad43-8743-4424-9eb5-d63adcca7a7c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:48.366510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5ad43-8743-4424-9eb5-d63adcca7a7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:48.366510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5ad43-8743-4424-9eb5-d63adcca7a7c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:48.366861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 384/811] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:17:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:48.366861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c7dee-491a-4b77-aed8-2cef87b98998 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:48.386084 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 428/812] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Sep 27 16:17:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:48.387940 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601a4a2-a9ca-4701-833f-e41586af6d7b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:48.388283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601a4a2-a9ca-4701-833f-e41586af6d7b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:48.388643 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601a4a2-a9ca-4701-833f-e41586af6d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:48.407288 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-0601a4a2-a9ca-4701-833f-e41586af6d7b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:48.408510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0601a4a2-a9ca-4701-833f-e41586af6d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:48.422275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:48.474930 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c7dee-491a-4b77-aed8-2cef87b98998 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:48.484804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 429/813] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:17:48.484804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601a4a2-a9ca-4701-833f-e41586af6d7b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:48.519584 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a6b7d-bbf2-4bfb-b633-362b83485dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:48.520204 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a6b7d-bbf2-4bfb-b633-362b83485dba None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:48.520527 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a6b7d-bbf2-4bfb-b633-362b83485dba None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:48.520791 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a6b7d-bbf2-4bfb-b633-362b83485dba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:48.521457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a6b7d-bbf2-4bfb-b633-362b83485dba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:48.523120 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a6b7d-bbf2-4bfb-b633-362b83485dba None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:48.546934 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:48.591871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601a4a2-a9ca-4701-833f-e41586af6d7b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:48.624861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3d24e-87a1-45a3-a380-7b20fca7cadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:48.625492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3d24e-87a1-45a3-a380-7b20fca7cadd None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:48.625810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3d24e-87a1-45a3-a380-7b20fca7cadd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:48.626063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3d24e-87a1-45a3-a380-7b20fca7cadd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:48.637104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3d24e-87a1-45a3-a380-7b20fca7cadd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:48.639591 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3d24e-87a1-45a3-a380-7b20fca7cadd None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:48.645672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 385/814] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:17:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:17:48.646639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a6b7d-bbf2-4bfb-b633-362b83485dba None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:48.658804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-d6b3d24e-87a1-45a3-a380-7b20fca7cadd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:48.658804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:48.658804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:48.658804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:48.658804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:48.658804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:48.658804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:48.658804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:48.658804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:48.658804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:48.658804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:48.658804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:48.658804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:48.658804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:48.658804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:48.658804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:48.659810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:48.659810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:48.659810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:48.659810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:48.659810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:48.659810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:48.659810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:48.659810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:48.659810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:48.659810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:48.659810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:48.659810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:48.659810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:48.659810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:48.659810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:48.659810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:48.659810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:48.661226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:48.661226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:48.661226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:48.663070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 430/815] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:48.671260 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3d24e-87a1-45a3-a380-7b20fca7cadd None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:48.800174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3d24e-87a1-45a3-a380-7b20fca7cadd None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:48.809091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:48.832203 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:48.836483 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a6b7d-bbf2-4bfb-b633-362b83485dba None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:48.843560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdeec94-cee2-4d18-a3b9-4813cdb2d5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:48.843560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdeec94-cee2-4d18-a3b9-4813cdb2d5da None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:48.843560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdeec94-cee2-4d18-a3b9-4813cdb2d5da None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:48.843560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdeec94-cee2-4d18-a3b9-4813cdb2d5da None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:48.844121 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdeec94-cee2-4d18-a3b9-4813cdb2d5da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:48.844713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdeec94-cee2-4d18-a3b9-4813cdb2d5da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:48.846259 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdeec94-cee2-4d18-a3b9-4813cdb2d5da None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:48.860447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 431/816] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:48.861612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdeec94-cee2-4d18-a3b9-4813cdb2d5da None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:48.884862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a735723-dbb1-4922-8967-7850b7a63aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:48.886022 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a735723-dbb1-4922-8967-7850b7a63aac None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:48.886459 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a735723-dbb1-4922-8967-7850b7a63aac None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:48.886725 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a735723-dbb1-4922-8967-7850b7a63aac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:48.899057 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a735723-dbb1-4922-8967-7850b7a63aac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:48.900804 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a735723-dbb1-4922-8967-7850b7a63aac None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:48.915479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-8a735723-dbb1-4922-8967-7850b7a63aac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:48.915479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:48.915479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:48.915479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:48.915479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:48.915479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:48.915479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:48.915479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:48.915479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:48.915479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:48.915479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:48.915479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:48.915479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:48.915479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:48.915479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:48.915479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:48.916509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:48.916509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:48.916509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:48.916509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:48.916509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:48.916509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:48.916509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:48.916509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:48.916509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:48.916509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:48.916509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:48.916509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:48.916509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:48.916509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:48.916509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:48.916509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:48.916509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:48.917426 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:48.917426 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:48.917426 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:48.917426 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 386/817] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:48.917426 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a735723-dbb1-4922-8967-7850b7a63aac None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:48.998846 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdeec94-cee2-4d18-a3b9-4813cdb2d5da None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:49.025249 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a735723-dbb1-4922-8967-7850b7a63aac None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:49.037382 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396b35e-8a23-4051-9dcb-a7c2f6ec3ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:49.038074 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396b35e-8a23-4051-9dcb-a7c2f6ec3ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:49.038356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396b35e-8a23-4051-9dcb-a7c2f6ec3ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:49.038633 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396b35e-8a23-4051-9dcb-a7c2f6ec3ee2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:49.039262 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396b35e-8a23-4051-9dcb-a7c2f6ec3ee2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:49.041296 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396b35e-8a23-4051-9dcb-a7c2f6ec3ee2 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:49.051478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-7396b35e-8a23-4051-9dcb-a7c2f6ec3ee2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 16:17:49.051478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:49.051478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:17:49.051478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:17:49.051478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:17:49.051478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:17:49.051478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:17:49.051478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:49.051478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 16:17:49.051478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:49.051478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:17:49.051478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:49.051478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:49.051478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:49.051478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:49.051478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:49.051478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:49.052549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:49.052549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:49.052549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:49.052549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:49.052549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:49.052549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:49.052549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:17:49.052549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:17:49.052549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:17:49.052549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:17:49.052549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:49.052549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:49.052549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:49.052549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:49.052549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:49.052549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:49.053408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:49.053408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:49.053408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:49.053408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:49.053408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:49.053408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:49.053408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:49.053408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:49.053408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:49.053408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:49.053408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:17:49.053408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:49.053408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 16:17:49.053408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:49.053408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 432/818] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:48 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:49.054200 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396b35e-8a23-4051-9dcb-a7c2f6ec3ee2 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:49.067477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d84cc-2d12-4814-8916-a4b156c6d6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:49.068275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d84cc-2d12-4814-8916-a4b156c6d6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:49.068732 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d84cc-2d12-4814-8916-a4b156c6d6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:49.069105 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d84cc-2d12-4814-8916-a4b156c6d6f7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:49.078704 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d84cc-2d12-4814-8916-a4b156c6d6f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:49.080403 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d84cc-2d12-4814-8916-a4b156c6d6f7 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:49.089350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:49.093280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-c02d84cc-2d12-4814-8916-a4b156c6d6f7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 16:17:49.093280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:49.093280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:49.093280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:49.093280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:49.093280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:49.093280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:49.093280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:49.093280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:49.093280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:49.093280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:49.093280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:49.093280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:49.093280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:49.093280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:49.093280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:49.094414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:49.094414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:49.094414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:49.094414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:49.094414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:49.094414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:49.094414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:49.094414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:49.094414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:49.094414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:49.094414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:49.094414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:49.094414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:49.094414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:49.094414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:49.094414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:49.094414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:49.094414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:49.095651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:49.095651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:49.095651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:49.095651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:49.095651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:49.095651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:49.095651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:49.095651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:49.095651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 16:17:49.095651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:49.100354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 387/819] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 27 16:17:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:49.100354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d84cc-2d12-4814-8916-a4b156c6d6f7 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:49.113680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:49.179008 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396b35e-8a23-4051-9dcb-a7c2f6ec3ee2 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:49.218119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7316cd3-9f93-4550-9bcb-c6dda41b7e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:49.219087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7316cd3-9f93-4550-9bcb-c6dda41b7e07 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:49.219638 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7316cd3-9f93-4550-9bcb-c6dda41b7e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:49.220129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7316cd3-9f93-4550-9bcb-c6dda41b7e07 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:49.221010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7316cd3-9f93-4550-9bcb-c6dda41b7e07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:49.221515 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7316cd3-9f93-4550-9bcb-c6dda41b7e07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:49.223405 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7316cd3-9f93-4550-9bcb-c6dda41b7e07 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:49.233218 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d84cc-2d12-4814-8916-a4b156c6d6f7 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:49.237080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 433/820] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:49.238193 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7316cd3-9f93-4550-9bcb-c6dda41b7e07 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:49.277676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3eb971-7f17-4ddf-9bab-7b50437d20e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:49.278812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3eb971-7f17-4ddf-9bab-7b50437d20e8 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:49.279088 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3eb971-7f17-4ddf-9bab-7b50437d20e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:49.279357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3eb971-7f17-4ddf-9bab-7b50437d20e8 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:49.279982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3eb971-7f17-4ddf-9bab-7b50437d20e8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:49.280284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3eb971-7f17-4ddf-9bab-7b50437d20e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:49.281672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3eb971-7f17-4ddf-9bab-7b50437d20e8 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:49.289365 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 388/821] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 27 16:17:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:49.290906 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3eb971-7f17-4ddf-9bab-7b50437d20e8 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:49.341040 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:49.353800 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7316cd3-9f93-4550-9bcb-c6dda41b7e07 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:49.391710 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680578b-1766-4c56-a29e-a0cd283a9e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:49.392215 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680578b-1766-4c56-a29e-a0cd283a9e3a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:49.392626 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680578b-1766-4c56-a29e-a0cd283a9e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:49.393014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680578b-1766-4c56-a29e-a0cd283a9e3a None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:49.393838 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680578b-1766-4c56-a29e-a0cd283a9e3a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:49.394498 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:49.394809 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680578b-1766-4c56-a29e-a0cd283a9e3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:49.397356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680578b-1766-4c56-a29e-a0cd283a9e3a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:49.416273 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 434/822] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Sep 27 16:17:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:49.417466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680578b-1766-4c56-a29e-a0cd283a9e3a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:49.423523 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3eb971-7f17-4ddf-9bab-7b50437d20e8 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:49.471467 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8b13f-6a14-49da-953d-55b51fc40b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:49.472277 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8b13f-6a14-49da-953d-55b51fc40b28 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:49.472674 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8b13f-6a14-49da-953d-55b51fc40b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:49.472954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8b13f-6a14-49da-953d-55b51fc40b28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:49.482002 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8b13f-6a14-49da-953d-55b51fc40b28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:49.484264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8b13f-6a14-49da-953d-55b51fc40b28 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:49.500007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-a5c8b13f-6a14-49da-953d-55b51fc40b28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:49.500007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:49.500007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:49.500007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:49.500007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:49.500007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:49.500007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:49.500007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:49.500007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:49.500007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:49.500007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:49.500007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:49.500007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:49.500007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:49.500007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:49.501067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:49.501067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:49.501067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:49.501067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:49.501067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:49.501067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:49.501067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:49.501067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:49.501067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:49.501067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:49.501067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:49.501067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:49.501067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:49.501067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:49.501067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:49.501067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:49.501067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:49.501986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:49.501986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:49.501986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:49.501986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:49.501986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:49.501986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:49.501986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:49.501986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:49.501986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 389/823] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:49.501986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8b13f-6a14-49da-953d-55b51fc40b28 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:49.544617 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680578b-1766-4c56-a29e-a0cd283a9e3a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:49.581841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde9d0c-c0a3-4524-8dad-907ce8f084bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:49.582817 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde9d0c-c0a3-4524-8dad-907ce8f084bd None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:49.583372 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde9d0c-c0a3-4524-8dad-907ce8f084bd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:49.583870 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde9d0c-c0a3-4524-8dad-907ce8f084bd None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:49.584838 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde9d0c-c0a3-4524-8dad-907ce8f084bd None admin] RBAC: Adding query filter params (type=network) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:49.585346 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde9d0c-c0a3-4524-8dad-907ce8f084bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:49.586906 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde9d0c-c0a3-4524-8dad-907ce8f084bd None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:49.592663 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 435/824] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 27 16:17:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:49.593795 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde9d0c-c0a3-4524-8dad-907ce8f084bd None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:49.611089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:49.639797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8b13f-6a14-49da-953d-55b51fc40b28 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:49.679479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529917d-21b8-4563-84bf-9837aba9c67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:49.680117 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529917d-21b8-4563-84bf-9837aba9c67b None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:49.680422 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529917d-21b8-4563-84bf-9837aba9c67b None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:49.680698 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529917d-21b8-4563-84bf-9837aba9c67b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:49.684986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:49.696928 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529917d-21b8-4563-84bf-9837aba9c67b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:49.699345 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529917d-21b8-4563-84bf-9837aba9c67b None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:49.719208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde9d0c-c0a3-4524-8dad-907ce8f084bd None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:49.720058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-a529917d-21b8-4563-84bf-9837aba9c67b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:49.720058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:49.720058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:49.720058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:49.720058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:49.720058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:49.720058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:49.720058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:49.720058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:49.720058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:49.720058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:49.720058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:49.720058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:49.720058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:49.720058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:49.720058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:49.721051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:49.721051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:49.721051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:49.721051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:49.721051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:49.721051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:49.721051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:49.721051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:49.721051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:49.721051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:49.721051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:49.721051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:49.721051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:49.721051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:49.721051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:49.721051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:49.721051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:49.722015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:49.722015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:49.722015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:49.722015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 390/825] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:49.722731 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529917d-21b8-4563-84bf-9837aba9c67b None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:49.761446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2439f32-5758-4ce9-908e-f1dec92935a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:49.763199 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2439f32-5758-4ce9-908e-f1dec92935a0 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:49.764151 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2439f32-5758-4ce9-908e-f1dec92935a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:49.764917 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2439f32-5758-4ce9-908e-f1dec92935a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:49.765809 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2439f32-5758-4ce9-908e-f1dec92935a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:49.766375 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2439f32-5758-4ce9-908e-f1dec92935a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:49.768149 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2439f32-5758-4ce9-908e-f1dec92935a0 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:49.781468 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 436/826] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:49.782693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2439f32-5758-4ce9-908e-f1dec92935a0 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:49.861639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529917d-21b8-4563-84bf-9837aba9c67b None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:49.865637 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:49.896906 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2439f32-5758-4ce9-908e-f1dec92935a0 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:49.900082 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c225d-c194-490d-b737-56b895924b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:49.900979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c225d-c194-490d-b737-56b895924b8d None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:49.901489 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c225d-c194-490d-b737-56b895924b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:49.901965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c225d-c194-490d-b737-56b895924b8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:49.902977 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c225d-c194-490d-b737-56b895924b8d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:49.904752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c225d-c194-490d-b737-56b895924b8d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:49.931868 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb20e9f-8249-4770-a84e-ee798f05be0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:49.932548 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb20e9f-8249-4770-a84e-ee798f05be0e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:49.932830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb20e9f-8249-4770-a84e-ee798f05be0e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:49.933105 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb20e9f-8249-4770-a84e-ee798f05be0e None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:49.933737 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb20e9f-8249-4770-a84e-ee798f05be0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:49.934537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb20e9f-8249-4770-a84e-ee798f05be0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:49.939723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb20e9f-8249-4770-a84e-ee798f05be0e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:49.953453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 437/827] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:49.953453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb20e9f-8249-4770-a84e-ee798f05be0e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:50.002575 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 391/828] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:17:49 2022] POST /identity/v3/endpoints => generated 337 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:17:50.004568 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c225d-c194-490d-b737-56b895924b8d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:50.072102 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:50.132954 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb20e9f-8249-4770-a84e-ee798f05be0e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:50.153052 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c225d-c194-490d-b737-56b895924b8d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:50.176066 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:50.181247 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdd831-5c42-41f3-b83b-08543726ccc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:50.181983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdd831-5c42-41f3-b83b-08543726ccc3 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:50.182423 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdd831-5c42-41f3-b83b-08543726ccc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:50.182811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdd831-5c42-41f3-b83b-08543726ccc3 None admin] PATH_INFO: `/v3/projects/ad230723d90a439daf38443915c2282f/users/e70b85e430004a8b865622354c1d1ed4/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:50.185433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdd831-5c42-41f3-b83b-08543726ccc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad230723d90a439daf38443915c2282f, user_id=e70b85e430004a8b865622354c1d1ed4, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:50.186994 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdd831-5c42-41f3-b83b-08543726ccc3 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:50.202337 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a627435-4213-4c7f-8e6b-51290cfc9f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:50.203288 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a627435-4213-4c7f-8e6b-51290cfc9f7b None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:50.203288 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a627435-4213-4c7f-8e6b-51290cfc9f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:50.203569 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a627435-4213-4c7f-8e6b-51290cfc9f7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:50.210715 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a627435-4213-4c7f-8e6b-51290cfc9f7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:50.212159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a627435-4213-4c7f-8e6b-51290cfc9f7b None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:50.308754 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 438/829] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:17:49 2022] PUT /identity/v3/projects/ad230723d90a439daf38443915c2282f/users/e70b85e430004a8b865622354c1d1ed4/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:17:50.311024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a396988-f8ba-4bd7-b5fc-63d0c175bdfe None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:50.311519 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a396988-f8ba-4bd7-b5fc-63d0c175bdfe None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:50.311960 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a396988-f8ba-4bd7-b5fc-63d0c175bdfe None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:50.313764 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 439/830] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:50.319630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91195d66-4829-490c-9b34-fbe11d68f330 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:50.319923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91195d66-4829-490c-9b34-fbe11d68f330 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:50.320197 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91195d66-4829-490c-9b34-fbe11d68f330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:50.340398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-0a627435-4213-4c7f-8e6b-51290cfc9f7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:50.340398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:50.340398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:50.340398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:50.340398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:50.340398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:50.340398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:50.340398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:50.340398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:50.340398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:50.340398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:50.340398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:50.340398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:50.340398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:50.340398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:50.341447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:50.341447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:50.341447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:50.341447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:50.341447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:50.341447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:50.341447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:50.341447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:50.341447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:50.341447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:50.341447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:50.341447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:50.341447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:50.341447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:50.341447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:50.341447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:50.341447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:50.342354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:50.342354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:50.342354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:50.342354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:50.342354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:50.342354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:50.342354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:50.342354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:50.346613 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 392/831] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:50.347555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a627435-4213-4c7f-8e6b-51290cfc9f7b None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:50.359862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-91195d66-4829-490c-9b34-fbe11d68f330 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:50.361209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-91195d66-4829-490c-9b34-fbe11d68f330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:50.439364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 440/832] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:17:50.467664 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:50.470681 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a627435-4213-4c7f-8e6b-51290cfc9f7b None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:50.510429 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7d006-9897-428d-9926-49606f065ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:50.511042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7d006-9897-428d-9926-49606f065ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:50.511317 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7d006-9897-428d-9926-49606f065ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:50.511584 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7d006-9897-428d-9926-49606f065ab8 None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:50.512848 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7d006-9897-428d-9926-49606f065ab8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:50.513151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7d006-9897-428d-9926-49606f065ab8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:50.514576 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7d006-9897-428d-9926-49606f065ab8 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:50.526981 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 393/833] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:50.533402 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91195d66-4829-490c-9b34-fbe11d68f330 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:50.633634 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91195d66-4829-490c-9b34-fbe11d68f330 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:50.657372 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:50.669058 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e295e1-0589-40ba-af9e-5be9b4cf02d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:50.670216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e295e1-0589-40ba-af9e-5be9b4cf02d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:50.670665 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e295e1-0589-40ba-af9e-5be9b4cf02d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:50.671117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e295e1-0589-40ba-af9e-5be9b4cf02d0 None admin] PATH_INFO: `/v3/projects/ad230723d90a439daf38443915c2282f/users/0c8d0a718e8347b5af397f866056266e/roles/2696068001744b38a289a59c56f56a95` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:50.687409 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e295e1-0589-40ba-af9e-5be9b4cf02d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad230723d90a439daf38443915c2282f, user_id=0c8d0a718e8347b5af397f866056266e, role_id=2696068001744b38a289a59c56f56a95)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:50.692513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e295e1-0589-40ba-af9e-5be9b4cf02d0 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:50.729618 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7d006-9897-428d-9926-49606f065ab8 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:50.764884 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 441/834] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:17:50 2022] PUT /identity/v3/projects/ad230723d90a439daf38443915c2282f/users/0c8d0a718e8347b5af397f866056266e/roles/2696068001744b38a289a59c56f56a95 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:17:50.863442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7d006-9897-428d-9926-49606f065ab8 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:50.903177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902a292-8b13-445d-9422-9f1270100137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:50.904161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902a292-8b13-445d-9422-9f1270100137 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:50.904673 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902a292-8b13-445d-9422-9f1270100137 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:50.905168 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902a292-8b13-445d-9422-9f1270100137 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:50.905956 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902a292-8b13-445d-9422-9f1270100137 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:50.907616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902a292-8b13-445d-9422-9f1270100137 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:50.918878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-6902a292-8b13-445d-9422-9f1270100137 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 16:17:50.918878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:50.918878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:17:50.918878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:17:50.918878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:17:50.918878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:17:50.918878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:17:50.918878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:50.918878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 16:17:50.918878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:50.918878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:17:50.918878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:50.918878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:50.918878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:50.918878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:50.918878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:50.920202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:50.920202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:50.920202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:50.920202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:50.920202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:50.920202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:50.920202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:50.920202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:17:50.920202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:17:50.920202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:17:50.920202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:17:50.920202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:50.920202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:50.920202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:50.920202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:50.920202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:50.920202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:50.921139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:50.921139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:50.921139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:50.921139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:50.921139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:50.921139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:50.921139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:50.921139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:50.921139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:50.921139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:50.921139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:17:50.921139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:50.921139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 16:17:50.921139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:50.924258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 394/835] 10.222.0.26 () {56 vars in 1132 bytes} [Tue Sep 27 16:17:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:50.933586 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e295e1-0589-40ba-af9e-5be9b4cf02d0 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:51.058336 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e295e1-0589-40ba-af9e-5be9b4cf02d0 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:51.094658 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491d14a-2a29-4c1a-a0f9-6688ff86ed12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:51.095701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491d14a-2a29-4c1a-a0f9-6688ff86ed12 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:51.096229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491d14a-2a29-4c1a-a0f9-6688ff86ed12 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:51.096730 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491d14a-2a29-4c1a-a0f9-6688ff86ed12 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:51.097553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491d14a-2a29-4c1a-a0f9-6688ff86ed12 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:51.098057 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491d14a-2a29-4c1a-a0f9-6688ff86ed12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:51.099617 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491d14a-2a29-4c1a-a0f9-6688ff86ed12 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:51.105069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 442/836] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 27 16:17:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:51.116389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902a292-8b13-445d-9422-9f1270100137 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:51.116580 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb15d8-ff55-43ff-b9b5-ef2cf26c469d None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:51.116580 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb15d8-ff55-43ff-b9b5-ef2cf26c469d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:51.116766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb15d8-ff55-43ff-b9b5-ef2cf26c469d None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:51.118240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 443/837] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:51.123742 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f62232-05b5-4e54-98ec-43f56fb1bbb7 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:51.124034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f62232-05b5-4e54-98ec-43f56fb1bbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:51.124312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f62232-05b5-4e54-98ec-43f56fb1bbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:51.139994 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:51.143227 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-07f62232-05b5-4e54-98ec-43f56fb1bbb7 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:51.144459 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-07f62232-05b5-4e54-98ec-43f56fb1bbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:51.175414 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:51.216526 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 444/838] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:17:51.232748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902a292-8b13-445d-9422-9f1270100137 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:51.269097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170130e-7181-4162-ad96-c32b945d2b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:51.270071 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170130e-7181-4162-ad96-c32b945d2b2d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:51.270553 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170130e-7181-4162-ad96-c32b945d2b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:51.271021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170130e-7181-4162-ad96-c32b945d2b2d None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:51.271841 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170130e-7181-4162-ad96-c32b945d2b2d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:51.272384 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170130e-7181-4162-ad96-c32b945d2b2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:51.273967 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170130e-7181-4162-ad96-c32b945d2b2d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:51.279271 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 395/839] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 27 16:17:51 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:51.493227 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f62232-05b5-4e54-98ec-43f56fb1bbb7 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:51.598362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f62232-05b5-4e54-98ec-43f56fb1bbb7 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:51.638134 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19c8f6-39bb-48b1-9b78-d4017637faf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:51.638766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19c8f6-39bb-48b1-9b78-d4017637faf2 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:51.639042 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19c8f6-39bb-48b1-9b78-d4017637faf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:51.639312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19c8f6-39bb-48b1-9b78-d4017637faf2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:51.639889 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19c8f6-39bb-48b1-9b78-d4017637faf2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:51.641292 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19c8f6-39bb-48b1-9b78-d4017637faf2 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:51.650392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-ec19c8f6-39bb-48b1-9b78-d4017637faf2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 16:17:51.650392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:51.650392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:17:51.650392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:17:51.650392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:17:51.650392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:17:51.650392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:17:51.650392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:51.650392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 16:17:51.650392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:51.650392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:17:51.650392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:51.650392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:51.650392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:51.650392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:51.650392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:51.650392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:51.651398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:51.651398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:51.651398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:51.651398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:51.651398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:51.651398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:51.651398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:17:51.651398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:17:51.651398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:17:51.651398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:17:51.651398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:51.651398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:51.651398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:51.651398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:51.651398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:51.651398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:51.652252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:51.652252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:51.652252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:51.652252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:51.652252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:51.652252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:51.652252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:51.652252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:51.652252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:51.652252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:51.652252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:17:51.652252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:51.652252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 16:17:51.652252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:51.652252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 445/840] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:17:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:51.660228 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170130e-7181-4162-ad96-c32b945d2b2d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:51.755676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:51.769683 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170130e-7181-4162-ad96-c32b945d2b2d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:51.806529 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93962dec-5cf9-4bbd-a95a-02b73cec0f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:51.807150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93962dec-5cf9-4bbd-a95a-02b73cec0f3d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:51.807429 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93962dec-5cf9-4bbd-a95a-02b73cec0f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:51.807703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93962dec-5cf9-4bbd-a95a-02b73cec0f3d None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:51.808328 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93962dec-5cf9-4bbd-a95a-02b73cec0f3d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:51.808653 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93962dec-5cf9-4bbd-a95a-02b73cec0f3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:51.810588 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93962dec-5cf9-4bbd-a95a-02b73cec0f3d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:51.815439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 396/841] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:17:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:51.821013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19c8f6-39bb-48b1-9b78-d4017637faf2 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:51.851748 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:51.925942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19c8f6-39bb-48b1-9b78-d4017637faf2 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:51.959421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a110c-1a0a-4fcf-b090-ca74aa8a9c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:51.960108 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a110c-1a0a-4fcf-b090-ca74aa8a9c17 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:51.960347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a110c-1a0a-4fcf-b090-ca74aa8a9c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:51.960578 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a110c-1a0a-4fcf-b090-ca74aa8a9c17 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:51.961196 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a110c-1a0a-4fcf-b090-ca74aa8a9c17 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:51.961500 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a110c-1a0a-4fcf-b090-ca74aa8a9c17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:51.962859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a110c-1a0a-4fcf-b090-ca74aa8a9c17 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:51.967848 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 446/842] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:17:51 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:52.628838 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb3cb9-6dda-47e6-911f-52f056f256c3 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:52.629358 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb3cb9-6dda-47e6-911f-52f056f256c3 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:52.629436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb3cb9-6dda-47e6-911f-52f056f256c3 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:52.630860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 397/843] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:52.636327 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5856c6-192c-4b09-9f8d-6034fe05ae9b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:52.636641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5856c6-192c-4b09-9f8d-6034fe05ae9b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:52.636923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5856c6-192c-4b09-9f8d-6034fe05ae9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:52.655266 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-cc5856c6-192c-4b09-9f8d-6034fe05ae9b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:52.656479 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-cc5856c6-192c-4b09-9f8d-6034fe05ae9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:52.724678 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 447/844] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:17:52.991255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb3cb9-6dda-47e6-911f-52f056f256c3 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:53.065001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc610ce-ad96-47b7-b204-4fcd02a001c6 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:53.065514 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc610ce-ad96-47b7-b204-4fcd02a001c6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:53.065625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc610ce-ad96-47b7-b204-4fcd02a001c6 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:53.067152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 448/845] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:17:53.072152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e952c-23f6-4767-8bbb-48a2c303b113 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:53.072480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e952c-23f6-4767-8bbb-48a2c303b113 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:53.072781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e952c-23f6-4767-8bbb-48a2c303b113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:53.093375 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-359e952c-23f6-4767-8bbb-48a2c303b113 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:53.094562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-359e952c-23f6-4767-8bbb-48a2c303b113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:53.099935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb3cb9-6dda-47e6-911f-52f056f256c3 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:53.113462 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:53.143131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe89170-1334-4285-a0a8-d56efd9f5faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:53.143763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe89170-1334-4285-a0a8-d56efd9f5faa None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:53.144043 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe89170-1334-4285-a0a8-d56efd9f5faa None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:53.144314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe89170-1334-4285-a0a8-d56efd9f5faa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:53.156189 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe89170-1334-4285-a0a8-d56efd9f5faa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:53.162063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-2fe89170-1334-4285-a0a8-d56efd9f5faa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:17:53.162063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:53.162063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:53.162063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:53.162063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:53.162063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:53.162063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:53.162063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:53.162063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:53.162063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:53.162063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:53.162063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:53.162063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:53.162063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:53.162063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:53.162063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:53.163005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:53.163005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:53.163005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:53.163005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:53.163005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:53.163005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:53.163005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:53.163005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:53.163005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:53.163005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:53.163005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:53.163005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:53.163005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:53.163005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:53.163005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:53.163005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:53.163871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:53.163871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:53.163871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:53.163871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:53.163871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:53.163871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:53.163871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:53.163871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:53.163871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:53.163871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:53.163871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:17:53.163871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:53.163871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 398/846] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:17:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:53.172143 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe89170-1334-4285-a0a8-d56efd9f5faa None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:53.189271 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 449/847] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:17:53.190563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:53.274873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe89170-1334-4285-a0a8-d56efd9f5faa None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:53.309765 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02528c0-3250-4363-8676-54575f1e5b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:53.310717 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02528c0-3250-4363-8676-54575f1e5b0e None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:53.311194 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02528c0-3250-4363-8676-54575f1e5b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:53.311664 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02528c0-3250-4363-8676-54575f1e5b0e None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:53.312542 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02528c0-3250-4363-8676-54575f1e5b0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:53.313061 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02528c0-3250-4363-8676-54575f1e5b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:53.314626 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02528c0-3250-4363-8676-54575f1e5b0e None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:53.323402 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 399/848] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:17:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:53.329914 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e952c-23f6-4767-8bbb-48a2c303b113 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:53.436009 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e952c-23f6-4767-8bbb-48a2c303b113 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:53.471837 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dd831-dc93-4e99-a66c-49bc1e72d903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:53.472803 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dd831-dc93-4e99-a66c-49bc1e72d903 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:53.473258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dd831-dc93-4e99-a66c-49bc1e72d903 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:53.473703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dd831-dc93-4e99-a66c-49bc1e72d903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:53.487967 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5dd831-dc93-4e99-a66c-49bc1e72d903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:53.489453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5dd831-dc93-4e99-a66c-49bc1e72d903 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:53.501227 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02528c0-3250-4363-8676-54575f1e5b0e None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:53.508887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-5d5dd831-dc93-4e99-a66c-49bc1e72d903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:53.508887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:53.508887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:53.508887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:53.508887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:53.508887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:53.508887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:53.508887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:53.508887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:53.508887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:53.508887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:53.508887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:53.508887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:53.508887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:53.508887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:53.508887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:53.509881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:53.509881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:53.509881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:53.509881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:53.509881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:53.509881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:53.509881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:53.509881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:53.509881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:53.509881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:53.509881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:53.509881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:53.509881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:53.509881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:53.509881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:53.509881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:53.509881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:53.510804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:53.510804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:53.510804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:53.514002 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 450/849] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:53.517235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dd831-dc93-4e99-a66c-49bc1e72d903 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:53.527024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:53.580479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:53.605742 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02528c0-3250-4363-8676-54575f1e5b0e None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:53.627466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dd831-dc93-4e99-a66c-49bc1e72d903 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:53.641143 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4feb9e1-bb42-4383-9670-9e760b76ca30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:53.641779 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4feb9e1-bb42-4383-9670-9e760b76ca30 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:53.642059 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4feb9e1-bb42-4383-9670-9e760b76ca30 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:53.642331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4feb9e1-bb42-4383-9670-9e760b76ca30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:53.653428 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4feb9e1-bb42-4383-9670-9e760b76ca30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:53.658625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-d4feb9e1-bb42-4383-9670-9e760b76ca30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:53.658625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:53.658625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:53.658625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:53.658625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:53.658625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:53.658625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:53.658625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:53.658625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:53.658625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:53.658625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:53.658625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:53.658625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:53.658625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:53.658625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:53.658625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:53.659563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:53.659563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:53.659563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:53.659563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:53.659563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:53.659563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:53.659563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:53.659563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:53.659563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:53.659563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:53.659563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:53.659563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:53.659563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:53.659563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:53.659563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:53.659563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:53.660965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:53.660965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:53.660965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:53.660965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:53.660965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:53.660965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:53.660965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:53.660965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:53.660965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:53.660965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:53.660965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:17:53.660965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:53.660965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 400/850] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:17:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:53.660965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989e7d4-3092-41ec-9cb1-58b76a9abbc4 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:53.661733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989e7d4-3092-41ec-9cb1-58b76a9abbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:53.661733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989e7d4-3092-41ec-9cb1-58b76a9abbc4 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:53.662776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 401/851] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:53.667473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989e7d4-3092-41ec-9cb1-58b76a9abbc4 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:53.669080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aebf80-8ff8-4674-be8a-17f6df18c12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:53.669958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aebf80-8ff8-4674-be8a-17f6df18c12a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:53.670236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aebf80-8ff8-4674-be8a-17f6df18c12a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:53.670503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aebf80-8ff8-4674-be8a-17f6df18c12a None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:53.671144 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aebf80-8ff8-4674-be8a-17f6df18c12a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:53.671443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aebf80-8ff8-4674-be8a-17f6df18c12a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:53.672835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aebf80-8ff8-4674-be8a-17f6df18c12a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:53.689531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 451/852] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:53.689531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44591ce-dd31-49a6-9d5a-67fb89dbca67 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:53.689531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44591ce-dd31-49a6-9d5a-67fb89dbca67 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:53.689531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44591ce-dd31-49a6-9d5a-67fb89dbca67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:53.704693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a44591ce-dd31-49a6-9d5a-67fb89dbca67 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:53.705934 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a44591ce-dd31-49a6-9d5a-67fb89dbca67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:53.773425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:53.777656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989e7d4-3092-41ec-9cb1-58b76a9abbc4 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:53.789306 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 452/853] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:17:53.789306 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44591ce-dd31-49a6-9d5a-67fb89dbca67 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:53.830844 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525f95e-0ecb-4fa9-93c0-f9e017ec2a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:53.832030 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525f95e-0ecb-4fa9-93c0-f9e017ec2a62 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:53.832319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525f95e-0ecb-4fa9-93c0-f9e017ec2a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:53.832630 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525f95e-0ecb-4fa9-93c0-f9e017ec2a62 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:53.833308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525f95e-0ecb-4fa9-93c0-f9e017ec2a62 None admin] RBAC: Adding query filter params (name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:53.833615 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525f95e-0ecb-4fa9-93c0-f9e017ec2a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:53.835869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525f95e-0ecb-4fa9-93c0-f9e017ec2a62 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:53.837638 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:53.849587 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 402/854] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:17:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:53.855770 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525f95e-0ecb-4fa9-93c0-f9e017ec2a62 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:53.906208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44591ce-dd31-49a6-9d5a-67fb89dbca67 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:53.942777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092ca87-ec27-4e65-9e11-f4ae9849d69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:53.943523 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092ca87-ec27-4e65-9e11-f4ae9849d69f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:53.943805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092ca87-ec27-4e65-9e11-f4ae9849d69f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:53.944189 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092ca87-ec27-4e65-9e11-f4ae9849d69f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:53.953596 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092ca87-ec27-4e65-9e11-f4ae9849d69f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:53.955601 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092ca87-ec27-4e65-9e11-f4ae9849d69f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:53.971014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-4092ca87-ec27-4e65-9e11-f4ae9849d69f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 16:17:53.971014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:53.971014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:53.971014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:53.971014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:53.971014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:53.971014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:53.971014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:53.971014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:53.971014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:53.971014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:53.971014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:53.971014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:53.971014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:53.971014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:53.971014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:53.971998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:53.971998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:53.971998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:53.971998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:53.971998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:53.971998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:53.971998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:53.971998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:53.971998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:53.971998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:53.971998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:53.971998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:53.971998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:53.971998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:53.971998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:53.971998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:53.971998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:53.971998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:53.973010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:53.973010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:53.973010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:53.973010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:53.973010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:53.973010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:53.973010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:53.973010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:53.973010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 27 16:17:53.973010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:53.973010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 453/855] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:17:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:53.979567 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092ca87-ec27-4e65-9e11-f4ae9849d69f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:53.986045 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525f95e-0ecb-4fa9-93c0-f9e017ec2a62 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:54.021087 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da5bae-3989-408e-b7ca-5bec83ed7c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:54.021728 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da5bae-3989-408e-b7ca-5bec83ed7c16 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:54.022011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da5bae-3989-408e-b7ca-5bec83ed7c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:54.022288 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da5bae-3989-408e-b7ca-5bec83ed7c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:54.033613 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da5bae-3989-408e-b7ca-5bec83ed7c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:54.035052 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da5bae-3989-408e-b7ca-5bec83ed7c16 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:54.049212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:54.051353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-e2da5bae-3989-408e-b7ca-5bec83ed7c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:54.051353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:54.051353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:54.051353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:54.051353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:54.051353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:54.051353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:54.051353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:54.051353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:54.051353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:54.051353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:54.051353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:54.051353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:54.051353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:54.051353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:54.051353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:54.052293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:54.052293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:54.052293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:54.052293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:54.052293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:54.052293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:54.052293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:54.052293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:54.052293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:54.052293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:54.052293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:54.052293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:54.052293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:54.052293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:54.052293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:54.052293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:54.052293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:54.053215 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:54.053215 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:54.053215 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:54.053215 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 403/856] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:54.065389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da5bae-3989-408e-b7ca-5bec83ed7c16 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:54.102219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092ca87-ec27-4e65-9e11-f4ae9849d69f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:54.125808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:54.140239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a38c67-3e36-4e3a-b360-5072e2820d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:54.140875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a38c67-3e36-4e3a-b360-5072e2820d7c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:54.141156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a38c67-3e36-4e3a-b360-5072e2820d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:54.141431 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a38c67-3e36-4e3a-b360-5072e2820d7c None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:54.142155 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a38c67-3e36-4e3a-b360-5072e2820d7c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:54.142511 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a38c67-3e36-4e3a-b360-5072e2820d7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:54.143989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a38c67-3e36-4e3a-b360-5072e2820d7c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:54.167764 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 454/857] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Sep 27 16:17:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:54.167764 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a38c67-3e36-4e3a-b360-5072e2820d7c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:54.181634 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da5bae-3989-408e-b7ca-5bec83ed7c16 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:54.217865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f8cd6-4c0f-447a-b87d-e7d11559033b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:54.218474 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f8cd6-4c0f-447a-b87d-e7d11559033b None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:54.218752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f8cd6-4c0f-447a-b87d-e7d11559033b None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:54.219027 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f8cd6-4c0f-447a-b87d-e7d11559033b None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:54.219659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f8cd6-4c0f-447a-b87d-e7d11559033b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:54.219960 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f8cd6-4c0f-447a-b87d-e7d11559033b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:54.221363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f8cd6-4c0f-447a-b87d-e7d11559033b None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:54.233002 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 404/858] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:54.233863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f8cd6-4c0f-447a-b87d-e7d11559033b None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:54.265512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a38c67-3e36-4e3a-b360-5072e2820d7c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:54.279803 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:54.299700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382fae0-cb38-4d60-9055-352d1db66205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:54.300349 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382fae0-cb38-4d60-9055-352d1db66205 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:54.300680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382fae0-cb38-4d60-9055-352d1db66205 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:54.300962 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382fae0-cb38-4d60-9055-352d1db66205 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:54.301607 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382fae0-cb38-4d60-9055-352d1db66205 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:54.302951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382fae0-cb38-4d60-9055-352d1db66205 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:54.332355 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f8cd6-4c0f-447a-b87d-e7d11559033b None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:54.341313 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:54.364394 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a187dfe-e7e4-4032-8a70-bfd13faa4768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:54.364992 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a187dfe-e7e4-4032-8a70-bfd13faa4768 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:54.365269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a187dfe-e7e4-4032-8a70-bfd13faa4768 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:54.365542 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a187dfe-e7e4-4032-8a70-bfd13faa4768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:54.392215 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 455/859] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 27 16:17:54 2022] POST /identity/v3/services => generated 269 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:17:54.393496 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69ed28-23c8-4b68-8809-045a02f79bf8 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:54.393780 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69ed28-23c8-4b68-8809-045a02f79bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:54.403430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69ed28-23c8-4b68-8809-045a02f79bf8 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:54.403430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 456/860] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:54.403430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69ed28-23c8-4b68-8809-045a02f79bf8 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:54.440382 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a187dfe-e7e4-4032-8a70-bfd13faa4768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:54.441860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a187dfe-e7e4-4032-8a70-bfd13faa4768 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:54.529350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69ed28-23c8-4b68-8809-045a02f79bf8 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:54.557833 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 405/861] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:54 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 16:17:54.559865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a294470-3a46-4a3f-9e22-556f4e02e6d1 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:54.560148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a294470-3a46-4a3f-9e22-556f4e02e6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:54.560442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a294470-3a46-4a3f-9e22-556f4e02e6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:54.573385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17ac09-8f14-418d-8660-e426efaf9fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:54.573703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17ac09-8f14-418d-8660-e426efaf9fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:54.573979 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17ac09-8f14-418d-8660-e426efaf9fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:54.574251 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17ac09-8f14-418d-8660-e426efaf9fc8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:54.580880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-4a294470-3a46-4a3f-9e22-556f4e02e6d1 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:54.582206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4a294470-3a46-4a3f-9e22-556f4e02e6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:54.582773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17ac09-8f14-418d-8660-e426efaf9fc8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:54.584245 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17ac09-8f14-418d-8660-e426efaf9fc8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:54.584386 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:54.597339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-dc17ac09-8f14-418d-8660-e426efaf9fc8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 16:17:54.597339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:54.597339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:54.597339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:54.597339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:54.597339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:54.597339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:54.597339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:54.597339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:54.597339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:54.597339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:54.597339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:54.597339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:54.597339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:54.597339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:54.597339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:54.599025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:54.599025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:54.599025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:54.599025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:54.599025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:54.599025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:54.599025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:54.599025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:54.599025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:54.599025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:54.599025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:54.599025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:54.599025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:54.599025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:54.599025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:54.599025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:54.599025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:54.599025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:54.600157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:54.600157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:54.600157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:54.600157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:54.600157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:54.600157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:54.600157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:54.600157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:54.600157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 16:17:54.600157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:54.603388 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 457/862] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 27 16:17:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:54.604269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17ac09-8f14-418d-8660-e426efaf9fc8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:54.636369 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:54.655433 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 406/863] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:54 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:17:54.656849 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a294470-3a46-4a3f-9e22-556f4e02e6d1 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:54.724763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17ac09-8f14-418d-8660-e426efaf9fc8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:54.765934 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95f2b0-abb3-4100-b896-2c31d2516770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:54.766559 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95f2b0-abb3-4100-b896-2c31d2516770 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:54.766834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95f2b0-abb3-4100-b896-2c31d2516770 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:54.767104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95f2b0-abb3-4100-b896-2c31d2516770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:54.780580 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95f2b0-abb3-4100-b896-2c31d2516770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:54.782081 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95f2b0-abb3-4100-b896-2c31d2516770 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:54.785737 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a294470-3a46-4a3f-9e22-556f4e02e6d1 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:54.801852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-cb95f2b0-abb3-4100-b896-2c31d2516770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:54.801852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:54.801852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:54.801852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:54.801852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:54.801852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:54.801852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:54.801852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:54.801852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:54.801852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:54.801852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:54.801852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:54.801852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:54.801852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:54.801852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:54.801852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:54.802761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:54.802761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:54.802761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:54.802761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:54.802761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:54.802761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:54.802761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:54.802761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:54.802761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:54.802761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:54.802761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:54.802761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:54.802761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:54.802761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:54.802761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:54.802761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:54.802761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:54.803739 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:54.803739 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:54.803739 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:54.803739 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 458/864] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:54.808121 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95f2b0-abb3-4100-b896-2c31d2516770 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:54.829592 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897ccba-e8c3-4c73-a701-52cc48de0142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:54.830547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897ccba-e8c3-4c73-a701-52cc48de0142 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:54.831021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897ccba-e8c3-4c73-a701-52cc48de0142 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:54.831504 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897ccba-e8c3-4c73-a701-52cc48de0142 None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:54.832447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897ccba-e8c3-4c73-a701-52cc48de0142 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:54.832950 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897ccba-e8c3-4c73-a701-52cc48de0142 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:54.834718 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897ccba-e8c3-4c73-a701-52cc48de0142 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:54.842897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:54.853981 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 407/865] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Sep 27 16:17:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:54.864388 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897ccba-e8c3-4c73-a701-52cc48de0142 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:54.911441 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:54.935706 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95f2b0-abb3-4100-b896-2c31d2516770 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:54.970863 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3754e-985b-40f9-9463-b0bed60c512a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:54.971466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3754e-985b-40f9-9463-b0bed60c512a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:54.971744 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3754e-985b-40f9-9463-b0bed60c512a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:54.972019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3754e-985b-40f9-9463-b0bed60c512a None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:54.972684 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3754e-985b-40f9-9463-b0bed60c512a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:54.972991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3754e-985b-40f9-9463-b0bed60c512a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:54.974355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3754e-985b-40f9-9463-b0bed60c512a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:54.977088 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897ccba-e8c3-4c73-a701-52cc48de0142 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:54.986467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 459/866] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:54.987261 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3754e-985b-40f9-9463-b0bed60c512a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:55.017183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acba4e-65b4-4b53-9032-e20e104a748c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:55.018013 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acba4e-65b4-4b53-9032-e20e104a748c None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:55.018443 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acba4e-65b4-4b53-9032-e20e104a748c None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:55.018916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acba4e-65b4-4b53-9032-e20e104a748c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:55.081050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:55.087384 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acba4e-65b4-4b53-9032-e20e104a748c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:55.088870 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acba4e-65b4-4b53-9032-e20e104a748c None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:55.093019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3754e-985b-40f9-9463-b0bed60c512a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:55.129979 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c2f9e-65e5-41b9-a38c-3b2eb1b3b500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:55.130979 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c2f9e-65e5-41b9-a38c-3b2eb1b3b500 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:55.130979 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c2f9e-65e5-41b9-a38c-3b2eb1b3b500 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:55.131185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c2f9e-65e5-41b9-a38c-3b2eb1b3b500 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:55.131792 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c2f9e-65e5-41b9-a38c-3b2eb1b3b500 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:55.133258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c2f9e-65e5-41b9-a38c-3b2eb1b3b500 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:55.193708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 408/867] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:17:54 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 27 16:17:55.194558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acba4e-65b4-4b53-9032-e20e104a748c None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:55.211785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 460/868] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 27 16:17:54 2022] POST /identity/v3/services => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:17:55.213596 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c2f9e-65e5-41b9-a38c-3b2eb1b3b500 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:55.222662 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:55.330819 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:55.338009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acba4e-65b4-4b53-9032-e20e104a748c None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:55.376020 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c2f9e-65e5-41b9-a38c-3b2eb1b3b500 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:55.378621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db9698-437f-4989-9d4f-798a0fb0abfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:55.379734 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db9698-437f-4989-9d4f-798a0fb0abfa None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:55.380226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db9698-437f-4989-9d4f-798a0fb0abfa None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:55.380745 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db9698-437f-4989-9d4f-798a0fb0abfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:55.388850 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db9698-437f-4989-9d4f-798a0fb0abfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:55.390591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db9698-437f-4989-9d4f-798a0fb0abfa None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:55.404014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-70db9698-437f-4989-9d4f-798a0fb0abfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:55.404014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:55.404014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:55.404014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:55.404014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:55.404014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:55.404014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:55.404014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:55.404014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:55.404014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:55.404014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:55.404014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:55.404014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:55.404014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:55.404014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:55.404965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:55.404965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:55.404965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:55.404965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:55.404965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:55.404965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:55.404965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:55.404965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:55.404965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:55.404965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:55.404965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:55.404965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:55.404965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:55.404965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:55.404965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:55.404965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:55.404965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:55.405885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:55.405885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:55.405885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:55.405885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:55.405885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:55.405885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:55.405885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:55.405885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:55.408278 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 409/869] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:55.414640 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db9698-437f-4989-9d4f-798a0fb0abfa None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:55.415696 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d31cc6-2266-4a8f-b688-89a5f4129e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:55.416359 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d31cc6-2266-4a8f-b688-89a5f4129e10 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:55.416638 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d31cc6-2266-4a8f-b688-89a5f4129e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:55.416915 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d31cc6-2266-4a8f-b688-89a5f4129e10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:55.429504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d31cc6-2266-4a8f-b688-89a5f4129e10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:55.431104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d31cc6-2266-4a8f-b688-89a5f4129e10 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:55.451681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-d4d31cc6-2266-4a8f-b688-89a5f4129e10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:55.451681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:55.451681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:55.451681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:55.451681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:55.451681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:55.451681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:55.451681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:55.451681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:55.451681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:55.451681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:55.451681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:55.451681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:55.451681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:55.451681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:55.451681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:55.452894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:55.452894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:55.452894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:55.452894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:55.452894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:55.452894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:55.452894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:55.452894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:55.452894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:55.452894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:55.452894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:55.452894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:55.452894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:55.452894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:55.452894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:55.452894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:55.452894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:55.453990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:55.453990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:55.453990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:55.454192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 461/870] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:55.459533 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d31cc6-2266-4a8f-b688-89a5f4129e10 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:55.520065 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:55.534363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db9698-437f-4989-9d4f-798a0fb0abfa None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:55.571829 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886cadd-dc0f-4fb7-9a18-ba40ceb99bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:55.572714 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886cadd-dc0f-4fb7-9a18-ba40ceb99bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:55.573155 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886cadd-dc0f-4fb7-9a18-ba40ceb99bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:55.573431 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886cadd-dc0f-4fb7-9a18-ba40ceb99bc5 None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:55.574119 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886cadd-dc0f-4fb7-9a18-ba40ceb99bc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:55.574422 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886cadd-dc0f-4fb7-9a18-ba40ceb99bc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:55.577715 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886cadd-dc0f-4fb7-9a18-ba40ceb99bc5 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:55.584029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d31cc6-2266-4a8f-b688-89a5f4129e10 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:55.593901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 410/871] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:55.601454 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886cadd-dc0f-4fb7-9a18-ba40ceb99bc5 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:55.619473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:55.623453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd4ad8-9f72-41c3-9fbc-13d9f6b7f573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:55.624358 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd4ad8-9f72-41c3-9fbc-13d9f6b7f573 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:55.624788 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd4ad8-9f72-41c3-9fbc-13d9f6b7f573 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:55.625236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd4ad8-9f72-41c3-9fbc-13d9f6b7f573 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:55.626118 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd4ad8-9f72-41c3-9fbc-13d9f6b7f573 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:55.626596 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd4ad8-9f72-41c3-9fbc-13d9f6b7f573 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:55.627971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd4ad8-9f72-41c3-9fbc-13d9f6b7f573 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:55.645568 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 462/872] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:55.646954 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd4ad8-9f72-41c3-9fbc-13d9f6b7f573 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:55.734002 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886cadd-dc0f-4fb7-9a18-ba40ceb99bc5 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:55.767858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd4ad8-9f72-41c3-9fbc-13d9f6b7f573 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:55.777988 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada7274-447d-429c-b8f9-b8a6fdc75643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:55.778684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada7274-447d-429c-b8f9-b8a6fdc75643 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:55.779035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada7274-447d-429c-b8f9-b8a6fdc75643 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:55.779380 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada7274-447d-429c-b8f9-b8a6fdc75643 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:55.786543 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada7274-447d-429c-b8f9-b8a6fdc75643 None admin] RBAC: Adding query filter params (role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=e70b85e430004a8b865622354c1d1ed4) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:55.786543 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada7274-447d-429c-b8f9-b8a6fdc75643 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:55.786789 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:55.786885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada7274-447d-429c-b8f9-b8a6fdc75643 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:55.798327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 411/873] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:17:55 2022] GET /identity/v3/role_assignments?user.id=e70b85e430004a8b865622354c1d1ed4&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:55.821870 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfa76f-58c7-431c-9f8c-69ff678e1f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:55.822553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfa76f-58c7-431c-9f8c-69ff678e1f7f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:55.822833 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfa76f-58c7-431c-9f8c-69ff678e1f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:55.823103 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfa76f-58c7-431c-9f8c-69ff678e1f7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:55.831228 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfa76f-58c7-431c-9f8c-69ff678e1f7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:55.832818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfa76f-58c7-431c-9f8c-69ff678e1f7f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:55.847298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-f1cfa76f-58c7-431c-9f8c-69ff678e1f7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:55.847298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:55.847298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:55.847298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:55.847298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:55.847298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:55.847298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:55.847298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:55.847298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:55.847298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:55.847298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:55.847298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:55.847298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:17:55.847298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:17:55.847298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:17:55.848256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:17:55.848256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:55.848256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:55.848256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:55.848256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:55.848256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:55.848256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:55.848256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:55.848256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:55.848256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:55.848256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:55.848256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:55.848256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:55.848256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:55.848256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:55.848256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:55.848256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:55.849308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:17:55.849308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:17:55.849308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:17:55.849308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:17:55.849308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:17:55.849308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:17:55.849308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:17:55.849308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:55.849308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 463/874] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:17:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:55.854254 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada7274-447d-429c-b8f9-b8a6fdc75643 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:55.946653 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:55.967979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada7274-447d-429c-b8f9-b8a6fdc75643 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:56.003962 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ae474-64c5-4bf7-b12c-6ee00ea1ef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:56.004593 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ae474-64c5-4bf7-b12c-6ee00ea1ef6e None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:56.004870 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ae474-64c5-4bf7-b12c-6ee00ea1ef6e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:56.005137 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ae474-64c5-4bf7-b12c-6ee00ea1ef6e None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:56.005820 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ae474-64c5-4bf7-b12c-6ee00ea1ef6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:56.006120 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ae474-64c5-4bf7-b12c-6ee00ea1ef6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:56.007536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ae474-64c5-4bf7-b12c-6ee00ea1ef6e None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:56.019982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 412/875] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:17:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:56.026277 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfa76f-58c7-431c-9f8c-69ff678e1f7f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:56.135065 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfa76f-58c7-431c-9f8c-69ff678e1f7f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:56.171375 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680ffaf-8fb2-45eb-ac72-495a0ec048da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:56.172310 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680ffaf-8fb2-45eb-ac72-495a0ec048da None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:56.172805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680ffaf-8fb2-45eb-ac72-495a0ec048da None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:56.173273 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680ffaf-8fb2-45eb-ac72-495a0ec048da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:56.174178 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680ffaf-8fb2-45eb-ac72-495a0ec048da None admin] RBAC: Adding query filter params (role.id=2696068001744b38a289a59c56f56a95, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=0c8d0a718e8347b5af397f866056266e) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:56.174669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680ffaf-8fb2-45eb-ac72-495a0ec048da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:56.176269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680ffaf-8fb2-45eb-ac72-495a0ec048da None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:56.182960 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 464/876] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:17:56 2022] GET /identity/v3/role_assignments?user.id=0c8d0a718e8347b5af397f866056266e&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=2696068001744b38a289a59c56f56a95 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:56.671155 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb2840-6499-495c-a2d0-8d804ea038b8 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:56.671472 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb2840-6499-495c-a2d0-8d804ea038b8 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:56.671718 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb2840-6499-495c-a2d0-8d804ea038b8 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:56.673343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 413/877] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:56.678568 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe9df5-6e9f-49e5-848d-13ba5fd6d33a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:56.678853 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe9df5-6e9f-49e5-848d-13ba5fd6d33a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:56.679125 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe9df5-6e9f-49e5-848d-13ba5fd6d33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:56.697571 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-60fe9df5-6e9f-49e5-848d-13ba5fd6d33a None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:56.698737 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-60fe9df5-6e9f-49e5-848d-13ba5fd6d33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:56.726522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:56.769723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 465/878] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:56 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:17:57.042570 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb2840-6499-495c-a2d0-8d804ea038b8 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:57.146636 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb2840-6499-495c-a2d0-8d804ea038b8 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:57.185679 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b6be2-1543-4a9c-8478-652cad082433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:57.186733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b6be2-1543-4a9c-8478-652cad082433 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:57.187226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b6be2-1543-4a9c-8478-652cad082433 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:57.187712 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b6be2-1543-4a9c-8478-652cad082433 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:57.188534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b6be2-1543-4a9c-8478-652cad082433 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:57.190115 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b6be2-1543-4a9c-8478-652cad082433 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:57.199409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-779b6be2-1543-4a9c-8478-652cad082433 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 16:17:57.199409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:57.199409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:17:57.199409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:17:57.199409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:17:57.199409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:17:57.199409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:17:57.199409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:57.199409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 16:17:57.199409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:57.199409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:17:57.199409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:57.199409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:57.199409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:57.199409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:57.199409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:57.202049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:57.202049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:57.202049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:57.202049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:57.202049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:57.202049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:57.202049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:57.202049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:17:57.202049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:17:57.202049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:17:57.202049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:17:57.202049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:57.202049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:57.202049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:57.202049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:57.202049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:57.202049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:57.203080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:57.203080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:57.203080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:57.203080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:57.203080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:57.203080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:57.203080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:57.203080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:57.203080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:57.203080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:57.203080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:17:57.203080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:57.203080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 16:17:57.203080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:17:57.206032 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 414/879] 10.222.0.26 () {56 vars in 1132 bytes} [Tue Sep 27 16:17:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:57.213604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe9df5-6e9f-49e5-848d-13ba5fd6d33a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:57.312014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe9df5-6e9f-49e5-848d-13ba5fd6d33a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:57.346303 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53319bef-2c91-4e89-a0bd-4a3160206038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:57.346913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53319bef-2c91-4e89-a0bd-4a3160206038 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:57.347199 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53319bef-2c91-4e89-a0bd-4a3160206038 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:57.347483 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53319bef-2c91-4e89-a0bd-4a3160206038 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:57.348114 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53319bef-2c91-4e89-a0bd-4a3160206038 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:57.348454 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53319bef-2c91-4e89-a0bd-4a3160206038 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:57.349819 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53319bef-2c91-4e89-a0bd-4a3160206038 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:57.354859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 466/880] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 27 16:17:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:57.363283 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b6be2-1543-4a9c-8478-652cad082433 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:57.368705 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:57.475840 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b6be2-1543-4a9c-8478-652cad082433 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:57.511599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136d327-4863-434b-92db-ffeaa8965c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:57.512352 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136d327-4863-434b-92db-ffeaa8965c52 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:57.512643 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136d327-4863-434b-92db-ffeaa8965c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:57.512918 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136d327-4863-434b-92db-ffeaa8965c52 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:57.513556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136d327-4863-434b-92db-ffeaa8965c52 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:57.513860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136d327-4863-434b-92db-ffeaa8965c52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:57.515244 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136d327-4863-434b-92db-ffeaa8965c52 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:57.520900 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 415/881] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 27 16:17:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:57.526772 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53319bef-2c91-4e89-a0bd-4a3160206038 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:57.544972 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142f420-cd66-4949-b71a-bcfd7331ced7 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:57.545283 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142f420-cd66-4949-b71a-bcfd7331ced7 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:57.545532 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142f420-cd66-4949-b71a-bcfd7331ced7 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:57.547135 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 416/882] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:17:57.552603 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a41c8-9326-459b-8a94-a057bf30053f None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:57.553109 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a41c8-9326-459b-8a94-a057bf30053f None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:57.553456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a41c8-9326-459b-8a94-a057bf30053f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:57.560439 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:57.571952 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-b55a41c8-9326-459b-8a94-a057bf30053f None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:57.573158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b55a41c8-9326-459b-8a94-a057bf30053f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:57.643672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:57.652062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53319bef-2c91-4e89-a0bd-4a3160206038 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:57.656598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 417/883] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:57 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:17:57.692539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2792550-3954-4e80-b621-50cc684e47b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:57.693995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2792550-3954-4e80-b621-50cc684e47b3 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:57.694687 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2792550-3954-4e80-b621-50cc684e47b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:57.695415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2792550-3954-4e80-b621-50cc684e47b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:57.696698 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2792550-3954-4e80-b621-50cc684e47b3 None admin] RBAC: Adding query filter params (interface=public, service_id=71b0446ade3948258d44691fcac57fa5, region_id=RegionOne) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:57.697280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2792550-3954-4e80-b621-50cc684e47b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:57.698853 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2792550-3954-4e80-b621-50cc684e47b3 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:57.705218 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 467/884] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Sep 27 16:17:57 2022] GET /identity/v3/endpoints?service_id=71b0446ade3948258d44691fcac57fa5&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:57.711139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a41c8-9326-459b-8a94-a057bf30053f None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:57.820353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a41c8-9326-459b-8a94-a057bf30053f None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:57.857634 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4813948-b1c1-4926-bfdc-75a9eb026566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:57.858166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4813948-b1c1-4926-bfdc-75a9eb026566 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:57.858528 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4813948-b1c1-4926-bfdc-75a9eb026566 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:57.858810 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4813948-b1c1-4926-bfdc-75a9eb026566 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:57.859461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4813948-b1c1-4926-bfdc-75a9eb026566 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:57.860952 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4813948-b1c1-4926-bfdc-75a9eb026566 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:57.867110 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 418/885] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Sep 27 16:17:57 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:17:57.941919 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2792550-3954-4e80-b621-50cc684e47b3 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:58.051747 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:58.062591 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2792550-3954-4e80-b621-50cc684e47b3 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:58.098254 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67c595-89b6-4693-8024-20e5841a4b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:58.098887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67c595-89b6-4693-8024-20e5841a4b66 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:58.099159 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67c595-89b6-4693-8024-20e5841a4b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:58.099429 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67c595-89b6-4693-8024-20e5841a4b66 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:58.100008 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67c595-89b6-4693-8024-20e5841a4b66 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:58.101416 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67c595-89b6-4693-8024-20e5841a4b66 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:58.110812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-af67c595-89b6-4693-8024-20e5841a4b66 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 16:17:58.110812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:58.110812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:17:58.110812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:17:58.110812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:17:58.110812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:17:58.110812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:17:58.110812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:58.110812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 16:17:58.110812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:58.110812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:17:58.110812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:58.110812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:58.110812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:58.110812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:58.110812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:58.110812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:58.111854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:58.111854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:58.111854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:58.111854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:58.111854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:58.111854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:58.111854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:17:58.111854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:17:58.111854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:17:58.111854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:17:58.111854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:58.111854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:58.111854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:58.111854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:58.111854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:58.111854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:58.113078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:58.113078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:58.113078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:58.113078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:58.113078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:58.113078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:58.113078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:58.113078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:58.113078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:58.113078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:58.113078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:17:58.113078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:58.113078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 16:17:58.113078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:58.113078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 468/886] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:17:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:58.117699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4813948-b1c1-4926-bfdc-75a9eb026566 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:58.134243 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ba80a-07d5-4f85-9ba1-4c961cce59de None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:58.134524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ba80a-07d5-4f85-9ba1-4c961cce59de None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:58.134802 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ba80a-07d5-4f85-9ba1-4c961cce59de None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:58.138016 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 469/887] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:17:58.142069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f9c58-59f6-428d-980a-297693c2ba3f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:58.142354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f9c58-59f6-428d-980a-297693c2ba3f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:58.142631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f9c58-59f6-428d-980a-297693c2ba3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:58.162842 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-e01f9c58-59f6-428d-980a-297693c2ba3f None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:58.164151 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e01f9c58-59f6-428d-980a-297693c2ba3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:58.187064 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:58.235955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4813948-b1c1-4926-bfdc-75a9eb026566 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:58.241604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 470/888] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:17:58.275743 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceca99d-ed04-41ce-9179-157b7cff1da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:58.276672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceca99d-ed04-41ce-9179-157b7cff1da6 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:58.277096 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceca99d-ed04-41ce-9179-157b7cff1da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:58.277614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceca99d-ed04-41ce-9179-157b7cff1da6 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:58.278396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceca99d-ed04-41ce-9179-157b7cff1da6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:58.278848 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceca99d-ed04-41ce-9179-157b7cff1da6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:58.280434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceca99d-ed04-41ce-9179-157b7cff1da6 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:58.285749 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 419/889] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:17:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:58.293260 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f9c58-59f6-428d-980a-297693c2ba3f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:58.376287 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:58.391676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f9c58-59f6-428d-980a-297693c2ba3f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:58.426512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a72e8e-c169-4b39-9e2d-64abb5b84b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:58.427190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a72e8e-c169-4b39-9e2d-64abb5b84b67 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:58.427467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a72e8e-c169-4b39-9e2d-64abb5b84b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:58.427736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a72e8e-c169-4b39-9e2d-64abb5b84b67 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:58.428447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a72e8e-c169-4b39-9e2d-64abb5b84b67 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:58.428817 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a72e8e-c169-4b39-9e2d-64abb5b84b67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:58.430221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a72e8e-c169-4b39-9e2d-64abb5b84b67 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:58.436946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 471/890] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:17:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:58.443088 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceca99d-ed04-41ce-9179-157b7cff1da6 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:58.550571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceca99d-ed04-41ce-9179-157b7cff1da6 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:58.563997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3054a-3ae0-47be-8228-16ceb433da9c None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:58.564290 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3054a-3ae0-47be-8228-16ceb433da9c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:58.564591 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3054a-3ae0-47be-8228-16ceb433da9c None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:58.566182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 472/891] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:17:58.568425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3054a-3ae0-47be-8228-16ceb433da9c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:58.579719 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:58.588912 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1a3af-34b1-451b-a94e-2108773f5b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:58.593671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1a3af-34b1-451b-a94e-2108773f5b40 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:58.593671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1a3af-34b1-451b-a94e-2108773f5b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:58.593671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1a3af-34b1-451b-a94e-2108773f5b40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:58.593671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1a3af-34b1-451b-a94e-2108773f5b40 None admin] RBAC: Adding query filter params (interface=public, service_id=5e43a039771345768fc8ed32d46307c8, region_id=RegionOne) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:58.593671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1a3af-34b1-451b-a94e-2108773f5b40 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:58.593671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1a3af-34b1-451b-a94e-2108773f5b40 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:58.600415 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 420/892] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Sep 27 16:17:58 2022] GET /identity/v3/endpoints?service_id=5e43a039771345768fc8ed32d46307c8&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:58.602457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfd690-569b-4473-abeb-97ac5c7eabd7 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:58.603367 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfd690-569b-4473-abeb-97ac5c7eabd7 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:58.603699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfd690-569b-4473-abeb-97ac5c7eabd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:58.622628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-cabfd690-569b-4473-abeb-97ac5c7eabd7 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:17:58.623816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-cabfd690-569b-4473-abeb-97ac5c7eabd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:17:58.680436 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3054a-3ae0-47be-8228-16ceb433da9c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:58.696560 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 421/893] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:17:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:17:58.697226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfd690-569b-4473-abeb-97ac5c7eabd7 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:58.732397 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24522ea-3927-4bd3-a9ae-0b3e931d2cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:58.733463 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24522ea-3927-4bd3-a9ae-0b3e931d2cdf None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:58.734216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24522ea-3927-4bd3-a9ae-0b3e931d2cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:58.734703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24522ea-3927-4bd3-a9ae-0b3e931d2cdf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:58.736477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24522ea-3927-4bd3-a9ae-0b3e931d2cdf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:58.738072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24522ea-3927-4bd3-a9ae-0b3e931d2cdf None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:58.750604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-c24522ea-3927-4bd3-a9ae-0b3e931d2cdf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 16:17:58.750604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:58.750604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:17:58.750604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:17:58.750604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:17:58.750604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:17:58.750604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:17:58.750604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:58.750604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 16:17:58.750604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:58.750604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:17:58.750604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:58.750604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:58.750604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:58.750604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:58.750604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:58.750604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:58.751639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:58.751639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:58.751639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:58.751639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:58.751639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:58.751639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:58.751639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:17:58.751639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:17:58.751639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:17:58.751639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:17:58.751639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:58.751639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:58.751639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:58.751639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:58.751639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:58.751639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:58.752527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:58.752527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:58.752527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:58.752527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:58.752527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:58.752527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:58.752527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:58.752527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:58.752527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:58.752527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:58.752527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:17:58.752527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:17:58.752527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 16:17:58.752527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:58.754136 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 473/894] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 27 16:17:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:58.760387 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24522ea-3927-4bd3-a9ae-0b3e931d2cdf None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:58.783341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:58.823998 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfd690-569b-4473-abeb-97ac5c7eabd7 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:58.847793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:58.862980 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2edc2-599d-4e3c-b946-b54e07a0019d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:58.863386 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2edc2-599d-4e3c-b946-b54e07a0019d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:58.863739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2edc2-599d-4e3c-b946-b54e07a0019d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:58.864089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2edc2-599d-4e3c-b946-b54e07a0019d None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:58.864842 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2edc2-599d-4e3c-b946-b54e07a0019d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:58.866353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2edc2-599d-4e3c-b946-b54e07a0019d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:58.873184 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 422/895] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Sep 27 16:17:58 2022] GET /identity/v3/services => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:17:58.897735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24522ea-3927-4bd3-a9ae-0b3e931d2cdf None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:58.936477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a30d0c-3064-4196-a122-e02ddebda94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:58.937168 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a30d0c-3064-4196-a122-e02ddebda94b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:58.937451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a30d0c-3064-4196-a122-e02ddebda94b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:58.937726 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a30d0c-3064-4196-a122-e02ddebda94b None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:58.938371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a30d0c-3064-4196-a122-e02ddebda94b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:58.938674 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a30d0c-3064-4196-a122-e02ddebda94b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:58.940073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a30d0c-3064-4196-a122-e02ddebda94b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:58.951048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 474/896] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 27 16:17:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:17:58.952593 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2edc2-599d-4e3c-b946-b54e07a0019d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:59.000624 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a30d0c-3064-4196-a122-e02ddebda94b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:59.069899 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2edc2-599d-4e3c-b946-b54e07a0019d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:59.099236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:59.114429 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6c2a6-dabd-4ff6-a2f1-858bd0255760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:59.115281 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6c2a6-dabd-4ff6-a2f1-858bd0255760 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:59.116641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6c2a6-dabd-4ff6-a2f1-858bd0255760 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:59.116641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6c2a6-dabd-4ff6-a2f1-858bd0255760 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:59.116641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6c2a6-dabd-4ff6-a2f1-858bd0255760 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:59.116887 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6c2a6-dabd-4ff6-a2f1-858bd0255760 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:59.118171 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6c2a6-dabd-4ff6-a2f1-858bd0255760 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:59.123056 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 423/897] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 27 16:17:58 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:59.127364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a30d0c-3064-4196-a122-e02ddebda94b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:59.166087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0fcd5-92ca-4a3f-afc1-b542749fcab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:59.166845 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0fcd5-92ca-4a3f-afc1-b542749fcab9 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:59.167197 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0fcd5-92ca-4a3f-afc1-b542749fcab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:59.167538 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0fcd5-92ca-4a3f-afc1-b542749fcab9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:59.180067 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0fcd5-92ca-4a3f-afc1-b542749fcab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:17:59.186286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-6ec0fcd5-92ca-4a3f-afc1-b542749fcab9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 16:17:59.186286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:59.186286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:59.186286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:59.186286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:59.186286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:59.186286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:59.186286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:59.186286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:59.186286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:59.186286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:59.186286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:59.186286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:17:59.186286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:17:59.186286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:17:59.186286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:17:59.187351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:17:59.187351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:17:59.187351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:17:59.187351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:17:59.187351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:59.187351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:59.187351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:59.187351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:59.187351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:59.187351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:59.187351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:59.187351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:59.187351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:59.187351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:59.187351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:59.187351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:59.188235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:59.188235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:59.188235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:59.188235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:59.188235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:17:59.188235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:17:59.188235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:17:59.188235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:17:59.188235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:17:59.188235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:17:59.188235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 16:17:59.188235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:59.188235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 475/898] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Sep 27 16:17:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:17:59.193681 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6c2a6-dabd-4ff6-a2f1-858bd0255760 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:59.256929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:59.314849 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6c2a6-dabd-4ff6-a2f1-858bd0255760 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:59.354446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78933eaa-7a42-4c0f-9678-23f06914a9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:59.355137 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78933eaa-7a42-4c0f-9678-23f06914a9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:59.355457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78933eaa-7a42-4c0f-9678-23f06914a9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:59.373731 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78933eaa-7a42-4c0f-9678-23f06914a9b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:59.373731 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78933eaa-7a42-4c0f-9678-23f06914a9b9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:59.373731 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78933eaa-7a42-4c0f-9678-23f06914a9b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:59.373731 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78933eaa-7a42-4c0f-9678-23f06914a9b9 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:59.373731 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 424/899] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Sep 27 16:17:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:59.374116 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0fcd5-92ca-4a3f-afc1-b542749fcab9 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:59.483958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0fcd5-92ca-4a3f-afc1-b542749fcab9 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:59.519650 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232a557-7090-4d41-abbd-c59e4e8705d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:59.520632 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232a557-7090-4d41-abbd-c59e4e8705d5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:59.521095 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232a557-7090-4d41-abbd-c59e4e8705d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:59.521580 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232a557-7090-4d41-abbd-c59e4e8705d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:59.530529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:59.534992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232a557-7090-4d41-abbd-c59e4e8705d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:59.536683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232a557-7090-4d41-abbd-c59e4e8705d5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:59.551505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-2232a557-7090-4d41-abbd-c59e4e8705d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:59.551505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:59.551505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:59.551505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:59.551505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:59.551505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:59.551505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:59.551505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:59.551505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:59.551505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:59.551505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:59.551505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:59.551505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:17:59.551505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:17:59.551505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:17:59.551505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:17:59.552704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:59.552704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:59.552704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:59.552704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:59.552704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:59.552704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:59.552704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:59.552704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:59.552704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:59.552704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:59.552704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:59.552704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:59.552704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:59.552704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:59.552704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:59.552704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:59.552704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:17:59.553624 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:17:59.553624 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:17:59.553624 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:59.560406 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 476/900] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:59.561884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78933eaa-7a42-4c0f-9678-23f06914a9b9 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:59.668027 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78933eaa-7a42-4c0f-9678-23f06914a9b9 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:59.679674 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:17:59.705193 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c15c7-6f5d-460b-92e6-b7d1b8dfd93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:59.706069 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c15c7-6f5d-460b-92e6-b7d1b8dfd93a None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:59.706498 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c15c7-6f5d-460b-92e6-b7d1b8dfd93a None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:59.706932 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c15c7-6f5d-460b-92e6-b7d1b8dfd93a None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:59.707725 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c15c7-6f5d-460b-92e6-b7d1b8dfd93a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:17:59.708263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c15c7-6f5d-460b-92e6-b7d1b8dfd93a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:59.709798 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c15c7-6f5d-460b-92e6-b7d1b8dfd93a None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:59.726620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 425/901] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:17:59.728187 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232a557-7090-4d41-abbd-c59e4e8705d5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:17:59.836878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232a557-7090-4d41-abbd-c59e4e8705d5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:17:59.874811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95f19d-4bff-4da4-96df-ec798605c80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:17:59.875613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95f19d-4bff-4da4-96df-ec798605c80b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:17:59.875901 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95f19d-4bff-4da4-96df-ec798605c80b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:17:59.876174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95f19d-4bff-4da4-96df-ec798605c80b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:17:59.884048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95f19d-4bff-4da4-96df-ec798605c80b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:17:59.885515 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95f19d-4bff-4da4-96df-ec798605c80b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:17:59.897385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-7a95f19d-4bff-4da4-96df-ec798605c80b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 16:17:59.897385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:17:59.897385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:17:59.897385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:17:59.897385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:17:59.897385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:17:59.897385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:17:59.897385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:17:59.897385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:17:59.897385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:17:59.897385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:17:59.897385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:17:59.897385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:17:59.897385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:17:59.897385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:17:59.897385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:17:59.898364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:17:59.898364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:17:59.898364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:17:59.898364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:59.898364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:17:59.898364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:17:59.898364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:17:59.898364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:17:59.898364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:17:59.898364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:17:59.898364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:17:59.898364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:17:59.898364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:17:59.898364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:17:59.898364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:17:59.898364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:17:59.898364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:17:59.898364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:17:59.899354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:17:59.899354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:17:59.899354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:17:59.899354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:17:59.899354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:17:59.899354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:17:59.899354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:17:59.899354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:17:59.899354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 16:17:59.899354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:17:59.903257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 477/902] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 27 16:17:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:17:59.904624 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c15c7-6f5d-460b-92e6-b7d1b8dfd93a None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:00.009998 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c15c7-6f5d-460b-92e6-b7d1b8dfd93a None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:00.050391 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907dd69-462e-4740-8583-f7cb47f0b03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:00.050935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907dd69-462e-4740-8583-f7cb47f0b03e None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:00.051213 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907dd69-462e-4740-8583-f7cb47f0b03e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:00.051487 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907dd69-462e-4740-8583-f7cb47f0b03e None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:00.052224 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907dd69-462e-4740-8583-f7cb47f0b03e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:00.052551 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907dd69-462e-4740-8583-f7cb47f0b03e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:00.053993 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907dd69-462e-4740-8583-f7cb47f0b03e None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:00.077792 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 426/903] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Sep 27 16:17:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:00.079125 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95f19d-4bff-4da4-96df-ec798605c80b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:00.134537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:00.148015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b1a38-25dd-456c-a4f3-b361be9494ad None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:00.148948 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b1a38-25dd-456c-a4f3-b361be9494ad None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:00.149435 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b1a38-25dd-456c-a4f3-b361be9494ad None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:00.151203 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 427/904] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:18:00.156298 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e32e5-5cc1-42c9-8c5e-13a41534d775 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:00.156846 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e32e5-5cc1-42c9-8c5e-13a41534d775 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:00.157318 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e32e5-5cc1-42c9-8c5e-13a41534d775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:00.176303 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-f81e32e5-5cc1-42c9-8c5e-13a41534d775 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:00.177830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f81e32e5-5cc1-42c9-8c5e-13a41534d775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:00.193036 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95f19d-4bff-4da4-96df-ec798605c80b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:00.209296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:00.231771 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea2f25-90f3-43a4-a077-7ad9f99f326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:00.232841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea2f25-90f3-43a4-a077-7ad9f99f326a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:00.233333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea2f25-90f3-43a4-a077-7ad9f99f326a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:00.233816 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea2f25-90f3-43a4-a077-7ad9f99f326a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:00.280360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 428/905] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:18:00.310570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea2f25-90f3-43a4-a077-7ad9f99f326a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:00.312010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea2f25-90f3-43a4-a077-7ad9f99f326a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:00.363784 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:00.415834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 478/906] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:18:00 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 16:18:00.422366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e32e5-5cc1-42c9-8c5e-13a41534d775 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:00.524423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e32e5-5cc1-42c9-8c5e-13a41534d775 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:00.545437 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea2f25-90f3-43a4-a077-7ad9f99f326a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:00.565017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e6342-1477-434d-8340-f8de2048fa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:00.565954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e6342-1477-434d-8340-f8de2048fa9e None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:00.566246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e6342-1477-434d-8340-f8de2048fa9e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:00.566524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e6342-1477-434d-8340-f8de2048fa9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:00.579634 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e6342-1477-434d-8340-f8de2048fa9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:00.581828 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e6342-1477-434d-8340-f8de2048fa9e None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:00.600620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-376e6342-1477-434d-8340-f8de2048fa9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:00.600620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:00.600620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:00.600620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:00.600620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:00.600620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:00.600620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:00.600620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:00.600620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:00.600620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:00.600620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:00.600620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:00.600620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:18:00.600620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:18:00.600620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:18:00.600620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:18:00.601621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:00.601621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:00.601621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:00.601621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:00.601621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:00.601621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:00.601621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:00.601621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:00.601621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:00.601621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:00.601621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:00.601621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:00.601621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:00.601621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:00.601621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:00.601621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:00.601621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:18:00.602574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:18:00.602574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:00.602574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:00.604420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 429/907] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:00.609165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e6342-1477-434d-8340-f8de2048fa9e None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:00.636705 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:00.664786 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea2f25-90f3-43a4-a077-7ad9f99f326a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:00.703775 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf5803-ba2e-4ea0-ad2e-574fbb058fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:00.704606 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf5803-ba2e-4ea0-ad2e-574fbb058fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:00.704996 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf5803-ba2e-4ea0-ad2e-574fbb058fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:00.705343 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf5803-ba2e-4ea0-ad2e-574fbb058fc7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:00.706105 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf5803-ba2e-4ea0-ad2e-574fbb058fc7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:00.707533 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf5803-ba2e-4ea0-ad2e-574fbb058fc7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:00.717675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-3eaf5803-ba2e-4ea0-ad2e-574fbb058fc7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 16:18:00.717675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:00.717675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:18:00.717675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:18:00.717675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:18:00.717675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:18:00.717675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:18:00.717675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:00.717675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 16:18:00.717675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:00.717675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:18:00.717675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:00.717675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:00.717675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:00.717675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:00.717675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:00.718659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:00.718659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:00.718659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:00.718659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:00.718659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:00.718659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:00.718659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:00.718659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:18:00.718659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:18:00.718659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:18:00.718659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:18:00.718659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:00.718659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:00.718659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:00.718659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:00.718659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:00.718659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:00.719572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:00.719572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:00.719572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:00.719572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:00.719572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:00.719572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:00.719572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:00.719572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:00.719572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:00.719572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:00.719572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:18:00.719572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:00.719572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 16:18:00.719572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:00.722367 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 479/908] 10.222.0.26 () {56 vars in 1132 bytes} [Tue Sep 27 16:18:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:18:00.732456 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf5803-ba2e-4ea0-ad2e-574fbb058fc7 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:00.742107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e6342-1477-434d-8340-f8de2048fa9e None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:00.751150 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:00.781260 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69823670-b79e-43f3-94b0-e33882a56f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:00.781966 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69823670-b79e-43f3-94b0-e33882a56f06 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:00.782313 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69823670-b79e-43f3-94b0-e33882a56f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:00.782654 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69823670-b79e-43f3-94b0-e33882a56f06 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:00.783390 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69823670-b79e-43f3-94b0-e33882a56f06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:00.783785 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69823670-b79e-43f3-94b0-e33882a56f06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:00.785295 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69823670-b79e-43f3-94b0-e33882a56f06 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:00.803695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 430/909] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:00.805215 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69823670-b79e-43f3-94b0-e33882a56f06 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:00.858602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf5803-ba2e-4ea0-ad2e-574fbb058fc7 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:00.880250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:00.898350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c99f5-7abc-4eec-8484-b89eb0920adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:00.899246 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c99f5-7abc-4eec-8484-b89eb0920adf None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:00.899692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c99f5-7abc-4eec-8484-b89eb0920adf None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:00.900234 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c99f5-7abc-4eec-8484-b89eb0920adf None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:00.901100 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c99f5-7abc-4eec-8484-b89eb0920adf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:00.901575 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c99f5-7abc-4eec-8484-b89eb0920adf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:00.903341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c99f5-7abc-4eec-8484-b89eb0920adf None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:00.910234 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 480/910] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 27 16:18:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:00.912888 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69823670-b79e-43f3-94b0-e33882a56f06 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:00.922477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c99f5-7abc-4eec-8484-b89eb0920adf None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:00.951863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8208ec9-5281-4111-af62-1699956e385e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:00.952873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8208ec9-5281-4111-af62-1699956e385e None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:00.953363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8208ec9-5281-4111-af62-1699956e385e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:00.953904 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8208ec9-5281-4111-af62-1699956e385e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:00.961200 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8208ec9-5281-4111-af62-1699956e385e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:00.962998 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8208ec9-5281-4111-af62-1699956e385e None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:00.974809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-b8208ec9-5281-4111-af62-1699956e385e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:18:00.974809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:00.974809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:00.974809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:00.974809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:00.974809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:00.974809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:00.974809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:00.974809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:00.974809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:00.974809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:00.974809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:00.974809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:18:00.974809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:18:00.974809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:18:00.975759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:18:00.975759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:00.975759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:00.975759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:00.975759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:00.975759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:00.975759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:00.975759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:00.975759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:00.975759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:00.975759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:00.975759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:00.975759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:00.975759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:00.975759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:00.975759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:00.975759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:00.976716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:18:00.976716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:18:00.976716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:18:00.976716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:18:00.976716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:18:00.976716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:18:00.976716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:18:00.976716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:00.979140 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 431/911] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:18:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:00.985911 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8208ec9-5281-4111-af62-1699956e385e None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:01.021569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:01.045740 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c99f5-7abc-4eec-8484-b89eb0920adf None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:01.086210 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d6867-9642-45c8-aa55-e15a3eef719b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:01.086890 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d6867-9642-45c8-aa55-e15a3eef719b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:01.087174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d6867-9642-45c8-aa55-e15a3eef719b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:01.087506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d6867-9642-45c8-aa55-e15a3eef719b None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:01.088171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d6867-9642-45c8-aa55-e15a3eef719b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:01.088531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d6867-9642-45c8-aa55-e15a3eef719b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:01.091388 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d6867-9642-45c8-aa55-e15a3eef719b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:01.096509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 481/912] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 27 16:18:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:01.101749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d6867-9642-45c8-aa55-e15a3eef719b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:01.129983 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8208ec9-5281-4111-af62-1699956e385e None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:01.166607 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:01.175517 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c8949-dae4-4bb9-8aa2-7a14a4ef8fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:01.176843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c8949-dae4-4bb9-8aa2-7a14a4ef8fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:01.177551 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c8949-dae4-4bb9-8aa2-7a14a4ef8fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:01.200492 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c8949-dae4-4bb9-8aa2-7a14a4ef8fb0 None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:01.200492 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c8949-dae4-4bb9-8aa2-7a14a4ef8fb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:01.200492 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c8949-dae4-4bb9-8aa2-7a14a4ef8fb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:01.200492 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c8949-dae4-4bb9-8aa2-7a14a4ef8fb0 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:01.201171 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 432/913] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:18:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:01.205643 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07906-56ad-4db9-9b51-4e54b7e9dbf7 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:01.205929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07906-56ad-4db9-9b51-4e54b7e9dbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:01.206210 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07906-56ad-4db9-9b51-4e54b7e9dbf7 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:01.207493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 433/914] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:01.208182 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c07906-56ad-4db9-9b51-4e54b7e9dbf7 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:01.221634 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d6867-9642-45c8-aa55-e15a3eef719b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:01.260409 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060bd5c-6bf6-4bd1-85f7-e825871d3e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:01.261395 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060bd5c-6bf6-4bd1-85f7-e825871d3e72 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:01.261925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060bd5c-6bf6-4bd1-85f7-e825871d3e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:01.262378 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060bd5c-6bf6-4bd1-85f7-e825871d3e72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:01.263343 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060bd5c-6bf6-4bd1-85f7-e825871d3e72 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:01.265048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060bd5c-6bf6-4bd1-85f7-e825871d3e72 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:01.315048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c07906-56ad-4db9-9b51-4e54b7e9dbf7 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:01.337264 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:01.344077 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 482/915] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:18:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:18:01.345501 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9a4b9-436b-4642-a978-067244bb5d7e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:01.345954 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9a4b9-436b-4642-a978-067244bb5d7e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:01.346240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9a4b9-436b-4642-a978-067244bb5d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:01.375710 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-00c9a4b9-436b-4642-a978-067244bb5d7e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:01.376184 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef6ee7-e6b5-484d-8414-c3976b77a10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:01.377100 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef6ee7-e6b5-484d-8414-c3976b77a10e None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:01.377228 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-00c9a4b9-436b-4642-a978-067244bb5d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:01.377703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef6ee7-e6b5-484d-8414-c3976b77a10e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:01.378173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef6ee7-e6b5-484d-8414-c3976b77a10e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:01.379222 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef6ee7-e6b5-484d-8414-c3976b77a10e None admin] RBAC: Adding query filter params (role.id=550538ff801d4fd08b79738d5b5897f6, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=0c8d0a718e8347b5af397f866056266e) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:01.380081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef6ee7-e6b5-484d-8414-c3976b77a10e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:01.382836 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef6ee7-e6b5-484d-8414-c3976b77a10e None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:01.391715 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 434/916] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:18:01 2022] GET /identity/v3/role_assignments?user.id=0c8d0a718e8347b5af397f866056266e&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=550538ff801d4fd08b79738d5b5897f6 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:01.448269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df646df-9062-478d-9d8b-f33550771ef7 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:01.448650 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df646df-9062-478d-9d8b-f33550771ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:01.448896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df646df-9062-478d-9d8b-f33550771ef7 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:01.450651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 435/917] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:18:01.457353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69601bd9-e5e1-479d-9ccb-20ef740e15a4 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:01.457700 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69601bd9-e5e1-479d-9ccb-20ef740e15a4 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:01.457916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69601bd9-e5e1-479d-9ccb-20ef740e15a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:01.479277 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 483/918] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:01.486006 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-69601bd9-e5e1-479d-9ccb-20ef740e15a4 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:01.489014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-69601bd9-e5e1-479d-9ccb-20ef740e15a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:01.546839 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:01.569166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 436/919] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:18:01.751645 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9a4b9-436b-4642-a978-067244bb5d7e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:01.847867 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69601bd9-e5e1-479d-9ccb-20ef740e15a4 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:01.860319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9a4b9-436b-4642-a978-067244bb5d7e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:01.891531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:01.900357 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22f3f1-017a-485c-92f1-aa57729c61c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:01.908066 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22f3f1-017a-485c-92f1-aa57729c61c6 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:01.908066 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22f3f1-017a-485c-92f1-aa57729c61c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:01.908066 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22f3f1-017a-485c-92f1-aa57729c61c6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:01.908066 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22f3f1-017a-485c-92f1-aa57729c61c6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:01.908066 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22f3f1-017a-485c-92f1-aa57729c61c6 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:01.919961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-5a22f3f1-017a-485c-92f1-aa57729c61c6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 16:18:01.919961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:01.919961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:18:01.919961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:18:01.919961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:18:01.919961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:18:01.919961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:18:01.919961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:01.919961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 16:18:01.919961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:01.919961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:18:01.919961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:01.919961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:01.919961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:01.919961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:01.919961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:01.919961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:01.921044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:01.921044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:01.921044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:01.921044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:01.921044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:01.921044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:01.921044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:18:01.921044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:18:01.921044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:18:01.921044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:18:01.921044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:01.921044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:01.921044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:01.921044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:01.921044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:01.921044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:01.921880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:01.921880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:01.921880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:01.921880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:01.921880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:01.921880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:01.921880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:01.921880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:01.921880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:01.921880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:01.921880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:18:01.921880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:01.921880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 16:18:01.921880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:01.924671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 484/920] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:18:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:01.931572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22f3f1-017a-485c-92f1-aa57729c61c6 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:01.969489 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69601bd9-e5e1-479d-9ccb-20ef740e15a4 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:02.013828 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb09f98-f0ff-4867-9bd3-7af7cc038ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:02.014362 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb09f98-f0ff-4867-9bd3-7af7cc038ab4 None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:02.014641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb09f98-f0ff-4867-9bd3-7af7cc038ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:02.015080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb09f98-f0ff-4867-9bd3-7af7cc038ab4 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:02.015850 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb09f98-f0ff-4867-9bd3-7af7cc038ab4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:02.017436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb09f98-f0ff-4867-9bd3-7af7cc038ab4 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:02.050509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22f3f1-017a-485c-92f1-aa57729c61c6 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:02.084422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560ddb1-a0c9-469f-b0b2-fee33e8f669f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:02.085033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560ddb1-a0c9-469f-b0b2-fee33e8f669f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:02.085361 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560ddb1-a0c9-469f-b0b2-fee33e8f669f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:02.085716 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560ddb1-a0c9-469f-b0b2-fee33e8f669f None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:02.086345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560ddb1-a0c9-469f-b0b2-fee33e8f669f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:02.086648 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560ddb1-a0c9-469f-b0b2-fee33e8f669f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:02.088002 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560ddb1-a0c9-469f-b0b2-fee33e8f669f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:02.093697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 485/921] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:18:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:02.100654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560ddb1-a0c9-469f-b0b2-fee33e8f669f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:02.102263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 437/922] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 27 16:18:01 2022] POST /identity/v3/services => generated 241 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:18:02.173516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:02.249926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560ddb1-a0c9-469f-b0b2-fee33e8f669f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:02.318633 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7482877-cbbf-4c87-8b93-fa631d338889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:02.319055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7482877-cbbf-4c87-8b93-fa631d338889 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:02.324851 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7482877-cbbf-4c87-8b93-fa631d338889 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:02.324851 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7482877-cbbf-4c87-8b93-fa631d338889 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:02.324851 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7482877-cbbf-4c87-8b93-fa631d338889 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:02.324851 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7482877-cbbf-4c87-8b93-fa631d338889 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:02.324851 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7482877-cbbf-4c87-8b93-fa631d338889 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:02.328509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 486/923] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 27 16:18:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:02.334452 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb09f98-f0ff-4867-9bd3-7af7cc038ab4 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:02.411954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:02.487923 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb09f98-f0ff-4867-9bd3-7af7cc038ab4 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:02.523777 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b9989-1b8a-488f-b1ba-680c5f6ded4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:02.524425 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b9989-1b8a-488f-b1ba-680c5f6ded4c None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:02.524729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b9989-1b8a-488f-b1ba-680c5f6ded4c None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:02.525052 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b9989-1b8a-488f-b1ba-680c5f6ded4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:02.525737 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b9989-1b8a-488f-b1ba-680c5f6ded4c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:02.527126 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b9989-1b8a-488f-b1ba-680c5f6ded4c None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:02.623867 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 438/924] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:18:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:18:03.724368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f30234-b6c5-43a7-9d10-7914abe87724 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:03.724883 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f30234-b6c5-43a7-9d10-7914abe87724 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:03.724991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f30234-b6c5-43a7-9d10-7914abe87724 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:03.726488 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 487/925] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:03.730051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f6ac5-0130-4e2a-95a8-c317a6305ac4 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:03.730448 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f6ac5-0130-4e2a-95a8-c317a6305ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:03.730649 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f6ac5-0130-4e2a-95a8-c317a6305ac4 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:03.732076 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 439/926] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:03.735374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc25f64-1dbd-48d6-83ad-7b91f23ceb01 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:03.736221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc25f64-1dbd-48d6-83ad-7b91f23ceb01 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:03.736737 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc25f64-1dbd-48d6-83ad-7b91f23ceb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:03.737547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd45687-0b48-4bbb-b707-a6f4ab1a84de None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:03.737831 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd45687-0b48-4bbb-b707-a6f4ab1a84de None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:03.738260 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd45687-0b48-4bbb-b707-a6f4ab1a84de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:03.756890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-4fd45687-0b48-4bbb-b707-a6f4ab1a84de None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:03.758079 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4fd45687-0b48-4bbb-b707-a6f4ab1a84de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:03.758213 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-0cc25f64-1dbd-48d6-83ad-7b91f23ceb01 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:03.759611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0cc25f64-1dbd-48d6-83ad-7b91f23ceb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:03.848449 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 440/928] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:03.848813 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 488/928] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:18:04.111020 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd45687-0b48-4bbb-b707-a6f4ab1a84de None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:04.117040 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc25f64-1dbd-48d6-83ad-7b91f23ceb01 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:04.141107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:04.167243 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:04.224289 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd45687-0b48-4bbb-b707-a6f4ab1a84de None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:04.231274 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc25f64-1dbd-48d6-83ad-7b91f23ceb01 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:04.263139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e2013-943d-4a14-bcc9-845a5537745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:04.264224 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e2013-943d-4a14-bcc9-845a5537745d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:04.264802 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e2013-943d-4a14-bcc9-845a5537745d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:04.265304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e2013-943d-4a14-bcc9-845a5537745d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:04.268877 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb0e65-f090-46fc-8087-157bb4e9f5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:04.269609 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb0e65-f090-46fc-8087-157bb4e9f5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:04.269964 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb0e65-f090-46fc-8087-157bb4e9f5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:04.270315 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb0e65-f090-46fc-8087-157bb4e9f5b4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:04.270971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb0e65-f090-46fc-8087-157bb4e9f5b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:04.272442 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb0e65-f090-46fc-8087-157bb4e9f5b4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:04.278585 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e2013-943d-4a14-bcc9-845a5537745d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:18:04.282762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-73fb0e65-f090-46fc-8087-157bb4e9f5b4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 16:18:04.282762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:04.282762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:18:04.282762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:18:04.282762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:18:04.282762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:18:04.282762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:18:04.282762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:04.282762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 16:18:04.282762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:04.282762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:18:04.282762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:04.282762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:04.282762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:04.282762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:04.282762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:04.282762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:04.284293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:04.284293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:04.284293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:04.284293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:04.284293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:04.284293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:04.284293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:18:04.284293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:18:04.284293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:18:04.284293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:18:04.284293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:04.284293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:04.284293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:04.284293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:04.284293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:04.284293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:04.285219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:04.285219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:04.285219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:04.285219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:04.285219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:04.285219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:04.285219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:04.285219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:04.285219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:04.285219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:04.285219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:18:04.285219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:04.285219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 16:18:04.285219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:04.285219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 489/929] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:18:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:04.286042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-b68e2013-943d-4a14-bcc9-845a5537745d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 16:18:04.286042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:04.286042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:04.286042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:04.286042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:04.286042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:04.286042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:04.286042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:04.286042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:04.286042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:04.286042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:04.286042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:04.286042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:18:04.286042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:18:04.286042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:18:04.286042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:18:04.288954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:18:04.288954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:18:04.288954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:18:04.288954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:18:04.288954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:04.288954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:04.288954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:04.288954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:04.288954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:04.288954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:04.288954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:04.288954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:04.288954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:04.288954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:04.288954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:04.288954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:04.289861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:04.289861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:04.289861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:04.289861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:04.289861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:18:04.289861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:18:04.289861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:18:04.289861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:18:04.289861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:18:04.289861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:18:04.289861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 16:18:04.289861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:04.289861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 441/930] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Sep 27 16:18:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:04.293737 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb0e65-f090-46fc-8087-157bb4e9f5b4 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:04.298837 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e2013-943d-4a14-bcc9-845a5537745d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:04.392686 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:04.413254 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb0e65-f090-46fc-8087-157bb4e9f5b4 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:04.413483 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e2013-943d-4a14-bcc9-845a5537745d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:04.425882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:04.451764 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb499f-eb46-40cf-86df-585cc439306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:04.452668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb499f-eb46-40cf-86df-585cc439306d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:04.452955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb499f-eb46-40cf-86df-585cc439306d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:04.453229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb499f-eb46-40cf-86df-585cc439306d None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:04.453890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb499f-eb46-40cf-86df-585cc439306d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:04.454197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb499f-eb46-40cf-86df-585cc439306d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:04.454384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9487b4c-d870-4171-bde9-69a5061c2854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:04.454991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9487b4c-d870-4171-bde9-69a5061c2854 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:04.455267 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9487b4c-d870-4171-bde9-69a5061c2854 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:04.455542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9487b4c-d870-4171-bde9-69a5061c2854 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:04.455643 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb499f-eb46-40cf-86df-585cc439306d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:04.456158 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9487b4c-d870-4171-bde9-69a5061c2854 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:04.456495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9487b4c-d870-4171-bde9-69a5061c2854 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:04.457842 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9487b4c-d870-4171-bde9-69a5061c2854 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:04.463174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 490/931] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 27 16:18:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:04.464350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85425c7b-de32-45e3-9a4e-d7f064e28baf None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:04.464680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85425c7b-de32-45e3-9a4e-d7f064e28baf None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:04.464962 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85425c7b-de32-45e3-9a4e-d7f064e28baf None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:04.465871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 442/932] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Sep 27 16:18:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:04.466950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 491/933] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:04.469329 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb499f-eb46-40cf-86df-585cc439306d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:04.472385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89564cf8-a3af-463c-ba3b-b0e7f2d69cbc None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:04.472674 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89564cf8-a3af-463c-ba3b-b0e7f2d69cbc None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:04.472948 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89564cf8-a3af-463c-ba3b-b0e7f2d69cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:04.490541 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-89564cf8-a3af-463c-ba3b-b0e7f2d69cbc None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:04.491707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-89564cf8-a3af-463c-ba3b-b0e7f2d69cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:04.565489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 492/934] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:04.566716 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89564cf8-a3af-463c-ba3b-b0e7f2d69cbc None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:04.586576 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb499f-eb46-40cf-86df-585cc439306d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:04.626549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34be6a1-ceec-49d5-a956-e4efbc5a3aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:04.627188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34be6a1-ceec-49d5-a956-e4efbc5a3aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:04.627473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34be6a1-ceec-49d5-a956-e4efbc5a3aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:04.627748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34be6a1-ceec-49d5-a956-e4efbc5a3aa6 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:04.628411 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34be6a1-ceec-49d5-a956-e4efbc5a3aa6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:04.628770 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34be6a1-ceec-49d5-a956-e4efbc5a3aa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:04.630738 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34be6a1-ceec-49d5-a956-e4efbc5a3aa6 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:04.637568 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 443/935] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 27 16:18:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:04.685212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:04.688811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89564cf8-a3af-463c-ba3b-b0e7f2d69cbc None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:04.729300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb135f-63eb-421a-b8e1-fca95f72dbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:04.730680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb135f-63eb-421a-b8e1-fca95f72dbad None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:04.731169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb135f-63eb-421a-b8e1-fca95f72dbad None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:04.731626 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb135f-63eb-421a-b8e1-fca95f72dbad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:04.743352 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb135f-63eb-421a-b8e1-fca95f72dbad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:04.745092 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb135f-63eb-421a-b8e1-fca95f72dbad None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:04.761590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-0dcb135f-63eb-421a-b8e1-fca95f72dbad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:04.761590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:04.761590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:04.761590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:04.761590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:04.761590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:04.761590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:04.761590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:04.761590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:04.761590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:04.761590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:04.761590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:04.761590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:18:04.761590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:18:04.761590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:18:04.761590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:18:04.763443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:04.763443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:04.763443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:04.763443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:04.763443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:04.763443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:04.763443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:04.763443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:04.763443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:04.763443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:04.763443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:04.763443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:04.763443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:04.763443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:04.763443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:04.763443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:04.763443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:18:04.764586 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:18:04.764586 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:04.764586 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:04.766689 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 493/936] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:04.772301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34be6a1-ceec-49d5-a956-e4efbc5a3aa6 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:04.791438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:04.863298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb135f-63eb-421a-b8e1-fca95f72dbad None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:04.900459 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34be6a1-ceec-49d5-a956-e4efbc5a3aa6 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:04.936194 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9b155-63be-43ec-be12-d5e5ee8427a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:04.936761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9b155-63be-43ec-be12-d5e5ee8427a7 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:04.937035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9b155-63be-43ec-be12-d5e5ee8427a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:04.937300 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9b155-63be-43ec-be12-d5e5ee8427a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:04.938041 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9b155-63be-43ec-be12-d5e5ee8427a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:04.938446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9b155-63be-43ec-be12-d5e5ee8427a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:04.939804 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9b155-63be-43ec-be12-d5e5ee8427a7 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:04.956417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 444/937] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:04.956417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2007e-faac-4a8f-893b-2043ac266bf3 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:04.956417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2007e-faac-4a8f-893b-2043ac266bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:04.956417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2007e-faac-4a8f-893b-2043ac266bf3 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:04.956417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 445/938] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:04.961105 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf6545-9871-4a9e-a9b8-789f5545fc32 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:04.961499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf6545-9871-4a9e-a9b8-789f5545fc32 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:04.961773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf6545-9871-4a9e-a9b8-789f5545fc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:04.981217 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-3abf6545-9871-4a9e-a9b8-789f5545fc32 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:04.981389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb135f-63eb-421a-b8e1-fca95f72dbad None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:04.982393 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3abf6545-9871-4a9e-a9b8-789f5545fc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:05.016936 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3506a-f691-4036-9783-a14a912137c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:05.017566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3506a-f691-4036-9783-a14a912137c8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:05.018004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3506a-f691-4036-9783-a14a912137c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:05.018279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3506a-f691-4036-9783-a14a912137c8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:05.018854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3506a-f691-4036-9783-a14a912137c8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:05.020774 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3506a-f691-4036-9783-a14a912137c8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:05.029946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-4bf3506a-f691-4036-9783-a14a912137c8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 16:18:05.029946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:05.029946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:18:05.029946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:18:05.029946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:18:05.029946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:18:05.029946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:18:05.029946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:05.029946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 16:18:05.029946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:05.029946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:18:05.029946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:05.029946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:05.029946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:05.029946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:05.029946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:05.029946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:05.030951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:05.030951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:05.030951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:05.030951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:05.030951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:05.030951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:05.030951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:18:05.030951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:18:05.030951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:18:05.030951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:18:05.030951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:05.030951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:05.030951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:05.030951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:05.030951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:05.030951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:05.031811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:05.031811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:05.031811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:05.031811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:05.031811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:05.031811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:05.031811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:05.031811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:05.031811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:05.031811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:05.031811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:18:05.031811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:05.031811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 16:18:05.031811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:05.031811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 494/939] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 27 16:18:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:05.033196 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3506a-f691-4036-9783-a14a912137c8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:05.051579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:05.056524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:05.068532 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 446/940] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:05.069392 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf6545-9871-4a9e-a9b8-789f5545fc32 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:05.139652 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3506a-f691-4036-9783-a14a912137c8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:05.181421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba342ce-a298-4742-a8e1-25c33daa2a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:05.182364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba342ce-a298-4742-a8e1-25c33daa2a8f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:05.182652 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba342ce-a298-4742-a8e1-25c33daa2a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:05.182933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba342ce-a298-4742-a8e1-25c33daa2a8f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:05.187090 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf6545-9871-4a9e-a9b8-789f5545fc32 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:05.191031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba342ce-a298-4742-a8e1-25c33daa2a8f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:05.192589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba342ce-a298-4742-a8e1-25c33daa2a8f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:05.206588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-1ba342ce-a298-4742-a8e1-25c33daa2a8f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 16:18:05.206588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:05.206588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:05.206588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:05.206588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:05.206588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:05.206588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:05.206588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:05.206588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:05.206588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:05.206588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:05.206588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:05.206588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:18:05.206588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:18:05.206588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:18:05.206588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:18:05.207770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:05.207770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:05.207770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:18:05.207770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:18:05.207770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:18:05.207770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:18:05.207770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:05.207770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:05.207770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:05.207770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:05.207770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:05.207770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:05.207770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:05.207770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:05.207770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:05.207770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:05.207770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:05.207770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:05.208830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:05.208830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:05.208830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:18:05.208830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:18:05.208830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:18:05.208830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:18:05.208830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:18:05.208830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:18:05.208830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 16:18:05.208830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:05.209373 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 495/941] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 27 16:18:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:05.214339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba342ce-a298-4742-a8e1-25c33daa2a8f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:05.234914 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbbc50-4c44-4641-ba4e-d225cc6e87da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:05.235530 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbbc50-4c44-4641-ba4e-d225cc6e87da None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:05.235812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbbc50-4c44-4641-ba4e-d225cc6e87da None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:05.236087 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbbc50-4c44-4641-ba4e-d225cc6e87da None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:05.237015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbbc50-4c44-4641-ba4e-d225cc6e87da None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:05.237713 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbbc50-4c44-4641-ba4e-d225cc6e87da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:05.239165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbbc50-4c44-4641-ba4e-d225cc6e87da None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:05.245339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 447/942] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 27 16:18:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:05.250866 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbbc50-4c44-4641-ba4e-d225cc6e87da None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:05.314104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:05.332085 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:05.342997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba342ce-a298-4742-a8e1-25c33daa2a8f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:05.376205 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbbc50-4c44-4641-ba4e-d225cc6e87da None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:05.381095 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60d2af-c686-47ca-a01b-2de626142d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:05.381713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60d2af-c686-47ca-a01b-2de626142d4f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:05.381996 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60d2af-c686-47ca-a01b-2de626142d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:05.382276 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60d2af-c686-47ca-a01b-2de626142d4f None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:05.383005 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60d2af-c686-47ca-a01b-2de626142d4f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:05.383313 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60d2af-c686-47ca-a01b-2de626142d4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:05.385193 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60d2af-c686-47ca-a01b-2de626142d4f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:05.406139 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 496/943] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Sep 27 16:18:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:05.411360 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60d2af-c686-47ca-a01b-2de626142d4f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:05.412276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0e134-feb2-4e24-8c6b-6072ecf1dd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:05.412918 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0e134-feb2-4e24-8c6b-6072ecf1dd13 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:05.413191 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0e134-feb2-4e24-8c6b-6072ecf1dd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:05.413464 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0e134-feb2-4e24-8c6b-6072ecf1dd13 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:05.414082 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0e134-feb2-4e24-8c6b-6072ecf1dd13 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:05.414383 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0e134-feb2-4e24-8c6b-6072ecf1dd13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:05.415742 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0e134-feb2-4e24-8c6b-6072ecf1dd13 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:05.421147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 448/944] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 27 16:18:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:05.421786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0e134-feb2-4e24-8c6b-6072ecf1dd13 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:05.522720 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60d2af-c686-47ca-a01b-2de626142d4f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:05.527319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0e134-feb2-4e24-8c6b-6072ecf1dd13 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:05.556261 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:05.558441 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc354af5-014f-40e2-b0e9-388ddd10020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:05.559573 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc354af5-014f-40e2-b0e9-388ddd10020d None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:05.559851 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc354af5-014f-40e2-b0e9-388ddd10020d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:05.560125 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc354af5-014f-40e2-b0e9-388ddd10020d None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:05.560790 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc354af5-014f-40e2-b0e9-388ddd10020d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:05.562228 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc354af5-014f-40e2-b0e9-388ddd10020d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:05.564879 dv-cinder-855060-2-smb devstack@keystone.service[81631]: WARNING keystone.server.flask.common [None req-fc354af5-014f-40e2-b0e9-388ddd10020d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 27 16:18:05.572535 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db82e5-4857-4b05-948a-dcaaaf825384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:05.572535 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db82e5-4857-4b05-948a-dcaaaf825384 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:05.572535 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db82e5-4857-4b05-948a-dcaaaf825384 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:05.572535 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db82e5-4857-4b05-948a-dcaaaf825384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:05.572936 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:05.580445 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db82e5-4857-4b05-948a-dcaaaf825384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:05.582069 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db82e5-4857-4b05-948a-dcaaaf825384 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:05.597598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-63db82e5-4857-4b05-948a-dcaaaf825384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:05.597598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:05.597598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:05.597598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:05.597598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:05.597598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:05.597598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:05.597598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:05.597598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:05.597598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:05.597598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:05.597598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:05.597598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:18:05.597598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:18:05.597598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:18:05.597598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:18:05.598783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:05.598783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:05.598783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:05.598783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:05.598783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:05.598783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:05.598783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:05.598783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:05.598783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:05.598783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:05.598783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:05.598783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:05.598783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:05.598783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:05.598783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:05.598783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:05.598783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:18:05.599852 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:18:05.599852 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:05.599852 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:05.599852 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 449/945] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:05.601164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db82e5-4857-4b05-948a-dcaaaf825384 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:05.614509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.sql.core [None req-fc354af5-014f-40e2-b0e9-388ddd10020d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 27 16:18:05.614509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 27 16:18:05.614509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [parameters: {'id': 'be6e11a8ea84459fae172c1a97c231d3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 27 16:18:05.614509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81631) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 27 16:18:05.631835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-fc354af5-014f-40e2-b0e9-388ddd10020d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id be6e11a8ea84459fae172c1a97c231d3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id be6e11a8ea84459fae172c1a97c231d3. Sep 27 16:18:05.631835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:05.631835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 16:18:05.631835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 16:18:05.631835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 16:18:05.631835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 16:18:05.631835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 16:18:05.631835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 16:18:05.631835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 16:18:05.631835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application conn.query(q) Sep 27 16:18:05.631835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 16:18:05.631835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 16:18:05.631835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 16:18:05.632897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result.read() Sep 27 16:18:05.632897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 16:18:05.632897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 16:18:05.632897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 16:18:05.632897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 16:18:05.632897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 16:18:05.632897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 16:18:05.632897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 16:18:05.632897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 16:18:05.632897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 27 16:18:05.632897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:05.632897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 27 16:18:05.632897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:05.632897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:05.632897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 27 16:18:05.632897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 27 16:18:05.632897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 27 16:18:05.632897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 27 16:18:05.633871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 16:18:05.633871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application next(self.gen) Sep 27 16:18:05.633871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 27 16:18:05.633871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application yield resource Sep 27 16:18:05.633871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 16:18:05.633871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application next(self.gen) Sep 27 16:18:05.633871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 27 16:18:05.633871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.session.rollback() Sep 27 16:18:05.633871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 16:18:05.633871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.force_reraise() Sep 27 16:18:05.633871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 16:18:05.633871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise self.value Sep 27 16:18:05.633871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 27 16:18:05.633871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 27 16:18:05.633871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 27 16:18:05.633871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application session.commit() Sep 27 16:18:05.633871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 27 16:18:05.634777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 27 16:18:05.634777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 27 16:18:05.634777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._prepare_impl() Sep 27 16:18:05.634777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 27 16:18:05.634777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.session.flush() Sep 27 16:18:05.634777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 27 16:18:05.634777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._flush(objects) Sep 27 16:18:05.634777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 27 16:18:05.634777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 27 16:18:05.634777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 27 16:18:05.634777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application compat.raise_( Sep 27 16:18:05.634777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 16:18:05.634777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception Sep 27 16:18:05.634777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 27 16:18:05.634777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application flush_context.execute() Sep 27 16:18:05.634777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 27 16:18:05.634777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rec.execute(self) Sep 27 16:18:05.637850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 27 16:18:05.637850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 27 16:18:05.637850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 27 16:18:05.637850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 27 16:18:05.637850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 27 16:18:05.637850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 27 16:18:05.637850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 27 16:18:05.637850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 27 16:18:05.637850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 27 16:18:05.637850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 27 16:18:05.637850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 27 16:18:05.637850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 27 16:18:05.637850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 27 16:18:05.637850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 27 16:18:05.637850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 27 16:18:05.639776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 27 16:18:05.639776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 16:18:05.639776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception Sep 27 16:18:05.639776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 16:18:05.639776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 16:18:05.639776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 16:18:05.639776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 16:18:05.639776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 16:18:05.639776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 16:18:05.639776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 16:18:05.639776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application conn.query(q) Sep 27 16:18:05.639776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 16:18:05.639776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 16:18:05.639776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 16:18:05.639776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result.read() Sep 27 16:18:05.639776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 16:18:05.639776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 16:18:05.642522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 16:18:05.642522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 16:18:05.642522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 16:18:05.642522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 16:18:05.642522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 16:18:05.642522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 16:18:05.642522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 27 16:18:05.642522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 27 16:18:05.642522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [parameters: {'id': 'be6e11a8ea84459fae172c1a97c231d3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 27 16:18:05.642522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 27 16:18:05.642522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:05.642522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:18:05.642522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:05.642522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:05.642522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 27 16:18:05.644892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 27 16:18:05.644892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 27 16:18:05.644892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 27 16:18:05.644892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 27 16:18:05.644892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:05.644892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:18:05.644892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:05.644892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:05.644892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:05.644892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:05.644892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:05.644892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:05.644892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:05.644892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:05.644892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:05.644892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:05.644892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:05.647697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:05.647697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 27 16:18:05.647697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 27 16:18:05.647697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:05.647697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:05.647697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 27 16:18:05.647697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 27 16:18:05.647697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id be6e11a8ea84459fae172c1a97c231d3. Sep 27 16:18:05.647697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:05.647697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 497/946] 10.222.0.26 () {60 vars in 1140 bytes} [Tue Sep 27 16:18:05 2022] POST /identity/v3/projects => generated 262 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:05.647697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc354af5-014f-40e2-b0e9-388ddd10020d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:05.711692 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db82e5-4857-4b05-948a-dcaaaf825384 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:05.741377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc354af5-014f-40e2-b0e9-388ddd10020d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:05.747161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a5255-1221-438f-828a-c8c9f04f0b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:05.747770 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a5255-1221-438f-828a-c8c9f04f0b23 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:05.748102 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a5255-1221-438f-828a-c8c9f04f0b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:05.748412 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a5255-1221-438f-828a-c8c9f04f0b23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:05.749115 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a5255-1221-438f-828a-c8c9f04f0b23 None admin] RBAC: Adding query filter params (interface=public, service_id=0ab591ab030c497b8f522bf560311c8b, region_id=RegionOne) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:05.749413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a5255-1221-438f-828a-c8c9f04f0b23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:05.750794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a5255-1221-438f-828a-c8c9f04f0b23 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:05.755804 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 450/947] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Sep 27 16:18:05 2022] GET /identity/v3/endpoints?service_id=0ab591ab030c497b8f522bf560311c8b&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:05.756670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a5255-1221-438f-828a-c8c9f04f0b23 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:05.785967 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68373ad-c21f-49b4-8cf9-adc856eb0126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:05.786892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68373ad-c21f-49b4-8cf9-adc856eb0126 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:05.787578 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68373ad-c21f-49b4-8cf9-adc856eb0126 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:05.788477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68373ad-c21f-49b4-8cf9-adc856eb0126 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:05.789596 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68373ad-c21f-49b4-8cf9-adc856eb0126 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:05.790096 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68373ad-c21f-49b4-8cf9-adc856eb0126 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:05.792109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68373ad-c21f-49b4-8cf9-adc856eb0126 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:05.800107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:05.812270 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 498/948] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:05.814363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68373ad-c21f-49b4-8cf9-adc856eb0126 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:05.864735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a5255-1221-438f-828a-c8c9f04f0b23 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:05.866350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:05.901149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6896af-9023-46b5-a5f5-fb6344676ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:05.901713 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6896af-9023-46b5-a5f5-fb6344676ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:05.901994 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6896af-9023-46b5-a5f5-fb6344676ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:05.902263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6896af-9023-46b5-a5f5-fb6344676ca7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:05.909775 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6896af-9023-46b5-a5f5-fb6344676ca7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:05.911517 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6896af-9023-46b5-a5f5-fb6344676ca7 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:05.920800 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68373ad-c21f-49b4-8cf9-adc856eb0126 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:05.926089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-fc6896af-9023-46b5-a5f5-fb6344676ca7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:18:05.926089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:05.926089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:05.926089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:05.926089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:05.926089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:05.926089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:05.926089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:05.926089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:05.926089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:05.926089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:05.926089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:05.926089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:18:05.926089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:18:05.926089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:18:05.926982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:18:05.926982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:05.926982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:05.926982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:05.926982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:05.926982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:05.926982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:05.926982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:05.926982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:05.926982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:05.926982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:05.926982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:05.926982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:05.926982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:05.926982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:05.926982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:05.926982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:05.932916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:18:05.932916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:18:05.932916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:18:05.932916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:18:05.932916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:18:05.932916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:18:05.932916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:18:05.932916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:05.932916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 451/949] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:18:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:05.932916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6896af-9023-46b5-a5f5-fb6344676ca7 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:05.956827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a04457-b9e4-4d95-a648-b06b2c3d23bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:05.957858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a04457-b9e4-4d95-a648-b06b2c3d23bd None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:05.958144 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a04457-b9e4-4d95-a648-b06b2c3d23bd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:05.958419 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a04457-b9e4-4d95-a648-b06b2c3d23bd None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:05.959172 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a04457-b9e4-4d95-a648-b06b2c3d23bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:05.960562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a04457-b9e4-4d95-a648-b06b2c3d23bd None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:05.976417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 499/950] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Sep 27 16:18:05 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:18:05.976417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a04457-b9e4-4d95-a648-b06b2c3d23bd None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:06.060713 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6896af-9023-46b5-a5f5-fb6344676ca7 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:06.063302 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:06.097277 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc0a62-63f4-4add-9ab8-6b9c5f62f07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:06.098022 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc0a62-63f4-4add-9ab8-6b9c5f62f07b None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:06.098376 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc0a62-63f4-4add-9ab8-6b9c5f62f07b None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:06.098720 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc0a62-63f4-4add-9ab8-6b9c5f62f07b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:06.106608 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc0a62-63f4-4add-9ab8-6b9c5f62f07b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:06.108087 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc0a62-63f4-4add-9ab8-6b9c5f62f07b None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:06.110217 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a04457-b9e4-4d95-a648-b06b2c3d23bd None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:06.120357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-5ccc0a62-63f4-4add-9ab8-6b9c5f62f07b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:18:06.120357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:06.120357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:06.120357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:06.120357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:06.120357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:06.120357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:06.120357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:06.120357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:06.120357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:06.120357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:06.120357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:06.120357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:18:06.120357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:18:06.120357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:18:06.122167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:18:06.122167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:06.122167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:06.122167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:06.122167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:06.122167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:06.122167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:06.122167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:06.122167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:06.122167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:06.122167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:06.122167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:06.122167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:06.122167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:06.122167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:06.122167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:06.122167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:06.123094 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:18:06.123094 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:18:06.123094 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:18:06.123094 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:18:06.123094 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:18:06.123094 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:18:06.123094 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:18:06.123094 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:06.123094 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 452/951] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:18:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:06.128064 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc0a62-63f4-4add-9ab8-6b9c5f62f07b None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:06.133506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:06.161146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22c59e-d123-41d4-a774-a1eb2ed81b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:06.162549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22c59e-d123-41d4-a774-a1eb2ed81b8c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:06.163323 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22c59e-d123-41d4-a774-a1eb2ed81b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:06.164887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22c59e-d123-41d4-a774-a1eb2ed81b8c None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:06.166343 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22c59e-d123-41d4-a774-a1eb2ed81b8c None admin] RBAC: Adding query filter params (name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:06.166892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22c59e-d123-41d4-a774-a1eb2ed81b8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:06.169260 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22c59e-d123-41d4-a774-a1eb2ed81b8c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:06.193503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 500/952] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 27 16:18:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:06.250431 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc0a62-63f4-4add-9ab8-6b9c5f62f07b None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:06.289782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64167f6-efd4-45ec-9045-83e78bafab37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:06.290771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64167f6-efd4-45ec-9045-83e78bafab37 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:06.291276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64167f6-efd4-45ec-9045-83e78bafab37 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:06.291757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64167f6-efd4-45ec-9045-83e78bafab37 None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:06.292701 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64167f6-efd4-45ec-9045-83e78bafab37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:06.293781 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64167f6-efd4-45ec-9045-83e78bafab37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:06.295746 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64167f6-efd4-45ec-9045-83e78bafab37 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:06.311435 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 453/953] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:18:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:06.317874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22c59e-d123-41d4-a774-a1eb2ed81b8c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:06.430422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22c59e-d123-41d4-a774-a1eb2ed81b8c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:06.466593 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db6ce9-d261-4a11-bbf0-a858afa40407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:06.467714 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db6ce9-d261-4a11-bbf0-a858afa40407 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:06.468181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db6ce9-d261-4a11-bbf0-a858afa40407 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:06.468657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db6ce9-d261-4a11-bbf0-a858afa40407 None admin] PATH_INFO: `/v3/projects/ad230723d90a439daf38443915c2282f/users/0c8d0a718e8347b5af397f866056266e/roles/550538ff801d4fd08b79738d5b5897f6` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:06.471207 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db6ce9-d261-4a11-bbf0-a858afa40407 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad230723d90a439daf38443915c2282f, user_id=0c8d0a718e8347b5af397f866056266e, role_id=550538ff801d4fd08b79738d5b5897f6)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:06.472841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db6ce9-d261-4a11-bbf0-a858afa40407 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:06.548483 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 501/954] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:18:06 2022] PUT /identity/v3/projects/ad230723d90a439daf38443915c2282f/users/0c8d0a718e8347b5af397f866056266e/roles/550538ff801d4fd08b79738d5b5897f6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:18:06.885312 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea751b3b-1a41-433f-b1be-acabc8c817ef None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:06.885864 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea751b3b-1a41-433f-b1be-acabc8c817ef None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:06.885864 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea751b3b-1a41-433f-b1be-acabc8c817ef None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:06.887981 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 454/955] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:06.893733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3081e-b057-40fd-833e-c7c627a9fc9e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:06.894146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3081e-b057-40fd-833e-c7c627a9fc9e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:06.894321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3081e-b057-40fd-833e-c7c627a9fc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:06.912856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1bd3081e-b057-40fd-833e-c7c627a9fc9e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:06.914378 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1bd3081e-b057-40fd-833e-c7c627a9fc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:06.942694 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:06.992504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 502/956] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:07.257762 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea751b3b-1a41-433f-b1be-acabc8c817ef None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:07.283853 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:07.372587 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea751b3b-1a41-433f-b1be-acabc8c817ef None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:07.408040 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4f228-ef6c-44ea-8938-40b9f0cba4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:07.408671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4f228-ef6c-44ea-8938-40b9f0cba4d0 None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:07.408945 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4f228-ef6c-44ea-8938-40b9f0cba4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:07.409209 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4f228-ef6c-44ea-8938-40b9f0cba4d0 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:07.409860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4f228-ef6c-44ea-8938-40b9f0cba4d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:07.411223 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4f228-ef6c-44ea-8938-40b9f0cba4d0 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:07.502553 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 455/957] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 27 16:18:07 2022] POST /identity/v3/services => generated 242 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:18:08.331693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d4aae-9f9e-43d0-8304-dddf14b0b1ec None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:08.332803 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d4aae-9f9e-43d0-8304-dddf14b0b1ec None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:08.332803 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d4aae-9f9e-43d0-8304-dddf14b0b1ec None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:08.333969 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 503/958] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:08.339320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c02d03-b9d1-4c6b-838b-ae5d25031fe6 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:08.339725 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c02d03-b9d1-4c6b-838b-ae5d25031fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:08.339951 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c02d03-b9d1-4c6b-838b-ae5d25031fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:08.359396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-87c02d03-b9d1-4c6b-838b-ae5d25031fe6 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:08.360647 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-87c02d03-b9d1-4c6b-838b-ae5d25031fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:08.441500 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 456/959] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:08.561028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467949db-beae-40ee-b180-e6b58aead621 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:08.561344 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467949db-beae-40ee-b180-e6b58aead621 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:08.561573 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467949db-beae-40ee-b180-e6b58aead621 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:08.563147 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 504/960] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:08.568455 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f59a7c-d957-4e2d-9a6f-4321da627427 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:08.568746 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f59a7c-d957-4e2d-9a6f-4321da627427 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:08.569019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f59a7c-d957-4e2d-9a6f-4321da627427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:08.587739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-61f59a7c-d957-4e2d-9a6f-4321da627427 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:08.588879 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-61f59a7c-d957-4e2d-9a6f-4321da627427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:08.591304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:08.666708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 457/961] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:08.728624 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467949db-beae-40ee-b180-e6b58aead621 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:08.729104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e06f2-a0e1-4227-bc43-cb9ffa4bc97f None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:08.729392 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e06f2-a0e1-4227-bc43-cb9ffa4bc97f None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:08.729668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e06f2-a0e1-4227-bc43-cb9ffa4bc97f None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:08.731893 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 458/962] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:18:08.736851 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f5a0f-6c84-4dd4-b3d4-2c8ccc761d95 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:08.737131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f5a0f-6c84-4dd4-b3d4-2c8ccc761d95 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:08.737406 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f5a0f-6c84-4dd4-b3d4-2c8ccc761d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:08.755595 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-e54f5a0f-6c84-4dd4-b3d4-2c8ccc761d95 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:08.756798 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-e54f5a0f-6c84-4dd4-b3d4-2c8ccc761d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:08.844586 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 459/963] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:18:08.852031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467949db-beae-40ee-b180-e6b58aead621 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:08.888152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cd1df-a7dc-494b-96a5-8778baab6db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:08.888806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cd1df-a7dc-494b-96a5-8778baab6db8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:08.889089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cd1df-a7dc-494b-96a5-8778baab6db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:08.889364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cd1df-a7dc-494b-96a5-8778baab6db8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:08.889940 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cd1df-a7dc-494b-96a5-8778baab6db8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:08.891299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cd1df-a7dc-494b-96a5-8778baab6db8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:08.900068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-c83cd1df-a7dc-494b-96a5-8778baab6db8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 16:18:08.900068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:08.900068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:18:08.900068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:18:08.900068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:18:08.900068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:18:08.900068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:18:08.900068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:08.900068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 16:18:08.900068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:08.900068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:18:08.900068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:08.900068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:08.900068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:08.900068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:08.900068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:08.900068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:08.901211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:08.901211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:08.901211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:08.901211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:08.901211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:08.901211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:08.901211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:18:08.901211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:18:08.901211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:18:08.901211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:18:08.901211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:08.901211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:08.901211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:08.901211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:08.901211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:08.901211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:08.903341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:08.903341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:08.903341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:08.903341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:08.903341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:08.903341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:08.903341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:08.903341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:08.903341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:08.903341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:08.903341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:18:08.903341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:08.903341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 16:18:08.903341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:08.903341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 505/964] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 27 16:18:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:18:08.907871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f5a0f-6c84-4dd4-b3d4-2c8ccc761d95 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:08.955887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cd1df-a7dc-494b-96a5-8778baab6db8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:08.988553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:08.994802 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:09.022643 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f5a0f-6c84-4dd4-b3d4-2c8ccc761d95 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:09.064119 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcc6da-5368-4cc0-9ccc-9b06036fb1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:09.064830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcc6da-5368-4cc0-9ccc-9b06036fb1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:09.065113 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcc6da-5368-4cc0-9ccc-9b06036fb1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:09.065385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcc6da-5368-4cc0-9ccc-9b06036fb1a9 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:09.066275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcc6da-5368-4cc0-9ccc-9b06036fb1a9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:09.066576 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcc6da-5368-4cc0-9ccc-9b06036fb1a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:09.068109 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcc6da-5368-4cc0-9ccc-9b06036fb1a9 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:09.076368 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 460/965] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 27 16:18:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:09.080614 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cd1df-a7dc-494b-96a5-8778baab6db8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:09.080850 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcc6da-5368-4cc0-9ccc-9b06036fb1a9 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:09.126313 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364948ef-9a52-4faa-8162-b8b4595ccac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:09.126843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364948ef-9a52-4faa-8162-b8b4595ccac7 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:09.127119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364948ef-9a52-4faa-8162-b8b4595ccac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:09.127835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364948ef-9a52-4faa-8162-b8b4595ccac7 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:09.128606 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364948ef-9a52-4faa-8162-b8b4595ccac7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:09.130730 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364948ef-9a52-4faa-8162-b8b4595ccac7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:09.180282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.sql.core [None req-364948ef-9a52-4faa-8162-b8b4595ccac7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 27 16:18:09.180282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 27 16:18:09.180282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [parameters: {'user_id': '7557bd1c7d9b493eb6a47b3b506c8593', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 27 16:18:09.180282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81631) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 27 16:18:09.185729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcc6da-5368-4cc0-9ccc-9b06036fb1a9 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:09.188062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-364948ef-9a52-4faa-8162-b8b4595ccac7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 27 16:18:09.188062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:09.188062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 16:18:09.188062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 16:18:09.188062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 16:18:09.188062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 16:18:09.188062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 16:18:09.188062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 16:18:09.188062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 16:18:09.188062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application conn.query(q) Sep 27 16:18:09.188062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 16:18:09.188062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 16:18:09.188062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 16:18:09.188062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result.read() Sep 27 16:18:09.188062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 16:18:09.189000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 16:18:09.189000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 16:18:09.189000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 16:18:09.189000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 16:18:09.189000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 16:18:09.189000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 16:18:09.189000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 16:18:09.189000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 27 16:18:09.189000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:09.189000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 27 16:18:09.189000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:09.189000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:09.189000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 27 16:18:09.189000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 27 16:18:09.189000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 27 16:18:09.189000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 27 16:18:09.189000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 16:18:09.189000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application next(self.gen) Sep 27 16:18:09.189986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 27 16:18:09.189986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application yield resource Sep 27 16:18:09.189986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 16:18:09.189986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application next(self.gen) Sep 27 16:18:09.189986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 27 16:18:09.189986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.session.rollback() Sep 27 16:18:09.189986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 16:18:09.189986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.force_reraise() Sep 27 16:18:09.189986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 16:18:09.189986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise self.value Sep 27 16:18:09.189986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 27 16:18:09.189986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 27 16:18:09.189986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 27 16:18:09.189986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application session.commit() Sep 27 16:18:09.189986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 27 16:18:09.189986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 27 16:18:09.189986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 27 16:18:09.190886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._prepare_impl() Sep 27 16:18:09.190886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 27 16:18:09.190886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.session.flush() Sep 27 16:18:09.190886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 27 16:18:09.190886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._flush(objects) Sep 27 16:18:09.190886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 27 16:18:09.190886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 27 16:18:09.190886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 27 16:18:09.190886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application compat.raise_( Sep 27 16:18:09.190886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 16:18:09.190886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception Sep 27 16:18:09.190886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 27 16:18:09.190886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application flush_context.execute() Sep 27 16:18:09.190886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 27 16:18:09.190886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rec.execute(self) Sep 27 16:18:09.190886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 27 16:18:09.190886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 27 16:18:09.192024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 27 16:18:09.192024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 27 16:18:09.192024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 27 16:18:09.192024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 27 16:18:09.192024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 27 16:18:09.192024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 27 16:18:09.192024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 27 16:18:09.192024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 27 16:18:09.192024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 27 16:18:09.192024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 27 16:18:09.192024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 27 16:18:09.192024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 27 16:18:09.192024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 27 16:18:09.192024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 27 16:18:09.192024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 16:18:09.192024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception Sep 27 16:18:09.193089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 16:18:09.193089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 16:18:09.193089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 16:18:09.193089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 16:18:09.193089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 16:18:09.193089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 16:18:09.193089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 16:18:09.193089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application conn.query(q) Sep 27 16:18:09.193089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 16:18:09.193089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 16:18:09.193089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 16:18:09.193089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result.read() Sep 27 16:18:09.193089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 16:18:09.193089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 16:18:09.193089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 16:18:09.193089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 16:18:09.194201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 16:18:09.194201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 16:18:09.194201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 16:18:09.194201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 16:18:09.194201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 27 16:18:09.194201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 27 16:18:09.194201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [parameters: {'user_id': '7557bd1c7d9b493eb6a47b3b506c8593', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 27 16:18:09.194201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 27 16:18:09.194201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:09.194201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:18:09.194201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:09.194201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:09.194201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:09.194201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:09.194201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:09.195192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:09.195192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:09.195192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:09.195192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:09.195192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:09.195192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:09.195192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:09.195192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 27 16:18:09.195192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 27 16:18:09.195192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:09.195192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:09.195192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:18:09.195192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:18:09.195192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:18:09.195192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:18:09.195192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 27 16:18:09.195192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 27 16:18:09.196362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 27 16:18:09.196362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 27 16:18:09.196362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 27 16:18:09.196362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 27 16:18:09.196362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 27 16:18:09.196362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:09.196362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 506/966] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Sep 27 16:18:08 2022] POST /identity/v3/users => generated 160 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:18:09.196362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364948ef-9a52-4faa-8162-b8b4595ccac7 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:09.226916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:09.233299 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf00b04-cbab-4518-a3d4-29916392412d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:09.235390 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf00b04-cbab-4518-a3d4-29916392412d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:09.235390 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf00b04-cbab-4518-a3d4-29916392412d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:09.235390 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf00b04-cbab-4518-a3d4-29916392412d None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:09.235390 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf00b04-cbab-4518-a3d4-29916392412d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:09.235390 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf00b04-cbab-4518-a3d4-29916392412d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:09.237194 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf00b04-cbab-4518-a3d4-29916392412d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:09.249008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 461/967] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 27 16:18:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:09.249008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf00b04-cbab-4518-a3d4-29916392412d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:09.289076 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:09.300081 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364948ef-9a52-4faa-8162-b8b4595ccac7 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:09.335380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9ed54-6b02-4b00-97ef-e2bd8eef1829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:09.336033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9ed54-6b02-4b00-97ef-e2bd8eef1829 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:09.336299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9ed54-6b02-4b00-97ef-e2bd8eef1829 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:09.336617 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9ed54-6b02-4b00-97ef-e2bd8eef1829 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:09.348462 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9ed54-6b02-4b00-97ef-e2bd8eef1829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:18:09.353379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-31f9ed54-6b02-4b00-97ef-e2bd8eef1829 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 16:18:09.353379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:09.353379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:09.353379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:09.353379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:09.353379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:09.353379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:09.353379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:09.353379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:09.353379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:09.353379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:09.353379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:09.353379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:18:09.353379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:18:09.353379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:18:09.353379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:18:09.354326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:18:09.354326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:18:09.354326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:18:09.354326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:18:09.354326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:09.354326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:09.354326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:09.354326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:09.354326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:09.354326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:09.354326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:09.354326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:09.354326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:09.354326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:09.354326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:09.354326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:09.355240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:09.355240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:09.355240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:09.355240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:09.355240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:18:09.355240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:18:09.355240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:18:09.355240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:18:09.355240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:18:09.355240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:18:09.355240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 16:18:09.355240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:09.355240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 507/968] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Sep 27 16:18:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:09.357381 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9ed54-6b02-4b00-97ef-e2bd8eef1829 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:09.365312 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf00b04-cbab-4518-a3d4-29916392412d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:09.399219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928d4e1-1a8d-40e0-872f-963f9c04e735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:09.399771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928d4e1-1a8d-40e0-872f-963f9c04e735 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:09.400048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928d4e1-1a8d-40e0-872f-963f9c04e735 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:09.400633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928d4e1-1a8d-40e0-872f-963f9c04e735 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:09.408640 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928d4e1-1a8d-40e0-872f-963f9c04e735 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:09.410125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928d4e1-1a8d-40e0-872f-963f9c04e735 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:09.422325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-0928d4e1-1a8d-40e0-872f-963f9c04e735 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 16:18:09.422325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:09.422325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:09.422325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:09.422325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:09.422325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:09.422325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:09.422325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:09.422325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:09.422325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:09.422325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:09.422325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:09.422325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:18:09.422325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:18:09.422325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:18:09.422325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:18:09.423275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:09.423275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:09.423275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:18:09.423275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:18:09.423275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:18:09.423275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:18:09.423275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:09.423275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:09.423275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:09.423275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:09.423275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:09.423275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:09.423275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:09.423275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:09.423275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:09.423275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:09.423275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:09.423275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:09.424253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:09.424253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:09.424253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:18:09.424253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:18:09.424253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:18:09.424253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:18:09.424253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:18:09.424253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:18:09.424253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 16:18:09.424253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:09.424253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 462/969] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:18:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:09.424253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928d4e1-1a8d-40e0-872f-963f9c04e735 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:09.468504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9ed54-6b02-4b00-97ef-e2bd8eef1829 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:09.479427 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:09.506397 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47080e7-efff-4dd0-8c53-9573cc7fe31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:09.506999 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47080e7-efff-4dd0-8c53-9573cc7fe31e None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:09.507274 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47080e7-efff-4dd0-8c53-9573cc7fe31e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:09.507543 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47080e7-efff-4dd0-8c53-9573cc7fe31e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:09.508200 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47080e7-efff-4dd0-8c53-9573cc7fe31e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:09.509813 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47080e7-efff-4dd0-8c53-9573cc7fe31e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:09.524681 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928d4e1-1a8d-40e0-872f-963f9c04e735 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:09.559334 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e11daf-bbf7-4a37-8027-d0da586eafec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:09.559934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e11daf-bbf7-4a37-8027-d0da586eafec None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:09.560211 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e11daf-bbf7-4a37-8027-d0da586eafec None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:09.560515 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e11daf-bbf7-4a37-8027-d0da586eafec None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:09.561168 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e11daf-bbf7-4a37-8027-d0da586eafec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:09.561465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e11daf-bbf7-4a37-8027-d0da586eafec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:09.562918 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e11daf-bbf7-4a37-8027-d0da586eafec None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:09.571131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 463/970] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Sep 27 16:18:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:09.571925 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e11daf-bbf7-4a37-8027-d0da586eafec None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:09.584439 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 508/971] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:18:09 2022] POST /identity/v3/endpoints => generated 349 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:18:09.594772 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47080e7-efff-4dd0-8c53-9573cc7fe31e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:09.600997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:09.720771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e11daf-bbf7-4a37-8027-d0da586eafec None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:09.729399 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47080e7-efff-4dd0-8c53-9573cc7fe31e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:09.740019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:09.759586 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50746a-8422-4f76-9b18-eb77d2748c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:09.760212 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50746a-8422-4f76-9b18-eb77d2748c15 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:09.760540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50746a-8422-4f76-9b18-eb77d2748c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:09.760817 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50746a-8422-4f76-9b18-eb77d2748c15 None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:09.761529 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50746a-8422-4f76-9b18-eb77d2748c15 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:09.762362 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50746a-8422-4f76-9b18-eb77d2748c15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:09.763913 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50746a-8422-4f76-9b18-eb77d2748c15 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:09.768177 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd4101-d5b9-47f3-b231-c93fdd552a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:09.768856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd4101-d5b9-47f3-b231-c93fdd552a41 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:09.769125 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd4101-d5b9-47f3-b231-c93fdd552a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:09.769399 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd4101-d5b9-47f3-b231-c93fdd552a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:09.781301 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd4101-d5b9-47f3-b231-c93fdd552a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:09.782770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd4101-d5b9-47f3-b231-c93fdd552a41 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:09.801508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 464/972] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 27 16:18:09 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:09.801676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-36dd4101-d5b9-47f3-b231-c93fdd552a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:09.801676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:09.801676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:09.801676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:09.801676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:09.801676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:09.801676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:09.801676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:09.801676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:09.801676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:09.801676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:09.801676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:09.801676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:18:09.801676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:18:09.801676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:18:09.801676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:18:09.802583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:09.802583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:09.802583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:09.802583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:09.802583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:09.802583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:09.802583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:09.802583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:09.802583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:09.802583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:09.802583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:09.802583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:09.802583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:09.802583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:09.802583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:09.802583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:09.802583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:18:09.803506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:18:09.803506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:09.803506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:09.803698 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81959790-9388-437c-9b0a-743e01d93db3 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:09.803698 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81959790-9388-437c-9b0a-743e01d93db3 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:09.803698 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81959790-9388-437c-9b0a-743e01d93db3 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:09.805019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 465/973] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:09.808656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 509/974] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:09.813095 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd4101-d5b9-47f3-b231-c93fdd552a41 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:09.813672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf768c6-39fb-4255-a292-d4f9aa863d12 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:09.813973 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf768c6-39fb-4255-a292-d4f9aa863d12 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:09.814242 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf768c6-39fb-4255-a292-d4f9aa863d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:09.837823 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-eaf768c6-39fb-4255-a292-d4f9aa863d12 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:09.839073 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-eaf768c6-39fb-4255-a292-d4f9aa863d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:09.898156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:09.916408 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 466/975] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:09.950019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd4101-d5b9-47f3-b231-c93fdd552a41 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:09.990975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933912b-4dc4-4927-a9a5-423ce2d956e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:09.991500 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933912b-4dc4-4927-a9a5-423ce2d956e7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:09.991772 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933912b-4dc4-4927-a9a5-423ce2d956e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:09.992040 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933912b-4dc4-4927-a9a5-423ce2d956e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:09.992710 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933912b-4dc4-4927-a9a5-423ce2d956e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:09.993009 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933912b-4dc4-4927-a9a5-423ce2d956e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:09.994366 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933912b-4dc4-4927-a9a5-423ce2d956e7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:10.007610 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 510/976] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:10.013393 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf768c6-39fb-4255-a292-d4f9aa863d12 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:10.122326 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf768c6-39fb-4255-a292-d4f9aa863d12 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:10.129505 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:10.157376 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b15c4-acd0-41a6-80d3-d8a748b17db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:10.158503 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b15c4-acd0-41a6-80d3-d8a748b17db8 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:10.159129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b15c4-acd0-41a6-80d3-d8a748b17db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:10.159897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b15c4-acd0-41a6-80d3-d8a748b17db8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:10.167087 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b15c4-acd0-41a6-80d3-d8a748b17db8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:10.168717 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b15c4-acd0-41a6-80d3-d8a748b17db8 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:10.180442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-585b15c4-acd0-41a6-80d3-d8a748b17db8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 16:18:10.180442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:10.180442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:10.180442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:10.180442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:10.180442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:10.180442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:10.180442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:10.180442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:10.180442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:10.180442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:10.180442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:10.180442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:18:10.180442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:18:10.180442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:18:10.180442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:18:10.181420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:10.181420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:10.181420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:18:10.181420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:18:10.181420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:18:10.181420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:18:10.181420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:10.181420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:10.181420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:10.181420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:10.181420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:10.181420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:10.181420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:10.181420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:10.181420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:10.181420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:10.181420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:10.181420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:10.182399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:10.182399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:10.182399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:18:10.182399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:18:10.182399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:18:10.182399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:18:10.182399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:18:10.182399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:18:10.182399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 16:18:10.182399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:10.182399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 467/977] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 27 16:18:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:18:10.187913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933912b-4dc4-4927-a9a5-423ce2d956e7 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:10.221522 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b15c4-acd0-41a6-80d3-d8a748b17db8 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:10.302655 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933912b-4dc4-4927-a9a5-423ce2d956e7 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:10.325308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b15c4-acd0-41a6-80d3-d8a748b17db8 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:10.326105 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:10.349016 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814eb18-b0b1-4938-b34d-7e24335a6874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:10.350333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814eb18-b0b1-4938-b34d-7e24335a6874 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:10.350780 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814eb18-b0b1-4938-b34d-7e24335a6874 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:10.351059 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814eb18-b0b1-4938-b34d-7e24335a6874 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:10.351784 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814eb18-b0b1-4938-b34d-7e24335a6874 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:10.352095 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814eb18-b0b1-4938-b34d-7e24335a6874 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:10.354069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814eb18-b0b1-4938-b34d-7e24335a6874 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:10.361977 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94b8ff-9c8e-45b8-8840-ff3e5d864425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:10.362609 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94b8ff-9c8e-45b8-8840-ff3e5d864425 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:10.363281 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94b8ff-9c8e-45b8-8840-ff3e5d864425 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:10.363281 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94b8ff-9c8e-45b8-8840-ff3e5d864425 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:10.363715 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94b8ff-9c8e-45b8-8840-ff3e5d864425 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:10.365112 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94b8ff-9c8e-45b8-8840-ff3e5d864425 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:10.374055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 511/978] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Sep 27 16:18:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:10.374207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-8d94b8ff-9c8e-45b8-8840-ff3e5d864425 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 16:18:10.374207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:10.374207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:18:10.374207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:18:10.374207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:18:10.374207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:18:10.374207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:18:10.374207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:10.374207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 16:18:10.374207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:10.374207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:18:10.374207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:10.374207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:10.374207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:10.374207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:10.374207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:10.374207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:10.375642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:10.375642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:10.375642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:10.375642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:10.375642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:10.375642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:10.375642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:18:10.375642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:18:10.375642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:18:10.375642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:18:10.375642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:10.375642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:10.375642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:10.375642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:10.375642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:10.375642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:10.376554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:10.376554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:10.376554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:10.376554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:10.376554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:10.376554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:10.376554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:10.376554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:10.376554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:10.376554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:10.376554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:18:10.376554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:10.376554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 16:18:10.376554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:10.376554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 468/979] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:18:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:18:10.379781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814eb18-b0b1-4938-b34d-7e24335a6874 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:10.381978 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94b8ff-9c8e-45b8-8840-ff3e5d864425 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:10.413566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:10.485698 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94b8ff-9c8e-45b8-8840-ff3e5d864425 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:10.489004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814eb18-b0b1-4938-b34d-7e24335a6874 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:10.521257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9b61f-4ab9-40e9-a691-e121784b27e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:10.521863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9b61f-4ab9-40e9-a691-e121784b27e0 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:10.522146 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9b61f-4ab9-40e9-a691-e121784b27e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:10.522464 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9b61f-4ab9-40e9-a691-e121784b27e0 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:10.523043 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9b61f-4ab9-40e9-a691-e121784b27e0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:10.523352 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9b61f-4ab9-40e9-a691-e121784b27e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:10.523600 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4651b60-f4f0-4280-ad63-a433164763c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:10.524204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4651b60-f4f0-4280-ad63-a433164763c1 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:10.524513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4651b60-f4f0-4280-ad63-a433164763c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:10.524783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9b61f-4ab9-40e9-a691-e121784b27e0 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:10.524893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4651b60-f4f0-4280-ad63-a433164763c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:10.534617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 469/980] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 27 16:18:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:10.535602 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9b61f-4ab9-40e9-a691-e121784b27e0 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:10.576978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:10.606820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4651b60-f4f0-4280-ad63-a433164763c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:10.608415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4651b60-f4f0-4280-ad63-a433164763c1 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:10.634694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:10.642317 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9b61f-4ab9-40e9-a691-e121784b27e0 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:10.682907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621a38e-9704-4048-a38b-c7e176b3563a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:10.683540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621a38e-9704-4048-a38b-c7e176b3563a None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:10.683823 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621a38e-9704-4048-a38b-c7e176b3563a None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:10.684098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621a38e-9704-4048-a38b-c7e176b3563a None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:10.684756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621a38e-9704-4048-a38b-c7e176b3563a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:10.685063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621a38e-9704-4048-a38b-c7e176b3563a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:10.686423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621a38e-9704-4048-a38b-c7e176b3563a None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:10.695922 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 470/981] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 27 16:18:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:10.697024 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621a38e-9704-4048-a38b-c7e176b3563a None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:10.720494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 512/982] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:18:10 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 27 16:18:10.723531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4651b60-f4f0-4280-ad63-a433164763c1 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:10.801765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:10.806736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621a38e-9704-4048-a38b-c7e176b3563a None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:10.834326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4651b60-f4f0-4280-ad63-a433164763c1 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:10.841504 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd75481-81f3-4a1f-adc5-c9c114f9b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:10.842120 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd75481-81f3-4a1f-adc5-c9c114f9b99d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:10.842402 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd75481-81f3-4a1f-adc5-c9c114f9b99d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:10.842686 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd75481-81f3-4a1f-adc5-c9c114f9b99d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:10.843383 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd75481-81f3-4a1f-adc5-c9c114f9b99d None admin] RBAC: Adding query filter params (interface=public, service_id=06cbf484c34948b3ade8ed62df737121, region_id=RegionOne) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:10.843698 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd75481-81f3-4a1f-adc5-c9c114f9b99d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:10.845101 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd75481-81f3-4a1f-adc5-c9c114f9b99d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:10.850480 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 471/983] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Sep 27 16:18:10 2022] GET /identity/v3/endpoints?service_id=06cbf484c34948b3ade8ed62df737121&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:10.855691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd75481-81f3-4a1f-adc5-c9c114f9b99d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:10.875908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38003f4-d733-4558-b870-620a1d9d4e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:10.876574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38003f4-d733-4558-b870-620a1d9d4e52 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:10.876852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38003f4-d733-4558-b870-620a1d9d4e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:10.877120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38003f4-d733-4558-b870-620a1d9d4e52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:10.881352 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:10.892677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38003f4-d733-4558-b870-620a1d9d4e52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:10.892677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38003f4-d733-4558-b870-620a1d9d4e52 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:10.905805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-f38003f4-d733-4558-b870-620a1d9d4e52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:10.905805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:10.905805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:10.905805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:10.905805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:10.905805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:10.905805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:10.905805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:10.905805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:10.905805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:10.905805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:10.905805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:10.905805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:18:10.905805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:18:10.905805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:18:10.905805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:18:10.906827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:10.906827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:10.906827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:10.906827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:10.906827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:10.906827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:10.906827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:10.906827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:10.906827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:10.906827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:10.906827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:10.906827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:10.906827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:10.906827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:10.906827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:10.906827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:10.906827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:18:10.907753 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:18:10.907753 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:10.907753 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:10.907753 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 513/984] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:18:10.912421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38003f4-d733-4558-b870-620a1d9d4e52 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:10.967115 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd75481-81f3-4a1f-adc5-c9c114f9b99d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:11.000576 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ca31a-efb6-4887-aaa3-35f00e7ec570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:11.001283 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ca31a-efb6-4887-aaa3-35f00e7ec570 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:11.001564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ca31a-efb6-4887-aaa3-35f00e7ec570 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:11.001842 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ca31a-efb6-4887-aaa3-35f00e7ec570 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:11.002426 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ca31a-efb6-4887-aaa3-35f00e7ec570 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:11.003790 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ca31a-efb6-4887-aaa3-35f00e7ec570 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:11.009936 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 472/985] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Sep 27 16:18:10 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:18:11.020227 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38003f4-d733-4558-b870-620a1d9d4e52 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:11.046848 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:11.058994 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60b8c9-3569-419e-993a-bbb1c356d35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:11.061371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b8c9-3569-419e-993a-bbb1c356d35c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:11.061371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b8c9-3569-419e-993a-bbb1c356d35c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:11.061371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b8c9-3569-419e-993a-bbb1c356d35c None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:11.061371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60b8c9-3569-419e-993a-bbb1c356d35c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:11.061371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60b8c9-3569-419e-993a-bbb1c356d35c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:11.062981 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60b8c9-3569-419e-993a-bbb1c356d35c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:11.082599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 514/986] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:11.083402 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ca31a-efb6-4887-aaa3-35f00e7ec570 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:11.174240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:11.191965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ca31a-efb6-4887-aaa3-35f00e7ec570 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:11.227321 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f3f43-8da7-4fa4-8475-8acc8c560275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:11.227958 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f3f43-8da7-4fa4-8475-8acc8c560275 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:11.228236 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f3f43-8da7-4fa4-8475-8acc8c560275 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:11.228535 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f3f43-8da7-4fa4-8475-8acc8c560275 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:11.235771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f3f43-8da7-4fa4-8475-8acc8c560275 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:11.237277 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f3f43-8da7-4fa4-8475-8acc8c560275 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:11.248908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-452f3f43-8da7-4fa4-8475-8acc8c560275 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:18:11.248908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:11.248908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:11.248908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:11.248908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:11.248908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:11.248908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:11.248908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:11.248908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:11.248908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:11.248908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:11.248908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:11.248908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:18:11.248908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:18:11.248908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:18:11.250015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:18:11.250015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:11.250015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:11.250015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:11.250015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:11.250015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:11.250015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:11.250015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:11.250015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:11.250015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:11.250015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:11.250015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:11.250015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:11.250015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:11.250015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:11.250015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:11.250015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:11.251157 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:18:11.251157 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:18:11.251157 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:18:11.251157 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:18:11.251157 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:18:11.251157 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:18:11.251157 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:18:11.251157 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:11.251157 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 473/987] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:18:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:18:11.257597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60b8c9-3569-419e-993a-bbb1c356d35c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:11.361346 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60b8c9-3569-419e-993a-bbb1c356d35c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:11.396654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2422d84-d407-464d-9739-3976443dfa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:11.397265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2422d84-d407-464d-9739-3976443dfa70 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:11.397546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2422d84-d407-464d-9739-3976443dfa70 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:11.397821 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2422d84-d407-464d-9739-3976443dfa70 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:11.398505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2422d84-d407-464d-9739-3976443dfa70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:11.398828 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2422d84-d407-464d-9739-3976443dfa70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:11.400232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2422d84-d407-464d-9739-3976443dfa70 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:11.416948 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 515/988] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:18:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:11.418718 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f3f43-8da7-4fa4-8475-8acc8c560275 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:11.524538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f3f43-8da7-4fa4-8475-8acc8c560275 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:11.558178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42cc333-c982-46ba-872e-3f803be531c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:11.559340 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cc333-c982-46ba-872e-3f803be531c8 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:11.559606 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cc333-c982-46ba-872e-3f803be531c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:11.559876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cc333-c982-46ba-872e-3f803be531c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:11.560616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42cc333-c982-46ba-872e-3f803be531c8 None admin] RBAC: Adding query filter params (role.id=550538ff801d4fd08b79738d5b5897f6, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=0c8d0a718e8347b5af397f866056266e) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:11.560925 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42cc333-c982-46ba-872e-3f803be531c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:11.562362 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42cc333-c982-46ba-872e-3f803be531c8 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:11.568368 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 474/989] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:18:11 2022] GET /identity/v3/role_assignments?user.id=0c8d0a718e8347b5af397f866056266e&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=550538ff801d4fd08b79738d5b5897f6 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:11.851110 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e609c-58c5-4709-96a6-393e2161cf8a None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:11.851410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e609c-58c5-4709-96a6-393e2161cf8a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:11.851664 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e609c-58c5-4709-96a6-393e2161cf8a None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:11.853188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 516/990] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:11.858969 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eac3a3-04a2-4672-8db0-21dd73af5842 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:11.859260 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eac3a3-04a2-4672-8db0-21dd73af5842 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:11.859540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eac3a3-04a2-4672-8db0-21dd73af5842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:11.877772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-19eac3a3-04a2-4672-8db0-21dd73af5842 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:11.878963 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-19eac3a3-04a2-4672-8db0-21dd73af5842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:11.881875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:11.948684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 475/991] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:12.216543 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e609c-58c5-4709-96a6-393e2161cf8a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:12.263660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:12.321034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e609c-58c5-4709-96a6-393e2161cf8a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:12.354809 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64019fbe-0d70-45e4-a614-64824efb4078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:12.355558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64019fbe-0d70-45e4-a614-64824efb4078 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:12.355902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64019fbe-0d70-45e4-a614-64824efb4078 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:12.356245 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64019fbe-0d70-45e4-a614-64824efb4078 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:12.356920 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64019fbe-0d70-45e4-a614-64824efb4078 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:12.358343 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64019fbe-0d70-45e4-a614-64824efb4078 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:12.367942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-64019fbe-0d70-45e4-a614-64824efb4078 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 16:18:12.367942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:12.367942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:18:12.367942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:18:12.367942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:18:12.367942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:18:12.367942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:18:12.367942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:12.367942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 16:18:12.367942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:12.367942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:18:12.367942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:12.367942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:12.367942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:12.367942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:12.367942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:12.367942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:12.369495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:12.369495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:12.369495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:12.369495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:12.369495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:12.369495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:12.369495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:18:12.369495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:18:12.369495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:18:12.369495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:18:12.369495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:12.369495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:12.369495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:12.369495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:12.369495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:12.369495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:12.370368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:12.370368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:12.370368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:12.370368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:12.370368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:12.370368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:12.370368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:12.370368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:12.370368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:12.370368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:12.370368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:18:12.370368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:12.370368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 16:18:12.370368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:12.372665 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 517/992] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 27 16:18:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:18:12.375611 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eac3a3-04a2-4672-8db0-21dd73af5842 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:12.473693 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eac3a3-04a2-4672-8db0-21dd73af5842 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:12.509639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707aa33-d2d2-495d-afca-fec97c417639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:12.510248 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707aa33-d2d2-495d-afca-fec97c417639 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:12.510528 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707aa33-d2d2-495d-afca-fec97c417639 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:12.510801 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707aa33-d2d2-495d-afca-fec97c417639 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:12.511422 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707aa33-d2d2-495d-afca-fec97c417639 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:12.512264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707aa33-d2d2-495d-afca-fec97c417639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:12.513693 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707aa33-d2d2-495d-afca-fec97c417639 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:12.518545 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 476/993] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 27 16:18:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:12.524156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64019fbe-0d70-45e4-a614-64824efb4078 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:12.623930 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64019fbe-0d70-45e4-a614-64824efb4078 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:12.633158 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:12.658201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37d4a0-6072-43cf-9fa4-9d27b95851fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:12.658806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37d4a0-6072-43cf-9fa4-9d27b95851fb None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:12.659083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37d4a0-6072-43cf-9fa4-9d27b95851fb None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:12.659352 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37d4a0-6072-43cf-9fa4-9d27b95851fb None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:12.659970 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37d4a0-6072-43cf-9fa4-9d27b95851fb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:12.660266 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37d4a0-6072-43cf-9fa4-9d27b95851fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:12.661684 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37d4a0-6072-43cf-9fa4-9d27b95851fb None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:12.667699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 518/994] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 27 16:18:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:12.672965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707aa33-d2d2-495d-afca-fec97c417639 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:12.676752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:12.775354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707aa33-d2d2-495d-afca-fec97c417639 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:12.816771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe39c11-db5e-4d2e-adc6-d260af248dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:12.817511 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe39c11-db5e-4d2e-adc6-d260af248dad None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:12.817893 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe39c11-db5e-4d2e-adc6-d260af248dad None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:12.818282 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe39c11-db5e-4d2e-adc6-d260af248dad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:12.819085 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe39c11-db5e-4d2e-adc6-d260af248dad None admin] RBAC: Adding query filter params (interface=admin, service_id=0ab591ab030c497b8f522bf560311c8b, region_id=RegionOne) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:12.819493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe39c11-db5e-4d2e-adc6-d260af248dad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:12.820975 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe39c11-db5e-4d2e-adc6-d260af248dad None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:12.830823 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 477/995] 10.222.0.26 () {56 vars in 1249 bytes} [Tue Sep 27 16:18:12 2022] GET /identity/v3/endpoints?service_id=0ab591ab030c497b8f522bf560311c8b&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:12.832179 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37d4a0-6072-43cf-9fa4-9d27b95851fb None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:12.933134 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37d4a0-6072-43cf-9fa4-9d27b95851fb None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:12.966475 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac31a0-2cc9-4961-b3fd-c99644fadfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:12.967083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac31a0-2cc9-4961-b3fd-c99644fadfc1 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:12.967364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac31a0-2cc9-4961-b3fd-c99644fadfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:12.967645 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac31a0-2cc9-4961-b3fd-c99644fadfc1 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:12.968245 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac31a0-2cc9-4961-b3fd-c99644fadfc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:12.969635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac31a0-2cc9-4961-b3fd-c99644fadfc1 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:12.976011 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 519/996] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Sep 27 16:18:12 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:18:13.180130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481606f-dd2a-4d6f-b6f9-ac6872d873a1 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:13.180318 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481606f-dd2a-4d6f-b6f9-ac6872d873a1 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:13.180619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481606f-dd2a-4d6f-b6f9-ac6872d873a1 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:13.182126 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 478/997] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:13.187659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52d880-cfa7-44a8-b88c-9c42f94e0c36 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:13.187945 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52d880-cfa7-44a8-b88c-9c42f94e0c36 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:13.188218 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52d880-cfa7-44a8-b88c-9c42f94e0c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:13.206857 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-8e52d880-cfa7-44a8-b88c-9c42f94e0c36 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:13.208374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8e52d880-cfa7-44a8-b88c-9c42f94e0c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:13.236809 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:13.276293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 520/998] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:13 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:13.543943 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481606f-dd2a-4d6f-b6f9-ac6872d873a1 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:13.612491 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:13.648354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481606f-dd2a-4d6f-b6f9-ac6872d873a1 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:13.685743 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbfc08-397d-4a2a-92aa-98001ac56592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:13.686379 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbfc08-397d-4a2a-92aa-98001ac56592 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:13.686657 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbfc08-397d-4a2a-92aa-98001ac56592 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:13.686926 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbfc08-397d-4a2a-92aa-98001ac56592 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:13.687496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbfc08-397d-4a2a-92aa-98001ac56592 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:13.688892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbfc08-397d-4a2a-92aa-98001ac56592 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:13.697709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-c4dbfc08-397d-4a2a-92aa-98001ac56592 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 16:18:13.697709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:13.697709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:18:13.697709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:18:13.697709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:18:13.697709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:18:13.697709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:18:13.697709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:13.697709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 16:18:13.697709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:13.697709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:18:13.697709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:13.697709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:13.697709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:13.697709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:13.697709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:13.697709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:13.698740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:13.698740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:13.698740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:13.698740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:13.698740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:13.698740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:13.698740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:18:13.698740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:18:13.698740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:18:13.698740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:18:13.698740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:13.698740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:13.698740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:13.698740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:13.698740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:13.698740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:13.700099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:13.700099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:13.700099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:13.700099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:13.700099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:13.700099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:13.700099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:13.700099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:13.700099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:13.700099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:13.700099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:18:13.700099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:13.700099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 16:18:13.700099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:13.701620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 479/999] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:18:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:13.705243 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52d880-cfa7-44a8-b88c-9c42f94e0c36 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:13.765037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e88914-daca-4378-8ce0-81be43de3181 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:13.765423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e88914-daca-4378-8ce0-81be43de3181 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:13.765705 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e88914-daca-4378-8ce0-81be43de3181 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:13.767128 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 480/1000] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:18:13.772377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254eb3c-a439-45d2-afc6-3c080a5edcc1 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:13.772377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254eb3c-a439-45d2-afc6-3c080a5edcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:13.772580 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254eb3c-a439-45d2-afc6-3c080a5edcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:13.791489 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-4254eb3c-a439-45d2-afc6-3c080a5edcc1 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:13.795945 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4254eb3c-a439-45d2-afc6-3c080a5edcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:13.812386 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52d880-cfa7-44a8-b88c-9c42f94e0c36 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:13.848928 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866aac6d-a0a9-4fa8-8341-902e19af2da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:13.849557 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866aac6d-a0a9-4fa8-8341-902e19af2da1 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:13.849841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866aac6d-a0a9-4fa8-8341-902e19af2da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:13.850118 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866aac6d-a0a9-4fa8-8341-902e19af2da1 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:13.850755 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866aac6d-a0a9-4fa8-8341-902e19af2da1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:13.851059 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866aac6d-a0a9-4fa8-8341-902e19af2da1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:13.852503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866aac6d-a0a9-4fa8-8341-902e19af2da1 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:13.858672 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 521/1001] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 27 16:18:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:13.864471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866aac6d-a0a9-4fa8-8341-902e19af2da1 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:13.871169 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 481/1002] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:13 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:18:13.897005 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:13.965959 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866aac6d-a0a9-4fa8-8341-902e19af2da1 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:13.999101 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f534480-1d2c-411b-a6f3-48af9522bb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:13.999703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f534480-1d2c-411b-a6f3-48af9522bb06 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:13.999984 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f534480-1d2c-411b-a6f3-48af9522bb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:14.000257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f534480-1d2c-411b-a6f3-48af9522bb06 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:14.000904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f534480-1d2c-411b-a6f3-48af9522bb06 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:14.001209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f534480-1d2c-411b-a6f3-48af9522bb06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:14.002618 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f534480-1d2c-411b-a6f3-48af9522bb06 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:14.007476 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 522/1003] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 27 16:18:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:14.013018 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254eb3c-a439-45d2-afc6-3c080a5edcc1 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:14.073490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:14.112941 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254eb3c-a439-45d2-afc6-3c080a5edcc1 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:14.137354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f534480-1d2c-411b-a6f3-48af9522bb06 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:14.146299 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d783e-0d2a-481f-9a80-f12f429b3682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:14.146919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d783e-0d2a-481f-9a80-f12f429b3682 None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:14.147201 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d783e-0d2a-481f-9a80-f12f429b3682 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:14.147477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d783e-0d2a-481f-9a80-f12f429b3682 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:14.148161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d783e-0d2a-481f-9a80-f12f429b3682 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:14.149574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d783e-0d2a-481f-9a80-f12f429b3682 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:14.232153 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:14.238913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f534480-1d2c-411b-a6f3-48af9522bb06 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:14.271829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5f9f0-96f9-40c2-92b6-a0afd8384835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:14.272488 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5f9f0-96f9-40c2-92b6-a0afd8384835 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:14.272769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5f9f0-96f9-40c2-92b6-a0afd8384835 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:14.273042 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5f9f0-96f9-40c2-92b6-a0afd8384835 None admin] PATH_INFO: `/v3/services/image` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:14.273620 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5f9f0-96f9-40c2-92b6-a0afd8384835 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:14.274981 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5f9f0-96f9-40c2-92b6-a0afd8384835 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:14.284755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 482/1004] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:18:14 2022] POST /identity/v3/endpoints => generated 334 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:18:14.288746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-8cc5f9f0-96f9-40c2-92b6-a0afd8384835 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 16:18:14.288746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:14.288746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:18:14.288746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:18:14.288746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:18:14.288746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:18:14.288746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:18:14.288746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:14.288746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 16:18:14.288746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:14.288746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:18:14.288746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:14.288746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:14.288746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:14.288746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:14.288746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:14.288746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:14.289865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:14.289865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:14.289865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:14.289865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:14.289865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:14.289865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:14.289865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:18:14.289865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:18:14.289865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:18:14.289865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:18:14.289865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:14.289865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:14.289865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:14.289865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:14.289865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:14.289865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:14.290766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:14.290766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:14.290766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:14.290766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:14.290766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:14.290766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:14.290766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:14.290766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:14.290766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:14.290766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:14.290766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:18:14.290766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:14.290766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 16:18:14.290766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:14.290766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 523/1005] 10.222.0.26 () {56 vars in 1105 bytes} [Tue Sep 27 16:18:14 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:18:14.297494 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d783e-0d2a-481f-9a80-f12f429b3682 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:14.416696 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d783e-0d2a-481f-9a80-f12f429b3682 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:14.431664 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:14.455995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df2232-bcd9-40b5-8197-63dd21600f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:14.456691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df2232-bcd9-40b5-8197-63dd21600f5f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:14.456979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df2232-bcd9-40b5-8197-63dd21600f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:14.457257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df2232-bcd9-40b5-8197-63dd21600f5f None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:14.457885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df2232-bcd9-40b5-8197-63dd21600f5f None admin] RBAC: Adding query filter params (name=image) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:14.458190 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df2232-bcd9-40b5-8197-63dd21600f5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:14.459564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df2232-bcd9-40b5-8197-63dd21600f5f None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:14.464575 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 483/1006] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:14.470748 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5f9f0-96f9-40c2-92b6-a0afd8384835 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:14.578136 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5f9f0-96f9-40c2-92b6-a0afd8384835 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:14.612040 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdf783-888b-46e8-a11a-c4cdf5f2b0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:14.612694 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdf783-888b-46e8-a11a-c4cdf5f2b0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:14.612974 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdf783-888b-46e8-a11a-c4cdf5f2b0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:14.613246 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdf783-888b-46e8-a11a-c4cdf5f2b0b0 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:14.613868 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdf783-888b-46e8-a11a-c4cdf5f2b0b0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:14.614169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdf783-888b-46e8-a11a-c4cdf5f2b0b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:14.615533 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdf783-888b-46e8-a11a-c4cdf5f2b0b0 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:14.620278 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 524/1007] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:14 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:15.138736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcc225-c3d3-4179-8095-81374894478f None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:15.139229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcc225-c3d3-4179-8095-81374894478f None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:15.139229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcc225-c3d3-4179-8095-81374894478f None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:15.140694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 484/1008] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:15.145925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15925539-8c6c-4907-b010-0b69277ceecd None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:15.146343 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15925539-8c6c-4907-b010-0b69277ceecd None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:15.146538 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15925539-8c6c-4907-b010-0b69277ceecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:15.165202 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-15925539-8c6c-4907-b010-0b69277ceecd None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:15.166373 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-15925539-8c6c-4907-b010-0b69277ceecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:15.182936 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:15.236759 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 525/1009] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:15 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:15.502796 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcc225-c3d3-4179-8095-81374894478f None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:15.607895 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcc225-c3d3-4179-8095-81374894478f None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:15.643346 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6d15c-3844-4efb-b612-abcae3336cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:15.644295 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6d15c-3844-4efb-b612-abcae3336cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:15.644815 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6d15c-3844-4efb-b612-abcae3336cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:15.645315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6d15c-3844-4efb-b612-abcae3336cc9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:15.646096 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6d15c-3844-4efb-b612-abcae3336cc9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:15.647689 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6d15c-3844-4efb-b612-abcae3336cc9 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:15.656761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-8ac6d15c-3844-4efb-b612-abcae3336cc9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 16:18:15.656761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:15.656761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:18:15.656761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:18:15.656761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:18:15.656761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:18:15.656761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:18:15.656761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:15.656761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 16:18:15.656761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:15.656761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:18:15.656761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:15.656761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:15.656761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:15.656761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:15.656761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:15.656761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:15.657757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:15.657757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:15.657757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:15.657757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:15.657757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:15.657757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:15.657757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:18:15.657757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:18:15.657757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:18:15.657757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:18:15.657757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:15.657757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:15.657757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:15.657757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:15.657757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:15.657757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:15.658627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:15.658627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:15.658627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:15.658627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:15.658627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:15.658627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:15.658627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:15.658627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:15.658627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:15.658627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:15.658627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:18:15.658627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:15.658627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 16:18:15.658627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:15.661318 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 485/1010] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 27 16:18:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:15.666946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15925539-8c6c-4907-b010-0b69277ceecd None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:15.767660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15925539-8c6c-4907-b010-0b69277ceecd None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:15.806609 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9e47e-eaa7-45e7-8811-1ef2a63d005e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:15.807223 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9e47e-eaa7-45e7-8811-1ef2a63d005e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:15.807503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9e47e-eaa7-45e7-8811-1ef2a63d005e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:15.807777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9e47e-eaa7-45e7-8811-1ef2a63d005e None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:15.809059 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9e47e-eaa7-45e7-8811-1ef2a63d005e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:15.809368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9e47e-eaa7-45e7-8811-1ef2a63d005e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:15.810730 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9e47e-eaa7-45e7-8811-1ef2a63d005e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:15.815761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 526/1011] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 27 16:18:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:15.821283 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6d15c-3844-4efb-b612-abcae3336cc9 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:15.866893 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:15.923503 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6d15c-3844-4efb-b612-abcae3336cc9 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:15.957303 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824acc2-6805-4a1b-8ed0-51225d1f5e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:15.957913 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824acc2-6805-4a1b-8ed0-51225d1f5e2e None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:15.958192 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824acc2-6805-4a1b-8ed0-51225d1f5e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:15.958464 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824acc2-6805-4a1b-8ed0-51225d1f5e2e None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:15.959087 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824acc2-6805-4a1b-8ed0-51225d1f5e2e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:15.959392 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824acc2-6805-4a1b-8ed0-51225d1f5e2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:15.960785 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824acc2-6805-4a1b-8ed0-51225d1f5e2e None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:15.965693 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 486/1012] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 27 16:18:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:15.971253 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9e47e-eaa7-45e7-8811-1ef2a63d005e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:15.990342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:16.073671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9e47e-eaa7-45e7-8811-1ef2a63d005e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:16.108311 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c5451-177d-4a65-a192-754525a57290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:16.108961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c5451-177d-4a65-a192-754525a57290 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:16.109243 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c5451-177d-4a65-a192-754525a57290 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:16.109578 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c5451-177d-4a65-a192-754525a57290 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:16.110245 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c5451-177d-4a65-a192-754525a57290 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:16.111669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c5451-177d-4a65-a192-754525a57290 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:16.194201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 527/1013] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:18:15 2022] POST /identity/v3/endpoints => generated 325 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:18:16.556864 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c46f4-46ad-458a-ab24-6f7999a4c706 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:16.557402 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c46f4-46ad-458a-ab24-6f7999a4c706 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:16.557402 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c46f4-46ad-458a-ab24-6f7999a4c706 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:16.558921 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 487/1014] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:16.564088 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d4999-0aee-4b6b-bbb6-936199e4d794 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:16.564401 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d4999-0aee-4b6b-bbb6-936199e4d794 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:16.564682 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d4999-0aee-4b6b-bbb6-936199e4d794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:16.583357 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a04d4999-0aee-4b6b-bbb6-936199e4d794 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:16.584665 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a04d4999-0aee-4b6b-bbb6-936199e4d794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:16.660395 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 528/1015] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:16 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:16.777156 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fa48d-02a5-449d-9507-bd9672772aa3 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:16.777990 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fa48d-02a5-449d-9507-bd9672772aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:16.778210 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fa48d-02a5-449d-9507-bd9672772aa3 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:16.779669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 488/1016] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:16.785861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e5020-a34a-4f64-ac16-15f2f2426cd5 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:16.786148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e5020-a34a-4f64-ac16-15f2f2426cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:16.786430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e5020-a34a-4f64-ac16-15f2f2426cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:16.792952 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:16.805701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ca3e5020-a34a-4f64-ac16-15f2f2426cd5 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:16.812453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ca3e5020-a34a-4f64-ac16-15f2f2426cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:16.874769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 529/1017] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:16 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:16.925868 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fa48d-02a5-449d-9507-bd9672772aa3 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:17.029313 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fa48d-02a5-449d-9507-bd9672772aa3 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:17.036911 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:17.063118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58ca3c-5e0d-49af-8559-1d16d1afa346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:17.063668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58ca3c-5e0d-49af-8559-1d16d1afa346 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:17.063942 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58ca3c-5e0d-49af-8559-1d16d1afa346 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:17.064207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58ca3c-5e0d-49af-8559-1d16d1afa346 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:17.075622 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58ca3c-5e0d-49af-8559-1d16d1afa346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:18:17.080577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-4c58ca3c-5e0d-49af-8559-1d16d1afa346 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 16:18:17.080577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:17.080577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:17.080577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:17.080577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:17.080577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:17.080577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:17.080577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:17.080577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:17.080577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:17.080577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:17.080577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:17.080577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:18:17.080577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:18:17.080577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:18:17.080577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:18:17.081567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:18:17.081567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:18:17.081567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:18:17.081567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:18:17.081567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:17.081567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:17.081567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:17.081567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:17.081567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:17.081567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:17.081567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:17.081567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:17.081567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:17.081567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:17.081567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:17.081567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:17.085339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:17.085339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:17.085339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:17.085339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:17.085339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:18:17.085339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:18:17.085339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:18:17.085339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:18:17.085339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:18:17.085339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:18:17.085339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 16:18:17.085339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:17.085339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 489/1018] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Sep 27 16:18:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:17.088051 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e5020-a34a-4f64-ac16-15f2f2426cd5 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:17.142152 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58ca3c-5e0d-49af-8559-1d16d1afa346 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:17.192012 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e5020-a34a-4f64-ac16-15f2f2426cd5 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:17.224660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:17.229714 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb802a7-6e5e-46d6-968b-f848390a8fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:17.230830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb802a7-6e5e-46d6-968b-f848390a8fcd None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:17.231156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb802a7-6e5e-46d6-968b-f848390a8fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:17.231490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb802a7-6e5e-46d6-968b-f848390a8fcd None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:17.232128 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb802a7-6e5e-46d6-968b-f848390a8fcd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:17.232460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb802a7-6e5e-46d6-968b-f848390a8fcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:17.233816 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb802a7-6e5e-46d6-968b-f848390a8fcd None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:17.246985 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 530/1019] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Sep 27 16:18:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:17.247991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb802a7-6e5e-46d6-968b-f848390a8fcd None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:17.250346 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58ca3c-5e0d-49af-8559-1d16d1afa346 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:17.286278 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba9ae9-75c9-419b-8b1b-e1025b455e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:17.286887 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba9ae9-75c9-419b-8b1b-e1025b455e90 None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:17.287168 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba9ae9-75c9-419b-8b1b-e1025b455e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:17.287443 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba9ae9-75c9-419b-8b1b-e1025b455e90 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:17.288105 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba9ae9-75c9-419b-8b1b-e1025b455e90 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:17.289513 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba9ae9-75c9-419b-8b1b-e1025b455e90 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:17.347871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb802a7-6e5e-46d6-968b-f848390a8fcd None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:17.372380 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 490/1020] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 27 16:18:17 2022] POST /identity/v3/services => generated 242 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:18:17.397460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee29bd-42a9-486d-ad81-3e5988c07112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:17.398124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee29bd-42a9-486d-ad81-3e5988c07112 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:17.398404 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee29bd-42a9-486d-ad81-3e5988c07112 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:17.398682 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee29bd-42a9-486d-ad81-3e5988c07112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:17.412044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee29bd-42a9-486d-ad81-3e5988c07112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:17.413591 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee29bd-42a9-486d-ad81-3e5988c07112 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:17.429975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-ffee29bd-42a9-486d-ad81-3e5988c07112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:17.429975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:17.429975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:17.429975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:17.429975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:17.429975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:17.429975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:17.429975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:17.429975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:17.429975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:17.429975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:17.429975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:17.429975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:18:17.429975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:18:17.429975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:18:17.429975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:18:17.431022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:17.431022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:17.431022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:17.431022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:17.431022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:17.431022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:17.431022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:17.431022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:17.431022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:17.431022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:17.431022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:17.431022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:17.431022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:17.431022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:17.431022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:17.431022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:17.431022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:18:17.431941 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:18:17.431941 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:17.431941 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:17.431941 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 531/1021] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:17.437325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba9ae9-75c9-419b-8b1b-e1025b455e90 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:17.469503 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:17.548320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba9ae9-75c9-419b-8b1b-e1025b455e90 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:17.584234 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8667d6d-7d87-4d2b-a293-e24248717230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:17.584901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8667d6d-7d87-4d2b-a293-e24248717230 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:17.585148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8667d6d-7d87-4d2b-a293-e24248717230 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:17.585426 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8667d6d-7d87-4d2b-a293-e24248717230 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:17.586071 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8667d6d-7d87-4d2b-a293-e24248717230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:17.586378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8667d6d-7d87-4d2b-a293-e24248717230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:17.587767 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8667d6d-7d87-4d2b-a293-e24248717230 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:17.600161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 491/1022] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:17.606015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee29bd-42a9-486d-ad81-3e5988c07112 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:17.651036 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:17.708964 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee29bd-42a9-486d-ad81-3e5988c07112 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:17.742155 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8e83c-8aa4-4f88-a397-172d4567d5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:17.742781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8e83c-8aa4-4f88-a397-172d4567d5ef None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:17.743060 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8e83c-8aa4-4f88-a397-172d4567d5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:17.743332 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8e83c-8aa4-4f88-a397-172d4567d5ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:17.751417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8e83c-8aa4-4f88-a397-172d4567d5ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:17.752893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8e83c-8aa4-4f88-a397-172d4567d5ef None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:17.764693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-8ff8e83c-8aa4-4f88-a397-172d4567d5ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 16:18:17.764693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:17.764693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:17.764693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:17.764693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:17.764693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:17.764693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:17.764693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:17.764693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:17.764693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:17.764693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:17.764693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:17.764693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:18:17.764693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:18:17.764693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:18:17.764693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:18:17.765701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:17.765701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:17.765701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:18:17.765701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:18:17.765701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:18:17.765701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:18:17.765701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:17.765701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:17.765701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:17.765701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:17.765701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:17.765701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:17.765701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:17.765701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:17.765701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:17.765701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:17.765701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:17.765701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:17.766708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:17.766708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:17.766708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:18:17.766708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:18:17.766708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:18:17.766708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:18:17.766708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:18:17.766708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:18:17.766708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 16:18:17.766708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:17.766708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 532/1023] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Sep 27 16:18:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:18:17.773587 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8667d6d-7d87-4d2b-a293-e24248717230 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:17.867819 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:17.883336 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8667d6d-7d87-4d2b-a293-e24248717230 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:17.917868 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e2194-570c-4f57-81bb-e3a8fce9f5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:17.918467 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e2194-570c-4f57-81bb-e3a8fce9f5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:17.918752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e2194-570c-4f57-81bb-e3a8fce9f5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:17.919026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e2194-570c-4f57-81bb-e3a8fce9f5f2 None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:17.920007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e2194-570c-4f57-81bb-e3a8fce9f5f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:17.920315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e2194-570c-4f57-81bb-e3a8fce9f5f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:17.921773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e2194-570c-4f57-81bb-e3a8fce9f5f2 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:17.943935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 492/1024] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Sep 27 16:18:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:17.945467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8e83c-8aa4-4f88-a397-172d4567d5ef None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:18.051405 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8e83c-8aa4-4f88-a397-172d4567d5ef None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:18.052995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:18.085885 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47fbd5-893c-453e-9369-518257e9d34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:18.086487 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47fbd5-893c-453e-9369-518257e9d34b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:18.086766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47fbd5-893c-453e-9369-518257e9d34b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:18.087044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47fbd5-893c-453e-9369-518257e9d34b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:18.155351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47fbd5-893c-453e-9369-518257e9d34b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:18.156737 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47fbd5-893c-453e-9369-518257e9d34b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:18.255066 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 533/1025] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:18:17 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 27 16:18:18.260876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e2194-570c-4f57-81bb-e3a8fce9f5f2 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:18.372061 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e2194-570c-4f57-81bb-e3a8fce9f5f2 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:18.392145 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67628c9-9885-47c4-bea6-004b81f66aa8 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:18.392484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67628c9-9885-47c4-bea6-004b81f66aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:18.392732 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67628c9-9885-47c4-bea6-004b81f66aa8 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:18.394068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 534/1026] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:18:18.398993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c72e19-c737-4776-9c77-6050edf8ad31 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:18.399282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c72e19-c737-4776-9c77-6050edf8ad31 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:18.399559 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c72e19-c737-4776-9c77-6050edf8ad31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:18.405924 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:18.407837 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b33cb-0514-47b2-9ac0-bf2fc329adad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:18.408515 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b33cb-0514-47b2-9ac0-bf2fc329adad None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:18.408797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b33cb-0514-47b2-9ac0-bf2fc329adad None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:18.409068 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b33cb-0514-47b2-9ac0-bf2fc329adad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:18.418332 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-43c72e19-c737-4776-9c77-6050edf8ad31 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:18.419239 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b33cb-0514-47b2-9ac0-bf2fc329adad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:18.419521 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-43c72e19-c737-4776-9c77-6050edf8ad31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:18.420988 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b33cb-0514-47b2-9ac0-bf2fc329adad None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:18.426216 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:18.437373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-f65b33cb-0514-47b2-9ac0-bf2fc329adad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:18.437373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:18.437373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:18.437373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:18.437373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:18.437373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:18.437373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:18.437373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:18.437373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:18.437373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:18.437373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:18.437373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:18.437373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:18:18.437373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:18:18.437373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:18:18.437373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:18:18.438437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:18.438437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:18.438437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:18.438437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:18.438437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:18.438437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:18.438437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:18.438437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:18.438437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:18.438437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:18.438437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:18.438437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:18.438437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:18.438437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:18.438437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:18.438437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:18.438437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:18:18.444447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:18:18.444447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:18.444447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:18.444447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 493/1027] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:18.445280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b33cb-0514-47b2-9ac0-bf2fc329adad None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:18.490327 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 535/1028] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:18:18.553594 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b33cb-0514-47b2-9ac0-bf2fc329adad None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:18.586501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee411e8-8344-4202-a424-c508f5f6932f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:18.587187 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee411e8-8344-4202-a424-c508f5f6932f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:18.587384 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee411e8-8344-4202-a424-c508f5f6932f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:18.587659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee411e8-8344-4202-a424-c508f5f6932f None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:18.588320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee411e8-8344-4202-a424-c508f5f6932f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:18.588658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee411e8-8344-4202-a424-c508f5f6932f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:18.590548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee411e8-8344-4202-a424-c508f5f6932f None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:18.602291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 494/1029] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:18.607767 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c72e19-c737-4776-9c77-6050edf8ad31 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:18.710551 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c72e19-c737-4776-9c77-6050edf8ad31 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:18.739250 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:18.744460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba900f08-6a5d-4771-85a9-8adaf96f04b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:18.745090 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba900f08-6a5d-4771-85a9-8adaf96f04b8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:18.745403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba900f08-6a5d-4771-85a9-8adaf96f04b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:18.745675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba900f08-6a5d-4771-85a9-8adaf96f04b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:18.752645 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba900f08-6a5d-4771-85a9-8adaf96f04b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:18.754128 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba900f08-6a5d-4771-85a9-8adaf96f04b8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:18.759936 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee411e8-8344-4202-a424-c508f5f6932f None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:18.768390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-ba900f08-6a5d-4771-85a9-8adaf96f04b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:18:18.768390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:18.768390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:18.768390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:18.768390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:18.768390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:18.768390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:18.768390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:18.768390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:18.768390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:18.768390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:18.768390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:18.768390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:18:18.768390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:18:18.768390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:18:18.769356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:18:18.769356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:18.769356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:18.769356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:18.769356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:18.769356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:18.769356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:18.769356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:18.769356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:18.769356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:18.769356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:18.769356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:18.769356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:18.769356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:18.769356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:18.769356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:18.769356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:18.770320 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:18:18.770320 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:18:18.770320 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:18:18.770320 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:18:18.770320 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:18:18.770320 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:18:18.770320 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:18:18.770320 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:18.770320 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 536/1030] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:18:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:18.771941 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba900f08-6a5d-4771-85a9-8adaf96f04b8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:18.827742 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:18.875123 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee411e8-8344-4202-a424-c508f5f6932f None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:18.881778 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba900f08-6a5d-4771-85a9-8adaf96f04b8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:18.911370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6993bcb-2650-4c8e-991d-6736eb322662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:18.912004 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6993bcb-2650-4c8e-991d-6736eb322662 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:18.912283 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6993bcb-2650-4c8e-991d-6736eb322662 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:18.912584 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6993bcb-2650-4c8e-991d-6736eb322662 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:18.913688 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6993bcb-2650-4c8e-991d-6736eb322662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:18.915117 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6993bcb-2650-4c8e-991d-6736eb322662 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:18.916786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 495/1031] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:18.921192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33baa9b3-87c7-4e28-ac3d-f7df8a69033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:18.921799 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33baa9b3-87c7-4e28-ac3d-f7df8a69033a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:18.922074 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33baa9b3-87c7-4e28-ac3d-f7df8a69033a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:18.922548 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33baa9b3-87c7-4e28-ac3d-f7df8a69033a None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:18.923051 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33baa9b3-87c7-4e28-ac3d-f7df8a69033a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:18.923324 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33baa9b3-87c7-4e28-ac3d-f7df8a69033a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:18.923422 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6993bcb-2650-4c8e-991d-6736eb322662 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:18.924758 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33baa9b3-87c7-4e28-ac3d-f7df8a69033a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:18.939103 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 537/1032] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:18:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:18.945513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33baa9b3-87c7-4e28-ac3d-f7df8a69033a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:19.002260 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:19.034465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6993bcb-2650-4c8e-991d-6736eb322662 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:19.054861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33baa9b3-87c7-4e28-ac3d-f7df8a69033a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:19.058987 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:19.069717 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf7fcb-113c-4d4e-9c63-8e740d71ea7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:19.070330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf7fcb-113c-4d4e-9c63-8e740d71ea7d None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:19.070610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf7fcb-113c-4d4e-9c63-8e740d71ea7d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:19.072863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf7fcb-113c-4d4e-9c63-8e740d71ea7d None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:19.072863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf7fcb-113c-4d4e-9c63-8e740d71ea7d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:19.073045 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf7fcb-113c-4d4e-9c63-8e740d71ea7d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:19.092607 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9ffdb-cdf9-447c-90f8-a58471dddfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:19.093214 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9ffdb-cdf9-447c-90f8-a58471dddfe0 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:19.093492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9ffdb-cdf9-447c-90f8-a58471dddfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:19.093763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9ffdb-cdf9-447c-90f8-a58471dddfe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:19.094482 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9ffdb-cdf9-447c-90f8-a58471dddfe0 None admin] RBAC: Adding query filter params (role.id=550538ff801d4fd08b79738d5b5897f6, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=e71fea96b2b949f9abca12172e69284b) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:19.094791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9ffdb-cdf9-447c-90f8-a58471dddfe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:19.096205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9ffdb-cdf9-447c-90f8-a58471dddfe0 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:19.101747 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 538/1033] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:18:18 2022] GET /identity/v3/role_assignments?user.id=e71fea96b2b949f9abca12172e69284b&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=550538ff801d4fd08b79738d5b5897f6 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:19.172778 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 496/1034] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 27 16:18:18 2022] POST /identity/v3/projects => generated 311 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:18:19.582134 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e79cd-a7a0-41eb-b6a3-d1c514cec087 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:19.582681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e79cd-a7a0-41eb-b6a3-d1c514cec087 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:19.582681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e79cd-a7a0-41eb-b6a3-d1c514cec087 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:19.584175 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 539/1035] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:19.589229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cbaba-8d43-4c4d-927e-9fa607e51d14 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:19.589751 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cbaba-8d43-4c4d-927e-9fa607e51d14 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:19.589844 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cbaba-8d43-4c4d-927e-9fa607e51d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:19.608176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-099cbaba-8d43-4c4d-927e-9fa607e51d14 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:19.609375 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-099cbaba-8d43-4c4d-927e-9fa607e51d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:19.678320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 497/1036] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:19 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:19.944626 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e79cd-a7a0-41eb-b6a3-d1c514cec087 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:20.046061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e79cd-a7a0-41eb-b6a3-d1c514cec087 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:20.062497 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:20.079453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373d73e-ab0b-4b65-8567-0f92a37e727e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:20.080072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373d73e-ab0b-4b65-8567-0f92a37e727e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:20.080358 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373d73e-ab0b-4b65-8567-0f92a37e727e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:20.080636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373d73e-ab0b-4b65-8567-0f92a37e727e None admin] PATH_INFO: `/v3/services/image` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:20.081206 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373d73e-ab0b-4b65-8567-0f92a37e727e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:20.082559 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373d73e-ab0b-4b65-8567-0f92a37e727e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:20.092004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-9373d73e-ab0b-4b65-8567-0f92a37e727e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 16:18:20.092004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:20.092004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:18:20.092004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:18:20.092004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:18:20.092004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:18:20.092004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:18:20.092004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:20.092004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 16:18:20.092004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:20.092004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:18:20.092004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:20.092004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:20.092004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:20.092004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:20.092004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:20.092004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:20.093120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:20.093120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:20.093120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:20.093120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:20.093120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:20.093120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:20.093120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:18:20.093120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:18:20.093120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:18:20.093120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:18:20.093120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:20.093120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:20.093120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:20.093120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:20.093120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:20.093120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:20.093992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:20.093992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:20.093992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:20.093992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:20.093992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:20.093992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:20.093992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:20.093992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:20.093992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:20.093992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:20.093992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:18:20.093992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:20.093992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 16:18:20.093992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:20.095616 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 540/1037] 10.222.0.26 () {56 vars in 1105 bytes} [Tue Sep 27 16:18:19 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:20.099442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cbaba-8d43-4c4d-927e-9fa607e51d14 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:20.195982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cbaba-8d43-4c4d-927e-9fa607e51d14 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:20.203389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:20.229482 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923054e-210a-4e0c-8e9c-b064a7f76428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:20.230099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923054e-210a-4e0c-8e9c-b064a7f76428 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:20.230378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923054e-210a-4e0c-8e9c-b064a7f76428 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:20.230645 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923054e-210a-4e0c-8e9c-b064a7f76428 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:20.231412 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923054e-210a-4e0c-8e9c-b064a7f76428 None admin] RBAC: Adding query filter params (name=image) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:20.231717 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923054e-210a-4e0c-8e9c-b064a7f76428 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:20.233106 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923054e-210a-4e0c-8e9c-b064a7f76428 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:20.237937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 498/1038] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:20.243455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373d73e-ab0b-4b65-8567-0f92a37e727e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:20.343297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373d73e-ab0b-4b65-8567-0f92a37e727e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:20.378016 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b75b6b-dc01-4112-b322-b3f491b2d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:20.378616 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b75b6b-dc01-4112-b322-b3f491b2d76b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:20.378890 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b75b6b-dc01-4112-b322-b3f491b2d76b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:20.379160 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b75b6b-dc01-4112-b322-b3f491b2d76b None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:20.379872 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b75b6b-dc01-4112-b322-b3f491b2d76b None admin] RBAC: Adding query filter params (type=image) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:20.380173 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b75b6b-dc01-4112-b322-b3f491b2d76b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:20.381571 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b75b6b-dc01-4112-b322-b3f491b2d76b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:20.388157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 541/1039] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:20.393122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923054e-210a-4e0c-8e9c-b064a7f76428 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:20.497787 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923054e-210a-4e0c-8e9c-b064a7f76428 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:20.531927 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1485cd0-7070-4460-a1c8-7331e0c4f0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:20.532621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1485cd0-7070-4460-a1c8-7331e0c4f0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:20.532903 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1485cd0-7070-4460-a1c8-7331e0c4f0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:20.533175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1485cd0-7070-4460-a1c8-7331e0c4f0f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:20.533868 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1485cd0-7070-4460-a1c8-7331e0c4f0f2 None admin] RBAC: Adding query filter params (interface=public, service_id=43c469fd8a7e45daa3f13b1c459edb3f, region_id=RegionOne) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:20.534177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1485cd0-7070-4460-a1c8-7331e0c4f0f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:20.535542 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1485cd0-7070-4460-a1c8-7331e0c4f0f2 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:20.540602 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 499/1040] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Sep 27 16:18:20 2022] GET /identity/v3/endpoints?service_id=43c469fd8a7e45daa3f13b1c459edb3f&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:20.546423 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b75b6b-dc01-4112-b322-b3f491b2d76b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:20.593059 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:20.645563 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b75b6b-dc01-4112-b322-b3f491b2d76b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:20.678506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a7751-b97d-425a-801a-3ad0d48093aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:20.679103 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a7751-b97d-425a-801a-3ad0d48093aa None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:20.679376 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a7751-b97d-425a-801a-3ad0d48093aa None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:20.679646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a7751-b97d-425a-801a-3ad0d48093aa None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:20.680232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a7751-b97d-425a-801a-3ad0d48093aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:20.681606 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a7751-b97d-425a-801a-3ad0d48093aa None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:20.688121 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 542/1041] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Sep 27 16:18:20 2022] GET /identity/v3/services => generated 1957 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:18:21.326961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784e2ec-1c6c-4d71-afdf-7bd02ca76269 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:21.327482 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784e2ec-1c6c-4d71-afdf-7bd02ca76269 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:21.327482 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784e2ec-1c6c-4d71-afdf-7bd02ca76269 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:21.329024 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 500/1042] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:21.333969 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dec1a-ab6f-4c60-a7a0-7306fb7646e2 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:21.337699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dec1a-ab6f-4c60-a7a0-7306fb7646e2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:21.337699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dec1a-ab6f-4c60-a7a0-7306fb7646e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:21.353883 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-cb9dec1a-ab6f-4c60-a7a0-7306fb7646e2 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:21.355880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-cb9dec1a-ab6f-4c60-a7a0-7306fb7646e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:21.380505 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6b335-c434-4893-a207-5be2c8aa1893 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:21.380793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6b335-c434-4893-a207-5be2c8aa1893 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:21.381077 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6b335-c434-4893-a207-5be2c8aa1893 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:21.382666 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 501/1043] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:21.387506 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416110e4-14bf-4428-b486-863351ebbfa8 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:21.387797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416110e4-14bf-4428-b486-863351ebbfa8 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:21.388068 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416110e4-14bf-4428-b486-863351ebbfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:21.407170 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-416110e4-14bf-4428-b486-863351ebbfa8 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:21.408426 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-416110e4-14bf-4428-b486-863351ebbfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:21.427478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 543/1044] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:18:21.442511 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:21.483401 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 502/1045] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:18:21.697601 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dec1a-ab6f-4c60-a7a0-7306fb7646e2 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:21.738073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:21.751964 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416110e4-14bf-4428-b486-863351ebbfa8 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:21.803670 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dec1a-ab6f-4c60-a7a0-7306fb7646e2 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:21.842134 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09070e8-a8e6-4935-b19c-763e701f65c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:21.842775 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09070e8-a8e6-4935-b19c-763e701f65c5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:21.843083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09070e8-a8e6-4935-b19c-763e701f65c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:21.843452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09070e8-a8e6-4935-b19c-763e701f65c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:21.854504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09070e8-a8e6-4935-b19c-763e701f65c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:18:21.858077 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416110e4-14bf-4428-b486-863351ebbfa8 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:21.860032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-d09070e8-a8e6-4935-b19c-763e701f65c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 16:18:21.860032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:21.860032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:21.860032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:21.860032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:21.860032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:21.860032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:21.860032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:21.860032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:21.860032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:21.860032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:21.860032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:21.860032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:18:21.860032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:18:21.860032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:18:21.860032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:18:21.860980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:18:21.860980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:18:21.860980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:18:21.860980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:18:21.860980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:21.860980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:21.860980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:21.860980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:21.860980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:21.860980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:21.860980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:21.860980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:21.860980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:21.860980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:21.860980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:21.860980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:21.861841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:21.861841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:21.861841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:21.861841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:21.861841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:18:21.861841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:18:21.861841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:18:21.861841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:18:21.861841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:18:21.861841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:18:21.861841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 16:18:21.861841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:21.861841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 544/1046] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Sep 27 16:18:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:21.867186 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09070e8-a8e6-4935-b19c-763e701f65c5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:21.897631 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817f25d-4dbf-4d83-80ea-26366a286a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:21.898272 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817f25d-4dbf-4d83-80ea-26366a286a05 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:21.898589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817f25d-4dbf-4d83-80ea-26366a286a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:21.898904 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817f25d-4dbf-4d83-80ea-26366a286a05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:21.899917 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817f25d-4dbf-4d83-80ea-26366a286a05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:21.901382 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817f25d-4dbf-4d83-80ea-26366a286a05 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:21.904521 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 503/1047] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:21.908521 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817f25d-4dbf-4d83-80ea-26366a286a05 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:21.943217 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:21.974107 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:21.978407 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09070e8-a8e6-4935-b19c-763e701f65c5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:22.012765 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817f25d-4dbf-4d83-80ea-26366a286a05 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:22.021405 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa0cb3-86d4-40d0-b722-ac39b913b151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:22.022464 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa0cb3-86d4-40d0-b722-ac39b913b151 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:22.022746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa0cb3-86d4-40d0-b722-ac39b913b151 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:22.023021 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa0cb3-86d4-40d0-b722-ac39b913b151 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:22.024095 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa0cb3-86d4-40d0-b722-ac39b913b151 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:22.024722 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa0cb3-86d4-40d0-b722-ac39b913b151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:22.026224 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa0cb3-86d4-40d0-b722-ac39b913b151 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:22.040435 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 545/1048] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Sep 27 16:18:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:22.041398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa0cb3-86d4-40d0-b722-ac39b913b151 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:22.052390 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2fa88-8672-47d1-958d-99c4ec7d3426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:22.052996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2fa88-8672-47d1-958d-99c4ec7d3426 None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:22.053271 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2fa88-8672-47d1-958d-99c4ec7d3426 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:22.053541 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2fa88-8672-47d1-958d-99c4ec7d3426 None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:22.054188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2fa88-8672-47d1-958d-99c4ec7d3426 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:22.055597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2fa88-8672-47d1-958d-99c4ec7d3426 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:22.142208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa0cb3-86d4-40d0-b722-ac39b913b151 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:22.148509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 504/1049] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 27 16:18:21 2022] POST /identity/v3/users => generated 285 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:18:22.178420 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf323150-aafc-47e4-a38f-ec2ff7e6206f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:22.179123 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf323150-aafc-47e4-a38f-ec2ff7e6206f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:22.179401 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf323150-aafc-47e4-a38f-ec2ff7e6206f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:22.179671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf323150-aafc-47e4-a38f-ec2ff7e6206f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:22.191693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf323150-aafc-47e4-a38f-ec2ff7e6206f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:22.193176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf323150-aafc-47e4-a38f-ec2ff7e6206f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:22.209001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-bf323150-aafc-47e4-a38f-ec2ff7e6206f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:22.209001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:22.209001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:22.209001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:22.209001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:22.209001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:22.209001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:22.209001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:22.209001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:22.209001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:22.209001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:22.209001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:22.209001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:18:22.209001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:18:22.209001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:18:22.209001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:18:22.210061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:22.210061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:22.210061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:22.210061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:22.210061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:22.210061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:22.210061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:22.210061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:22.210061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:22.210061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:22.210061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:22.210061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:22.210061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:22.210061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:22.210061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:22.210061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:22.210061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:18:22.216319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:18:22.216319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:22.216319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:22.216319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 546/1050] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:22.217771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2fa88-8672-47d1-958d-99c4ec7d3426 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:22.314614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:22.330114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2fa88-8672-47d1-958d-99c4ec7d3426 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:22.366845 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c83b06-24db-4f47-b146-5e9cc6d5a0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:22.367694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c83b06-24db-4f47-b146-5e9cc6d5a0af None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:22.368120 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c83b06-24db-4f47-b146-5e9cc6d5a0af None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:22.368564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c83b06-24db-4f47-b146-5e9cc6d5a0af None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:22.369380 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c83b06-24db-4f47-b146-5e9cc6d5a0af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:22.369680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c83b06-24db-4f47-b146-5e9cc6d5a0af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:22.371093 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c83b06-24db-4f47-b146-5e9cc6d5a0af None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:22.384117 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 505/1051] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:22.389689 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf323150-aafc-47e4-a38f-ec2ff7e6206f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:22.406394 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:22.491824 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf323150-aafc-47e4-a38f-ec2ff7e6206f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:22.524819 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25e0b5-5414-4b1d-b6d2-15933d4f3abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:22.525446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25e0b5-5414-4b1d-b6d2-15933d4f3abf None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:22.525719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25e0b5-5414-4b1d-b6d2-15933d4f3abf None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:22.525985 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25e0b5-5414-4b1d-b6d2-15933d4f3abf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:22.534043 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25e0b5-5414-4b1d-b6d2-15933d4f3abf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:22.535468 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25e0b5-5414-4b1d-b6d2-15933d4f3abf None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:22.546657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-9e25e0b5-5414-4b1d-b6d2-15933d4f3abf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 16:18:22.546657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:22.546657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:22.546657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:22.546657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:22.546657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:22.546657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:22.546657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:22.546657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:22.546657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:22.546657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:22.546657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:22.546657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:18:22.546657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:18:22.546657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:18:22.546657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:18:22.547602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:22.547602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:22.547602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:18:22.547602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:18:22.547602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:18:22.547602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:18:22.547602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:22.547602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:22.547602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:22.547602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:22.547602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:22.547602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:22.547602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:22.547602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:22.547602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:22.547602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:22.547602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:22.547602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:22.549022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:22.549022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:22.549022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:18:22.549022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:18:22.549022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:18:22.549022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:18:22.549022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:18:22.549022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:18:22.549022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 16:18:22.549022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:22.549022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 547/1052] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Sep 27 16:18:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:22.553642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c83b06-24db-4f47-b146-5e9cc6d5a0af None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:22.653770 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c83b06-24db-4f47-b146-5e9cc6d5a0af None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:22.687517 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b2758-098c-46b3-97c3-ee0fd1bf525f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:22.688122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b2758-098c-46b3-97c3-ee0fd1bf525f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:22.688493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b2758-098c-46b3-97c3-ee0fd1bf525f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:22.688764 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b2758-098c-46b3-97c3-ee0fd1bf525f None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:22.689487 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b2758-098c-46b3-97c3-ee0fd1bf525f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:22.689790 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b2758-098c-46b3-97c3-ee0fd1bf525f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:22.692181 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b2758-098c-46b3-97c3-ee0fd1bf525f None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:22.719936 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 506/1053] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Sep 27 16:18:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:22.721596 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25e0b5-5414-4b1d-b6d2-15933d4f3abf None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:22.807782 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:22.838437 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25e0b5-5414-4b1d-b6d2-15933d4f3abf None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:22.852254 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63468b-b7ca-4d84-b304-a1dd393d87ec None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:22.852574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63468b-b7ca-4d84-b304-a1dd393d87ec None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:22.852856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63468b-b7ca-4d84-b304-a1dd393d87ec None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:22.854198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 507/1054] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:22.859204 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736a0b1-73a1-420b-96e5-6582e35147b0 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:22.859492 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736a0b1-73a1-420b-96e5-6582e35147b0 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:22.859770 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736a0b1-73a1-420b-96e5-6582e35147b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:22.872392 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:22.875152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de97c8e-7974-485b-ba75-87b0211cc24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:22.875773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de97c8e-7974-485b-ba75-87b0211cc24d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:22.876046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de97c8e-7974-485b-ba75-87b0211cc24d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:22.876315 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de97c8e-7974-485b-ba75-87b0211cc24d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:22.879108 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-2736a0b1-73a1-420b-96e5-6582e35147b0 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:22.880063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-2736a0b1-73a1-420b-96e5-6582e35147b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:22.888312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de97c8e-7974-485b-ba75-87b0211cc24d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:22.889748 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de97c8e-7974-485b-ba75-87b0211cc24d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:22.904104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-9de97c8e-7974-485b-ba75-87b0211cc24d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:22.904104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:22.904104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:22.904104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:22.904104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:22.904104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:22.904104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:22.904104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:22.904104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:22.904104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:22.904104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:22.904104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:22.904104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:18:22.904104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:18:22.904104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:18:22.904104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:18:22.905302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:22.905302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:22.905302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:22.905302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:22.905302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:22.905302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:22.905302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:22.905302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:22.905302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:22.905302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:22.905302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:22.905302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:22.905302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:22.905302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:22.905302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:22.905302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:22.905302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:18:22.906242 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:18:22.906242 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:22.906242 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:22.906242 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 548/1055] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:18:22.910653 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de97c8e-7974-485b-ba75-87b0211cc24d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:22.960248 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 508/1056] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:18:23.014291 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de97c8e-7974-485b-ba75-87b0211cc24d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:23.036763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:23.047958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f3c4c-5078-4b2c-a3a7-d1aaec4ff32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:23.048595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f3c4c-5078-4b2c-a3a7-d1aaec4ff32f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:23.048873 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f3c4c-5078-4b2c-a3a7-d1aaec4ff32f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:23.049140 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f3c4c-5078-4b2c-a3a7-d1aaec4ff32f None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:23.049766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f3c4c-5078-4b2c-a3a7-d1aaec4ff32f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:23.050064 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f3c4c-5078-4b2c-a3a7-d1aaec4ff32f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:23.052211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f3c4c-5078-4b2c-a3a7-d1aaec4ff32f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:23.072453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 549/1057] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:23.073533 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736a0b1-73a1-420b-96e5-6582e35147b0 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:23.174470 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736a0b1-73a1-420b-96e5-6582e35147b0 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:23.207397 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00faf237-aee7-432e-8bd2-397dc139f6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:23.208017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faf237-aee7-432e-8bd2-397dc139f6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:23.208293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faf237-aee7-432e-8bd2-397dc139f6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:23.208586 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faf237-aee7-432e-8bd2-397dc139f6d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:23.211198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:23.215868 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00faf237-aee7-432e-8bd2-397dc139f6d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:23.217324 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00faf237-aee7-432e-8bd2-397dc139f6d0 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:23.228098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-00faf237-aee7-432e-8bd2-397dc139f6d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:18:23.228098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:23.228098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:23.228098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:23.228098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:23.228098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:23.228098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:23.228098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:23.228098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:23.228098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:23.228098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:23.228098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:23.228098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:18:23.228098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:18:23.228098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:18:23.229047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:18:23.229047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:23.229047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:23.229047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:23.229047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:23.229047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:23.229047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:23.229047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:23.229047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:23.229047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:23.229047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:23.229047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:23.229047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:23.229047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:23.229047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:23.229047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:23.229047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:23.235566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:18:23.235566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:18:23.235566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:18:23.235566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:18:23.235566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:18:23.235566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:18:23.235566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:18:23.235566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:23.235566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 509/1058] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:18:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:18:23.236094 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f3c4c-5078-4b2c-a3a7-d1aaec4ff32f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:23.236171 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00faf237-aee7-432e-8bd2-397dc139f6d0 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:23.338484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00faf237-aee7-432e-8bd2-397dc139f6d0 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:23.343478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f3c4c-5078-4b2c-a3a7-d1aaec4ff32f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:23.376003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617db426-64d9-4345-b476-fe499b134234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:23.376652 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617db426-64d9-4345-b476-fe499b134234 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:23.376937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617db426-64d9-4345-b476-fe499b134234 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:23.377213 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617db426-64d9-4345-b476-fe499b134234 None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:23.377936 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617db426-64d9-4345-b476-fe499b134234 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:23.378243 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617db426-64d9-4345-b476-fe499b134234 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:23.379790 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617db426-64d9-4345-b476-fe499b134234 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:23.387084 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a342a-a761-4e68-aeea-c5d9334d2944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:23.387710 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a342a-a761-4e68-aeea-c5d9334d2944 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:23.387993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a342a-a761-4e68-aeea-c5d9334d2944 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:23.388266 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a342a-a761-4e68-aeea-c5d9334d2944 None admin] PATH_INFO: `/v3/services/image` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:23.388868 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a342a-a761-4e68-aeea-c5d9334d2944 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:23.390210 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a342a-a761-4e68-aeea-c5d9334d2944 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:23.394267 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 510/1059] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:18:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:23.399516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-ec6a342a-a761-4e68-aeea-c5d9334d2944 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 16:18:23.399516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:23.399516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:18:23.399516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:18:23.399516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:18:23.399516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:18:23.399516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:18:23.399516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:23.399516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 16:18:23.399516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:23.399516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:18:23.399516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:23.399516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:23.399516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:23.399516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:23.399516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:23.399516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:23.400577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:23.400577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:23.400577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:23.400577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:23.400577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:23.400577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:23.400577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:18:23.400577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:18:23.400577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:18:23.400577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:18:23.400577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:23.400577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:23.400577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:23.400577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:23.400577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:23.400577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:23.401448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:23.401448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:23.401448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:23.401448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:23.401448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:23.401448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:23.401448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:23.401448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:23.401448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:23.401448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:23.401448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:18:23.401448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:18:23.401448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 16:18:23.401448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:23.402259 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617db426-64d9-4345-b476-fe499b134234 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:23.402333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 550/1060] 10.222.0.26 () {56 vars in 1105 bytes} [Tue Sep 27 16:18:23 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:23.406392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a342a-a761-4e68-aeea-c5d9334d2944 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:23.458749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:23.467984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:23.512210 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a342a-a761-4e68-aeea-c5d9334d2944 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:23.512783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617db426-64d9-4345-b476-fe499b134234 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:23.547616 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fda86-9a47-42cd-a01f-4175da7e06a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:23.548208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fda86-9a47-42cd-a01f-4175da7e06a7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:23.548518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fda86-9a47-42cd-a01f-4175da7e06a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:23.548792 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fda86-9a47-42cd-a01f-4175da7e06a7 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:23.548901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e18af-c859-4d6a-9cf2-1e15d5dacd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:23.549422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fda86-9a47-42cd-a01f-4175da7e06a7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:23.549523 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e18af-c859-4d6a-9cf2-1e15d5dacd95 None admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:23.549713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fda86-9a47-42cd-a01f-4175da7e06a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:23.549822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e18af-c859-4d6a-9cf2-1e15d5dacd95 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:23.549996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e18af-c859-4d6a-9cf2-1e15d5dacd95 None admin] PATH_INFO: `/v3/projects/ad230723d90a439daf38443915c2282f/users/e71fea96b2b949f9abca12172e69284b/roles/550538ff801d4fd08b79738d5b5897f6` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:23.551067 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fda86-9a47-42cd-a01f-4175da7e06a7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:23.552166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e18af-c859-4d6a-9cf2-1e15d5dacd95 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad230723d90a439daf38443915c2282f, user_id=e71fea96b2b949f9abca12172e69284b, role_id=550538ff801d4fd08b79738d5b5897f6)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:23.553724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e18af-c859-4d6a-9cf2-1e15d5dacd95 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:23.560560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 551/1061] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:23.561559 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fda86-9a47-42cd-a01f-4175da7e06a7 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:23.644584 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 511/1062] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:18:23 2022] PUT /identity/v3/projects/ad230723d90a439daf38443915c2282f/users/e71fea96b2b949f9abca12172e69284b/roles/550538ff801d4fd08b79738d5b5897f6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:18:23.665041 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fda86-9a47-42cd-a01f-4175da7e06a7 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:23.680740 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:23.704588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f50a9-8e84-40a0-8b60-c312cb0b0e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:23.705332 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f50a9-8e84-40a0-8b60-c312cb0b0e93 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:23.705607 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f50a9-8e84-40a0-8b60-c312cb0b0e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:23.705882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f50a9-8e84-40a0-8b60-c312cb0b0e93 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:23.706600 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f50a9-8e84-40a0-8b60-c312cb0b0e93 None admin] RBAC: Adding query filter params (type=image) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:23.706911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f50a9-8e84-40a0-8b60-c312cb0b0e93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:23.708320 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f50a9-8e84-40a0-8b60-c312cb0b0e93 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:23.720144 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 552/1063] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:23.721331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e18af-c859-4d6a-9cf2-1e15d5dacd95 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:23.841681 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e18af-c859-4d6a-9cf2-1e15d5dacd95 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:23.859524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:23.877584 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5d2a9-1e04-40eb-8814-da23dbf38488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:23.878202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5d2a9-1e04-40eb-8814-da23dbf38488 None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:23.878480 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5d2a9-1e04-40eb-8814-da23dbf38488 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:23.878755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5d2a9-1e04-40eb-8814-da23dbf38488 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:23.879433 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5d2a9-1e04-40eb-8814-da23dbf38488 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:23.880837 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5d2a9-1e04-40eb-8814-da23dbf38488 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:23.965462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 512/1064] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:18:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:18:24.386616 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f929e5b-4fe1-4521-bbb4-94cc68bddbdd None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:24.387155 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f929e5b-4fe1-4521-bbb4-94cc68bddbdd None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:24.387155 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f929e5b-4fe1-4521-bbb4-94cc68bddbdd None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:24.388661 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 553/1065] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:24.393935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ed1d1-18f0-4741-b031-fea2cc683ca9 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:24.394324 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ed1d1-18f0-4741-b031-fea2cc683ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:24.394485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ed1d1-18f0-4741-b031-fea2cc683ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:24.413158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-ea5ed1d1-18f0-4741-b031-fea2cc683ca9 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:24.414348 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ea5ed1d1-18f0-4741-b031-fea2cc683ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:24.488534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 513/1066] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:24.757546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f929e5b-4fe1-4521-bbb4-94cc68bddbdd None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:24.870779 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f929e5b-4fe1-4521-bbb4-94cc68bddbdd None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:24.905278 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca053b2-246c-4125-a4e5-6db20e228d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:24.905903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca053b2-246c-4125-a4e5-6db20e228d94 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:24.906180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca053b2-246c-4125-a4e5-6db20e228d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:24.906452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca053b2-246c-4125-a4e5-6db20e228d94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:24.916941 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca053b2-246c-4125-a4e5-6db20e228d94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:18:24.921986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-fca053b2-246c-4125-a4e5-6db20e228d94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:18:24.921986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:24.921986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:24.921986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:24.921986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:24.921986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:24.921986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:24.921986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:24.921986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:24.921986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:24.921986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:24.921986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:24.921986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:18:24.921986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:18:24.921986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:18:24.921986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:18:24.922898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:18:24.922898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:18:24.922898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:18:24.922898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:18:24.922898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:24.922898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:24.922898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:24.922898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:24.922898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:24.922898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:24.922898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:24.922898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:24.922898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:24.922898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:24.922898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:24.922898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:24.923760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:24.923760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:24.923760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:24.923760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:24.923760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:18:24.923760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:18:24.923760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:18:24.923760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:18:24.923760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:18:24.923760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:18:24.923760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:18:24.923760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:24.923760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 554/1067] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:18:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:24.929121 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ed1d1-18f0-4741-b031-fea2cc683ca9 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:25.023439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:25.028250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ed1d1-18f0-4741-b031-fea2cc683ca9 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:25.062793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246668b-b3f4-400f-99c9-312f1e7919dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:25.063396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246668b-b3f4-400f-99c9-312f1e7919dc None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:25.063670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246668b-b3f4-400f-99c9-312f1e7919dc None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:25.063937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246668b-b3f4-400f-99c9-312f1e7919dc None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:25.064610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246668b-b3f4-400f-99c9-312f1e7919dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:25.064909 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246668b-b3f4-400f-99c9-312f1e7919dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:25.066265 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246668b-b3f4-400f-99c9-312f1e7919dc None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:25.079523 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 514/1068] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:18:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:25.080685 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca053b2-246c-4125-a4e5-6db20e228d94 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:25.115176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:25.179186 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca053b2-246c-4125-a4e5-6db20e228d94 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:25.212775 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631f926-6455-4a3d-9204-a366cc4f42fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:25.213404 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631f926-6455-4a3d-9204-a366cc4f42fc None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:25.213677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631f926-6455-4a3d-9204-a366cc4f42fc None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:25.213945 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631f926-6455-4a3d-9204-a366cc4f42fc None admin] PATH_INFO: `/v3/users/5d86559533694fc9a9265f91181c5b27` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:25.227188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631f926-6455-4a3d-9204-a366cc4f42fc None admin] RBAC: Authorizing `identity:get_user(user_id=5d86559533694fc9a9265f91181c5b27)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:25.228742 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631f926-6455-4a3d-9204-a366cc4f42fc None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:25.235125 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 555/1069] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:18:25 2022] GET /identity/v3/users/5d86559533694fc9a9265f91181c5b27 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:25.236286 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246668b-b3f4-400f-99c9-312f1e7919dc None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:25.336212 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246668b-b3f4-400f-99c9-312f1e7919dc None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:25.368759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef27dd-9585-444a-900f-fc8770c9b94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:25.369363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef27dd-9585-444a-900f-fc8770c9b94d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:25.370483 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef27dd-9585-444a-900f-fc8770c9b94d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:25.370483 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef27dd-9585-444a-900f-fc8770c9b94d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:25.398859 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:25.438645 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef27dd-9585-444a-900f-fc8770c9b94d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:25.440079 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef27dd-9585-444a-900f-fc8770c9b94d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:25.542189 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 515/1070] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:18:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 27 16:18:25.543929 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631f926-6455-4a3d-9204-a366cc4f42fc None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:25.637559 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:25.644666 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631f926-6455-4a3d-9204-a366cc4f42fc None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:25.683765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668ea54-cfc4-4714-9a9b-c929f6626f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:25.684649 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668ea54-cfc4-4714-9a9b-c929f6626f53 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:25.684970 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668ea54-cfc4-4714-9a9b-c929f6626f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:25.685591 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668ea54-cfc4-4714-9a9b-c929f6626f53 None admin] PATH_INFO: `/v3/projects/7ca4edaa3c104cc98dd06dc863c9c464` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:25.689820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668ea54-cfc4-4714-9a9b-c929f6626f53 None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4edaa3c104cc98dd06dc863c9c464)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:25.691413 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668ea54-cfc4-4714-9a9b-c929f6626f53 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:25.698309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 556/1071] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:18:25 2022] GET /identity/v3/projects/7ca4edaa3c104cc98dd06dc863c9c464 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:25.700095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef27dd-9585-444a-900f-fc8770c9b94d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:25.763567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:25.809462 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc0ae1-e177-4ee2-8ce2-8579ea82bc86 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:25.809740 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc0ae1-e177-4ee2-8ce2-8579ea82bc86 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:25.810016 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc0ae1-e177-4ee2-8ce2-8579ea82bc86 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:25.811353 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 557/1072] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:25.813894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef27dd-9585-444a-900f-fc8770c9b94d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:25.816251 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192b148-2153-4fe8-bbc2-8bc5bb869b04 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:25.816564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192b148-2153-4fe8-bbc2-8bc5bb869b04 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:25.816841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192b148-2153-4fe8-bbc2-8bc5bb869b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:25.835079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b192b148-2153-4fe8-bbc2-8bc5bb869b04 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:25.836253 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b192b148-2153-4fe8-bbc2-8bc5bb869b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:25.850970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ab9ee-71cb-425c-9593-52b8a4c37864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:25.851579 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ab9ee-71cb-425c-9593-52b8a4c37864 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:25.851855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ab9ee-71cb-425c-9593-52b8a4c37864 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:25.852131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ab9ee-71cb-425c-9593-52b8a4c37864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:25.852873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ab9ee-71cb-425c-9593-52b8a4c37864 None admin] RBAC: Adding query filter params (role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.project.id=7ca4edaa3c104cc98dd06dc863c9c464, user.id=5d86559533694fc9a9265f91181c5b27) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:25.853181 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ab9ee-71cb-425c-9593-52b8a4c37864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:25.854631 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ab9ee-71cb-425c-9593-52b8a4c37864 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:25.868370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 516/1073] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:18:25 2022] GET /identity/v3/role_assignments?user.id=5d86559533694fc9a9265f91181c5b27&scope.project.id=7ca4edaa3c104cc98dd06dc863c9c464&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:25.919034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 558/1074] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:18:26.161145 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf02816-aecc-49ad-9331-cb607fc70d11 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:26.161492 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf02816-aecc-49ad-9331-cb607fc70d11 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:26.161705 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf02816-aecc-49ad-9331-cb607fc70d11 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:26.163188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 517/1075] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:26.168434 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39541b71-39b6-4a9b-9733-aa66198d9b4b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:26.168728 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39541b71-39b6-4a9b-9733-aa66198d9b4b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:26.169008 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39541b71-39b6-4a9b-9733-aa66198d9b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:26.187762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-39541b71-39b6-4a9b-9733-aa66198d9b4b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:26.188908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-39541b71-39b6-4a9b-9733-aa66198d9b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:26.191389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf02816-aecc-49ad-9331-cb607fc70d11 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:26.262519 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 559/1076] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:26.295361 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf02816-aecc-49ad-9331-cb607fc70d11 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:26.320898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:26.331573 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dc537-06d4-40e5-b8c4-a94dd5c3eff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:26.332769 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dc537-06d4-40e5-b8c4-a94dd5c3eff9 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:26.333046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dc537-06d4-40e5-b8c4-a94dd5c3eff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:26.339561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dc537-06d4-40e5-b8c4-a94dd5c3eff9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:26.343191 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22dc537-06d4-40e5-b8c4-a94dd5c3eff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:18:26.348025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-c22dc537-06d4-40e5-b8c4-a94dd5c3eff9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 16:18:26.348025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:26.348025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:26.348025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:26.348025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:26.348025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:26.348025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:26.348025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:26.348025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:26.348025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:26.348025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:26.348025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:26.348025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:18:26.348025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:18:26.348025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:18:26.348025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:18:26.349202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:18:26.349202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:18:26.349202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:18:26.349202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:18:26.349202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:26.349202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:26.349202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:26.349202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:26.349202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:26.349202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:26.349202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:26.349202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:26.349202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:26.349202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:26.349202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:26.349202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:26.350065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:26.350065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:26.350065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:26.350065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:26.350065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:18:26.350065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:18:26.350065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:18:26.350065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:18:26.350065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:18:26.350065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:18:26.350065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 16:18:26.350065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:26.350065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 518/1077] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Sep 27 16:18:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:18:26.356373 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39541b71-39b6-4a9b-9733-aa66198d9b4b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:26.380641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:26.454420 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39541b71-39b6-4a9b-9733-aa66198d9b4b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:26.487847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352ef2b-473a-41c5-8e08-cddc5d211481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:26.488481 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352ef2b-473a-41c5-8e08-cddc5d211481 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:26.488758 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352ef2b-473a-41c5-8e08-cddc5d211481 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:26.489027 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352ef2b-473a-41c5-8e08-cddc5d211481 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:26.489700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352ef2b-473a-41c5-8e08-cddc5d211481 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:26.489998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352ef2b-473a-41c5-8e08-cddc5d211481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:26.491345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352ef2b-473a-41c5-8e08-cddc5d211481 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:26.500105 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 560/1078] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Sep 27 16:18:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:26.505861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dc537-06d4-40e5-b8c4-a94dd5c3eff9 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:26.568578 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352ef2b-473a-41c5-8e08-cddc5d211481 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:26.610661 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dc537-06d4-40e5-b8c4-a94dd5c3eff9 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:26.644935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d574a7-1624-4bc4-be0f-3149c16b4104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:26.645566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d574a7-1624-4bc4-be0f-3149c16b4104 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:26.645840 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d574a7-1624-4bc4-be0f-3149c16b4104 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:26.646109 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d574a7-1624-4bc4-be0f-3149c16b4104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:26.656308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:26.656918 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d574a7-1624-4bc4-be0f-3149c16b4104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:26.658353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d574a7-1624-4bc4-be0f-3149c16b4104 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:26.672593 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352ef2b-473a-41c5-8e08-cddc5d211481 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:26.673782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-08d574a7-1624-4bc4-be0f-3149c16b4104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:26.673782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:26.673782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:26.673782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:26.673782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:26.673782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:26.673782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:26.673782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:26.673782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:26.673782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:26.673782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:26.673782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:26.673782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:18:26.673782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:18:26.673782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:18:26.673782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:18:26.674702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:26.674702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:26.674702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:26.674702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:26.674702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:26.674702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:26.674702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:26.674702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:26.674702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:26.674702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:26.674702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:26.674702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:26.674702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:26.674702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:26.674702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:26.674702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:26.674702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:18:26.675642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:18:26.675642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:26.675642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:26.675642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 519/1079] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:26.680610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d574a7-1624-4bc4-be0f-3149c16b4104 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:26.709933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d77d0-3b79-43c4-a0a1-dd3ee9aa84b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:26.710457 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d77d0-3b79-43c4-a0a1-dd3ee9aa84b7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:26.710731 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d77d0-3b79-43c4-a0a1-dd3ee9aa84b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:26.710999 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d77d0-3b79-43c4-a0a1-dd3ee9aa84b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:26.727325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:26.788208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d77d0-3b79-43c4-a0a1-dd3ee9aa84b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:26.789991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d77d0-3b79-43c4-a0a1-dd3ee9aa84b7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:26.791791 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d574a7-1624-4bc4-be0f-3149c16b4104 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:26.836368 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18268e4e-33ce-42a3-966a-bf9b6da70b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:26.837391 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18268e4e-33ce-42a3-966a-bf9b6da70b30 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:26.837876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18268e4e-33ce-42a3-966a-bf9b6da70b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:26.838331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18268e4e-33ce-42a3-966a-bf9b6da70b30 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:26.838994 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18268e4e-33ce-42a3-966a-bf9b6da70b30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:26.839837 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18268e4e-33ce-42a3-966a-bf9b6da70b30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:26.841242 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18268e4e-33ce-42a3-966a-bf9b6da70b30 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:26.859410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 520/1080] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:26.860243 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18268e4e-33ce-42a3-966a-bf9b6da70b30 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:26.887949 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:26.905173 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 561/1081] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:18:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 27 16:18:26.911093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d77d0-3b79-43c4-a0a1-dd3ee9aa84b7 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:26.958810 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:26.965915 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18268e4e-33ce-42a3-966a-bf9b6da70b30 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:27.000302 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56c38b-1efb-4edd-a76f-101c4c4b0cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:27.000955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56c38b-1efb-4edd-a76f-101c4c4b0cff None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:27.001234 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56c38b-1efb-4edd-a76f-101c4c4b0cff None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:27.001508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56c38b-1efb-4edd-a76f-101c4c4b0cff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:27.009223 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56c38b-1efb-4edd-a76f-101c4c4b0cff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:27.010803 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56c38b-1efb-4edd-a76f-101c4c4b0cff None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:27.015326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d77d0-3b79-43c4-a0a1-dd3ee9aa84b7 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:27.026008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-cc56c38b-1efb-4edd-a76f-101c4c4b0cff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 16:18:27.026008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:27.026008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:27.026008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:27.026008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:27.026008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:27.026008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:27.026008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:27.026008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:27.026008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:27.026008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:27.026008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:27.026008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:18:27.026008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:18:27.026008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:18:27.026008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:18:27.027659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:27.027659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:27.027659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:18:27.027659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:18:27.027659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:18:27.027659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:18:27.027659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:27.027659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:27.027659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:27.027659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:27.027659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:27.027659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:27.027659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:27.027659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:27.027659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:27.027659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:27.027659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:27.027659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:27.029363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:27.029363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:27.029363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:18:27.029363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:18:27.029363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:18:27.029363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:18:27.029363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:18:27.029363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:18:27.029363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 16:18:27.029363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:27.029363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 521/1082] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Sep 27 16:18:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:27.033611 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56c38b-1efb-4edd-a76f-101c4c4b0cff None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:27.052889 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aadc21-56d3-4ea4-844a-ed0ea959a2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:27.053519 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aadc21-56d3-4ea4-844a-ed0ea959a2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:27.053798 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aadc21-56d3-4ea4-844a-ed0ea959a2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:27.054072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aadc21-56d3-4ea4-844a-ed0ea959a2e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:27.063985 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aadc21-56d3-4ea4-844a-ed0ea959a2e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:27.065452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aadc21-56d3-4ea4-844a-ed0ea959a2e1 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:27.081480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-39aadc21-56d3-4ea4-844a-ed0ea959a2e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:27.081480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:27.081480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:27.081480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:27.081480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:27.081480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:27.081480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:27.081480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:27.081480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:27.081480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:27.081480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:27.081480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:27.081480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:18:27.081480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:18:27.081480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:18:27.081480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:18:27.082531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:27.082531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:27.082531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:27.082531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:27.082531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:27.082531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:27.082531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:27.082531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:27.082531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:27.082531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:27.082531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:27.082531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:27.082531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:27.082531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:27.082531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:27.082531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:27.082531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:18:27.083462 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:18:27.083462 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:27.083462 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:27.083462 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 562/1083] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:18:27.088509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aadc21-56d3-4ea4-844a-ed0ea959a2e1 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:27.126333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:27.144550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56c38b-1efb-4edd-a76f-101c4c4b0cff None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:27.182497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71313add-5bb5-4c24-94ab-15769a9b3246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:27.183181 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71313add-5bb5-4c24-94ab-15769a9b3246 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:27.183469 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71313add-5bb5-4c24-94ab-15769a9b3246 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:27.183921 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71313add-5bb5-4c24-94ab-15769a9b3246 None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:27.184524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71313add-5bb5-4c24-94ab-15769a9b3246 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:27.184805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71313add-5bb5-4c24-94ab-15769a9b3246 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:27.186237 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71313add-5bb5-4c24-94ab-15769a9b3246 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:27.193418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aadc21-56d3-4ea4-844a-ed0ea959a2e1 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:27.209614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 522/1084] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Sep 27 16:18:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:27.210494 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71313add-5bb5-4c24-94ab-15769a9b3246 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:27.225939 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:27.231177 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c830ac0-e907-4702-8bde-dd45b712cff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:27.238544 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c830ac0-e907-4702-8bde-dd45b712cff5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:27.238544 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c830ac0-e907-4702-8bde-dd45b712cff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:27.238544 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c830ac0-e907-4702-8bde-dd45b712cff5 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:27.238544 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c830ac0-e907-4702-8bde-dd45b712cff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:27.238544 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c830ac0-e907-4702-8bde-dd45b712cff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:27.238544 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c830ac0-e907-4702-8bde-dd45b712cff5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:27.246665 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 563/1085] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:27.318789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71313add-5bb5-4c24-94ab-15769a9b3246 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:27.357239 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf0dd1-7f29-4937-b912-822193613e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:27.357906 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf0dd1-7f29-4937-b912-822193613e3f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:27.358136 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf0dd1-7f29-4937-b912-822193613e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:27.358414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf0dd1-7f29-4937-b912-822193613e3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:27.431235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf0dd1-7f29-4937-b912-822193613e3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:27.432703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf0dd1-7f29-4937-b912-822193613e3f None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:27.450144 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:27.536400 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 523/1086] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:18:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 27 16:18:27.542249 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c830ac0-e907-4702-8bde-dd45b712cff5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:27.642570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:27.648703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c830ac0-e907-4702-8bde-dd45b712cff5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:27.681988 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfad30-f8cd-437f-a26c-15813d3b67e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:27.682603 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfad30-f8cd-437f-a26c-15813d3b67e6 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:27.682876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfad30-f8cd-437f-a26c-15813d3b67e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:27.683667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfad30-f8cd-437f-a26c-15813d3b67e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:27.693355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfad30-f8cd-437f-a26c-15813d3b67e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:27.694783 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfad30-f8cd-437f-a26c-15813d3b67e6 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:27.709455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-28cfad30-f8cd-437f-a26c-15813d3b67e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:27.709455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:27.709455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:27.709455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:27.709455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:27.709455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:27.709455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:27.709455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:27.709455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:27.709455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:27.709455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:27.709455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:27.709455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:18:27.709455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:18:27.709455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:18:27.709455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:18:27.710570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:27.710570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:27.710570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:27.710570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:27.710570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:27.710570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:27.710570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:27.710570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:27.710570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:27.710570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:27.710570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:27.710570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:27.710570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:27.710570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:27.710570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:27.710570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:27.710570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:18:27.711484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:18:27.711484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:18:27.711484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:27.711484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 564/1087] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:18:27.716191 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf0dd1-7f29-4937-b912-822193613e3f None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:27.818977 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf0dd1-7f29-4937-b912-822193613e3f None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:27.832517 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:27.851385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451d45d-63eb-4025-b742-1e1e2606e014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:27.851987 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451d45d-63eb-4025-b742-1e1e2606e014 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:27.852264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451d45d-63eb-4025-b742-1e1e2606e014 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:27.852564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451d45d-63eb-4025-b742-1e1e2606e014 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:27.853191 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451d45d-63eb-4025-b742-1e1e2606e014 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:27.853489 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451d45d-63eb-4025-b742-1e1e2606e014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:27.854841 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451d45d-63eb-4025-b742-1e1e2606e014 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:27.866667 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 524/1088] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:27.872942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfad30-f8cd-437f-a26c-15813d3b67e6 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:27.976209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfad30-f8cd-437f-a26c-15813d3b67e6 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:28.010276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d3401-8538-429d-a2dc-3629662364cc None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:28.010605 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d3401-8538-429d-a2dc-3629662364cc None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:28.010812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d3401-8538-429d-a2dc-3629662364cc None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:28.011841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87099e-475a-40c4-9297-07848682f526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:28.012271 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 525/1089] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:18:28.012517 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87099e-475a-40c4-9297-07848682f526 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:28.012801 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87099e-475a-40c4-9297-07848682f526 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:28.013080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87099e-475a-40c4-9297-07848682f526 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:28.016868 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b53cf0-2c4e-40a6-bcb5-37bcf01ce7de None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:28.017146 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b53cf0-2c4e-40a6-bcb5-37bcf01ce7de None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:28.017415 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b53cf0-2c4e-40a6-bcb5-37bcf01ce7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:28.019981 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87099e-475a-40c4-9297-07848682f526 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:28.021389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87099e-475a-40c4-9297-07848682f526 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:28.033529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-0a87099e-475a-40c4-9297-07848682f526 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:18:28.033529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:28.033529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:28.033529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:28.033529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:28.033529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:28.033529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:28.033529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:28.033529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:28.033529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:28.033529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:28.033529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:28.033529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:18:28.033529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:18:28.033529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:18:28.034485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:18:28.034485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:28.034485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:28.034485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:28.034485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:28.034485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:28.034485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:28.034485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:28.034485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:28.034485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:28.034485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:28.034485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:28.034485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:28.034485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:28.034485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:28.034485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:28.034485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:28.035415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:18:28.035415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:18:28.035415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:18:28.035415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:18:28.035415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:18:28.035415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:18:28.035415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:18:28.035415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:28.035415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 565/1090] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:18:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:18:28.036565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-a0b53cf0-2c4e-40a6-bcb5-37bcf01ce7de None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:28.037747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a0b53cf0-2c4e-40a6-bcb5-37bcf01ce7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:28.040267 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87099e-475a-40c4-9297-07848682f526 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:28.051952 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:28.107460 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 526/1091] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:18:28.153322 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87099e-475a-40c4-9297-07848682f526 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:28.185819 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef384e5-c05f-4b0a-803c-7fb2e009097c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:28.186413 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef384e5-c05f-4b0a-803c-7fb2e009097c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:28.186692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef384e5-c05f-4b0a-803c-7fb2e009097c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:28.186963 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef384e5-c05f-4b0a-803c-7fb2e009097c None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:28.187636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef384e5-c05f-4b0a-803c-7fb2e009097c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:28.187939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef384e5-c05f-4b0a-803c-7fb2e009097c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:28.189391 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef384e5-c05f-4b0a-803c-7fb2e009097c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:28.200922 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 566/1092] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:18:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:28.206977 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b53cf0-2c4e-40a6-bcb5-37bcf01ce7de None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:28.304306 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b53cf0-2c4e-40a6-bcb5-37bcf01ce7de None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:28.306522 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:28.337623 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c96f47-80bf-4be7-976d-d45e0aaf8e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:28.338247 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c96f47-80bf-4be7-976d-d45e0aaf8e88 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:28.338529 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c96f47-80bf-4be7-976d-d45e0aaf8e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:28.338806 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c96f47-80bf-4be7-976d-d45e0aaf8e88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:28.340059 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c96f47-80bf-4be7-976d-d45e0aaf8e88 None admin] RBAC: Adding query filter params (role.id=550538ff801d4fd08b79738d5b5897f6, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=e71fea96b2b949f9abca12172e69284b) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:28.340399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c96f47-80bf-4be7-976d-d45e0aaf8e88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:28.341836 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c96f47-80bf-4be7-976d-d45e0aaf8e88 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:28.347538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 527/1093] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:18:28 2022] GET /identity/v3/role_assignments?user.id=e71fea96b2b949f9abca12172e69284b&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=550538ff801d4fd08b79738d5b5897f6 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:28.375375 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef384e5-c05f-4b0a-803c-7fb2e009097c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:28.447632 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:28.483168 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef384e5-c05f-4b0a-803c-7fb2e009097c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:28.519793 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bf743-9f6d-4908-8f93-6697c3be8f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:28.520471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bf743-9f6d-4908-8f93-6697c3be8f98 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:28.520751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bf743-9f6d-4908-8f93-6697c3be8f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:28.521026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bf743-9f6d-4908-8f93-6697c3be8f98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:28.531991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8bf743-9f6d-4908-8f93-6697c3be8f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:18:28.536895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-cf8bf743-9f6d-4908-8f93-6697c3be8f98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:18:28.536895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:28.536895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:28.536895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:28.536895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:28.536895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:28.536895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:28.536895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:28.536895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:28.536895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:28.536895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:28.536895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:28.536895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:18:28.536895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:18:28.536895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:18:28.536895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:18:28.537910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:18:28.537910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:18:28.537910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:18:28.537910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:18:28.537910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:28.537910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:28.537910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:28.537910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:28.537910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:28.537910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:28.537910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:28.537910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:28.537910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:28.537910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:28.537910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:28.537910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:28.539174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:28.539174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:28.539174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:28.539174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:28.539174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:18:28.539174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:18:28.539174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:18:28.539174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:18:28.539174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:18:28.539174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:18:28.539174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:18:28.539174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:18:28.539174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 567/1094] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:18:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:28.544054 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c96f47-80bf-4be7-976d-d45e0aaf8e88 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:28.644786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c96f47-80bf-4be7-976d-d45e0aaf8e88 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:28.678574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157f59d-21b6-4a12-9ff9-13d083166dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:28.679186 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f59d-21b6-4a12-9ff9-13d083166dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:28.679459 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f59d-21b6-4a12-9ff9-13d083166dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:28.679729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f59d-21b6-4a12-9ff9-13d083166dd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:28.680405 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157f59d-21b6-4a12-9ff9-13d083166dd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:28.680709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157f59d-21b6-4a12-9ff9-13d083166dd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:28.682074 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157f59d-21b6-4a12-9ff9-13d083166dd7 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:28.690712 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 528/1095] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:18:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:28.696563 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bf743-9f6d-4908-8f93-6697c3be8f98 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:28.802291 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bf743-9f6d-4908-8f93-6697c3be8f98 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:28.829949 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:28.838874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bc68c-68f8-4f52-b9fe-7e99f39668ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:28.840234 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bc68c-68f8-4f52-b9fe-7e99f39668ec None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:28.840543 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bc68c-68f8-4f52-b9fe-7e99f39668ec None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:28.840872 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bc68c-68f8-4f52-b9fe-7e99f39668ec None admin] PATH_INFO: `/v3/users/5d86559533694fc9a9265f91181c5b27` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:28.841952 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bc68c-68f8-4f52-b9fe-7e99f39668ec None admin] RBAC: Authorizing `identity:get_user(user_id=5d86559533694fc9a9265f91181c5b27)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:28.843381 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bc68c-68f8-4f52-b9fe-7e99f39668ec None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:28.845034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 568/1096] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:18:28 2022] GET /identity/v3/users/5d86559533694fc9a9265f91181c5b27 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:28.852822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157f59d-21b6-4a12-9ff9-13d083166dd7 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:28.882613 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:28.953465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157f59d-21b6-4a12-9ff9-13d083166dd7 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:28.986790 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c88c91-6b95-4d14-a9f9-6ffdee440ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:28.987416 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c88c91-6b95-4d14-a9f9-6ffdee440ace None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:28.987696 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c88c91-6b95-4d14-a9f9-6ffdee440ace None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:28.987967 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c88c91-6b95-4d14-a9f9-6ffdee440ace None admin] PATH_INFO: `/v3/projects/7ca4edaa3c104cc98dd06dc863c9c464` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:28.989095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c88c91-6b95-4d14-a9f9-6ffdee440ace None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4edaa3c104cc98dd06dc863c9c464)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:28.990519 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c88c91-6b95-4d14-a9f9-6ffdee440ace None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:28.992127 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 529/1097] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:18:28 2022] GET /identity/v3/projects/7ca4edaa3c104cc98dd06dc863c9c464 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:28.998480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bc68c-68f8-4f52-b9fe-7e99f39668ec None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:29.103789 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bc68c-68f8-4f52-b9fe-7e99f39668ec None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:29.140071 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bad5e-b6dd-46e1-923c-ca4ee008aecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:29.140760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bad5e-b6dd-46e1-923c-ca4ee008aecc None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:29.141043 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bad5e-b6dd-46e1-923c-ca4ee008aecc None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:29.141320 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bad5e-b6dd-46e1-923c-ca4ee008aecc None admin] PATH_INFO: `/v3/projects/7ca4edaa3c104cc98dd06dc863c9c464/users/5d86559533694fc9a9265f91181c5b27/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:29.143220 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bad5e-b6dd-46e1-923c-ca4ee008aecc None admin] RBAC: Authorizing `identity:create_grant(project_id=7ca4edaa3c104cc98dd06dc863c9c464, user_id=5d86559533694fc9a9265f91181c5b27, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:29.144676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bad5e-b6dd-46e1-923c-ca4ee008aecc None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:29.227534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 569/1098] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:18:28 2022] PUT /identity/v3/projects/7ca4edaa3c104cc98dd06dc863c9c464/users/5d86559533694fc9a9265f91181c5b27/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:18:31.462633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca41b1-ffcf-40cd-b1d8-0a7b0ed17fc7 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:31.463189 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca41b1-ffcf-40cd-b1d8-0a7b0ed17fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:31.463189 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca41b1-ffcf-40cd-b1d8-0a7b0ed17fc7 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:31.464580 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 530/1099] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:31.469792 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fce7f-07bf-459e-94a5-7a6713c349c1 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:31.470227 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fce7f-07bf-459e-94a5-7a6713c349c1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:31.470340 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fce7f-07bf-459e-94a5-7a6713c349c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:31.488786 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-e90fce7f-07bf-459e-94a5-7a6713c349c1 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:31.489945 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e90fce7f-07bf-459e-94a5-7a6713c349c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:31.543596 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:31.559549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 570/1100] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:18:31.860279 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca41b1-ffcf-40cd-b1d8-0a7b0ed17fc7 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:31.956402 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:31.960762 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca41b1-ffcf-40cd-b1d8-0a7b0ed17fc7 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:31.994659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd01425-39e2-4f8f-8111-8b7a523f0dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:31.995300 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd01425-39e2-4f8f-8111-8b7a523f0dfc None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:31.996096 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd01425-39e2-4f8f-8111-8b7a523f0dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:31.996394 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd01425-39e2-4f8f-8111-8b7a523f0dfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:32.006256 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd01425-39e2-4f8f-8111-8b7a523f0dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:18:32.011153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-1cd01425-39e2-4f8f-8111-8b7a523f0dfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:18:32.011153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:32.011153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:32.011153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:32.011153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:32.011153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:32.011153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:32.011153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:32.011153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:32.011153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:32.011153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:32.011153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:32.011153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:18:32.011153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:18:32.011153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:18:32.011153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:18:32.012797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:18:32.012797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:18:32.012797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:18:32.012797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:18:32.012797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:32.012797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:32.012797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:32.012797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:32.012797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:32.012797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:32.012797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:32.012797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:32.012797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:32.012797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:32.012797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:32.012797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:32.013996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:32.013996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:32.013996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:32.013996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:32.013996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:18:32.013996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:18:32.013996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:18:32.013996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:18:32.013996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:18:32.013996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:18:32.013996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:18:32.013996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:32.013996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 531/1101] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:18:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:32.018797 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fce7f-07bf-459e-94a5-7a6713c349c1 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:32.115156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fce7f-07bf-459e-94a5-7a6713c349c1 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:32.148398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1d517-1cb9-4b8c-b5e5-0399323cea40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:32.148997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1d517-1cb9-4b8c-b5e5-0399323cea40 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:32.154564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1d517-1cb9-4b8c-b5e5-0399323cea40 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:32.154564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1d517-1cb9-4b8c-b5e5-0399323cea40 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:32.154564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1d517-1cb9-4b8c-b5e5-0399323cea40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:32.154564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1d517-1cb9-4b8c-b5e5-0399323cea40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:32.154564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1d517-1cb9-4b8c-b5e5-0399323cea40 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:32.159677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 571/1102] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:18:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:32.165529 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd01425-39e2-4f8f-8111-8b7a523f0dfc None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:32.264457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd01425-39e2-4f8f-8111-8b7a523f0dfc None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:32.298197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a1754-4302-4768-92a2-3494c793585f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:32.298827 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a1754-4302-4768-92a2-3494c793585f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:32.299108 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a1754-4302-4768-92a2-3494c793585f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:32.299385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a1754-4302-4768-92a2-3494c793585f None admin] PATH_INFO: `/v3/users/5d86559533694fc9a9265f91181c5b27` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:32.300528 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a1754-4302-4768-92a2-3494c793585f None admin] RBAC: Authorizing `identity:get_user(user_id=5d86559533694fc9a9265f91181c5b27)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:32.301966 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a1754-4302-4768-92a2-3494c793585f None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:32.303539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 532/1103] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:18:32 2022] GET /identity/v3/users/5d86559533694fc9a9265f91181c5b27 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:32.309995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1d517-1cb9-4b8c-b5e5-0399323cea40 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:32.363971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:32.413797 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1d517-1cb9-4b8c-b5e5-0399323cea40 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:32.447278 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337e923-6539-462e-b2c2-ff3816c96752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:32.447881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337e923-6539-462e-b2c2-ff3816c96752 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:32.448160 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337e923-6539-462e-b2c2-ff3816c96752 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:32.448466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337e923-6539-462e-b2c2-ff3816c96752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:32.543519 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337e923-6539-462e-b2c2-ff3816c96752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:32.545278 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337e923-6539-462e-b2c2-ff3816c96752 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:32.596899 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:32.661667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 572/1104] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:18:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 16:18:32.669566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a1754-4302-4768-92a2-3494c793585f None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:32.703125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:32.780882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a1754-4302-4768-92a2-3494c793585f None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:32.822518 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f33041-2bb7-4145-a1c9-fe732616d216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:32.823159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f33041-2bb7-4145-a1c9-fe732616d216 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:32.823443 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f33041-2bb7-4145-a1c9-fe732616d216 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:32.823746 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f33041-2bb7-4145-a1c9-fe732616d216 None admin] PATH_INFO: `/v3/projects/7ca4edaa3c104cc98dd06dc863c9c464` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:32.824955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f33041-2bb7-4145-a1c9-fe732616d216 None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4edaa3c104cc98dd06dc863c9c464)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:32.827804 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f33041-2bb7-4145-a1c9-fe732616d216 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:32.829569 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 533/1105] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:18:32 2022] GET /identity/v3/projects/7ca4edaa3c104cc98dd06dc863c9c464 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:32.836767 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337e923-6539-462e-b2c2-ff3816c96752 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:32.934443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337e923-6539-462e-b2c2-ff3816c96752 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:32.967734 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3b48d-70c2-4ee7-a179-462a404dd52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:32.968326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3b48d-70c2-4ee7-a179-462a404dd52d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:32.968637 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3b48d-70c2-4ee7-a179-462a404dd52d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:32.968910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3b48d-70c2-4ee7-a179-462a404dd52d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:32.969614 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3b48d-70c2-4ee7-a179-462a404dd52d None admin] RBAC: Adding query filter params (role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.project.id=7ca4edaa3c104cc98dd06dc863c9c464, user.id=5d86559533694fc9a9265f91181c5b27) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:32.969918 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3b48d-70c2-4ee7-a179-462a404dd52d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:32.971328 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3b48d-70c2-4ee7-a179-462a404dd52d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:32.976893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 573/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:18:32 2022] GET /identity/v3/role_assignments?user.id=5d86559533694fc9a9265f91181c5b27&scope.project.id=7ca4edaa3c104cc98dd06dc863c9c464&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:35.178292 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ff848-046c-4105-af35-33b3af870b6b None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:35.178796 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ff848-046c-4105-af35-33b3af870b6b None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:35.178796 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ff848-046c-4105-af35-33b3af870b6b None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:35.180061 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 534/1107] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:35.185417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fe8c6-127f-4a81-a764-f547d98199c7 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:35.185806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fe8c6-127f-4a81-a764-f547d98199c7 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:35.185999 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fe8c6-127f-4a81-a764-f547d98199c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:35.204289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-358fe8c6-127f-4a81-a764-f547d98199c7 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:35.205494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-358fe8c6-127f-4a81-a764-f547d98199c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:35.212570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:35.271613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 574/1108] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:18:35.543338 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ff848-046c-4105-af35-33b3af870b6b None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:35.633805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:35.641116 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ff848-046c-4105-af35-33b3af870b6b None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:35.674081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0ac9a-1472-433f-965a-e65f02105d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:35.674698 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0ac9a-1472-433f-965a-e65f02105d9f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:35.674978 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0ac9a-1472-433f-965a-e65f02105d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:35.675251 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0ac9a-1472-433f-965a-e65f02105d9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:35.676368 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0ac9a-1472-433f-965a-e65f02105d9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:35.677801 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0ac9a-1472-433f-965a-e65f02105d9f None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:35.679327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 535/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:35.685195 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fe8c6-127f-4a81-a764-f547d98199c7 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:35.782024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fe8c6-127f-4a81-a764-f547d98199c7 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:35.815274 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223cf6b-03b3-4bad-b54e-d71338b8c488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:35.815876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223cf6b-03b3-4bad-b54e-d71338b8c488 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:35.816155 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223cf6b-03b3-4bad-b54e-d71338b8c488 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:35.816460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223cf6b-03b3-4bad-b54e-d71338b8c488 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:35.817110 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223cf6b-03b3-4bad-b54e-d71338b8c488 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:35.818525 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223cf6b-03b3-4bad-b54e-d71338b8c488 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:35.911056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:35.916536 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 575/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 27 16:18:35 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:18:38.073606 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d65061-6152-404e-abb8-0b59d4b279b7 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:38.074133 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d65061-6152-404e-abb8-0b59d4b279b7 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:38.074133 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d65061-6152-404e-abb8-0b59d4b279b7 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:38.075397 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 536/1111] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:38.080600 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c99b1-478b-416c-8856-fc6bc470da47 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:38.081013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c99b1-478b-416c-8856-fc6bc470da47 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:38.081154 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c99b1-478b-416c-8856-fc6bc470da47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:38.099296 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-646c99b1-478b-416c-8856-fc6bc470da47 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:38.100512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-646c99b1-478b-416c-8856-fc6bc470da47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:38.164608 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 576/1112] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:38.435542 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d65061-6152-404e-abb8-0b59d4b279b7 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:38.613180 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d65061-6152-404e-abb8-0b59d4b279b7 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:38.646392 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa486e8-628c-461b-8e4b-ae854840d1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:38.647009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa486e8-628c-461b-8e4b-ae854840d1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:38.647287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa486e8-628c-461b-8e4b-ae854840d1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:38.647557 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa486e8-628c-461b-8e4b-ae854840d1d4 None admin] PATH_INFO: `/v3/roles/f60b6d7b309a4537a233198456c7aa34` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:38.648941 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa486e8-628c-461b-8e4b-ae854840d1d4 None admin] RBAC: Authorizing `identity:get_role(role_id=f60b6d7b309a4537a233198456c7aa34)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:38.650304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa486e8-628c-461b-8e4b-ae854840d1d4 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:38.651629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 537/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:18:38 2022] GET /identity/v3/roles/f60b6d7b309a4537a233198456c7aa34 => generated 223 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:38.657493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c99b1-478b-416c-8856-fc6bc470da47 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:38.751834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c99b1-478b-416c-8856-fc6bc470da47 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:38.777137 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:38.784552 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3df80-6694-490a-91b3-19d893ff1ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:38.785174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3df80-6694-490a-91b3-19d893ff1ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:38.785488 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3df80-6694-490a-91b3-19d893ff1ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:38.785722 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3df80-6694-490a-91b3-19d893ff1ba8 None admin] PATH_INFO: `/v3/users/3e47d0abc8e943c4901e38f8fb511077` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:38.798813 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3df80-6694-490a-91b3-19d893ff1ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=3e47d0abc8e943c4901e38f8fb511077)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:38.800246 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3df80-6694-490a-91b3-19d893ff1ba8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:38.801895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 577/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:18:38 2022] GET /identity/v3/users/3e47d0abc8e943c4901e38f8fb511077 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:38.812069 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa486e8-628c-461b-8e4b-ae854840d1d4 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:38.845998 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:38.912673 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa486e8-628c-461b-8e4b-ae854840d1d4 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:38.945221 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bf7bf-a916-4a4f-9481-17544d66fe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:38.945810 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bf7bf-a916-4a4f-9481-17544d66fe3d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:38.946086 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bf7bf-a916-4a4f-9481-17544d66fe3d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:38.946354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bf7bf-a916-4a4f-9481-17544d66fe3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:39.011108 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8bf7bf-a916-4a4f-9481-17544d66fe3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:39.012504 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8bf7bf-a916-4a4f-9481-17544d66fe3d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:39.039277 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:39.107893 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 538/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:18:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 16:18:39.113836 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3df80-6694-490a-91b3-19d893ff1ba8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:39.209203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3df80-6694-490a-91b3-19d893ff1ba8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:39.241321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d472e-8ae4-4249-9015-0159268ef812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:39.241925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d472e-8ae4-4249-9015-0159268ef812 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:39.242203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d472e-8ae4-4249-9015-0159268ef812 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:39.242474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d472e-8ae4-4249-9015-0159268ef812 None admin] PATH_INFO: `/v3/projects/7ca4edaa3c104cc98dd06dc863c9c464` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:39.243564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d472e-8ae4-4249-9015-0159268ef812 None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4edaa3c104cc98dd06dc863c9c464)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:39.245002 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d472e-8ae4-4249-9015-0159268ef812 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:39.246670 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 578/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:18:39 2022] GET /identity/v3/projects/7ca4edaa3c104cc98dd06dc863c9c464 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:39.252579 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bf7bf-a916-4a4f-9481-17544d66fe3d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:39.347223 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bf7bf-a916-4a4f-9481-17544d66fe3d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:39.374363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:39.379838 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca53e99-6eae-4e5a-9cea-89d051c26cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:39.380446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca53e99-6eae-4e5a-9cea-89d051c26cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:39.380725 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca53e99-6eae-4e5a-9cea-89d051c26cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:39.380995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca53e99-6eae-4e5a-9cea-89d051c26cc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:39.390374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca53e99-6eae-4e5a-9cea-89d051c26cc6 None admin] RBAC: Adding query filter params (role.id=f60b6d7b309a4537a233198456c7aa34, scope.project.id=7ca4edaa3c104cc98dd06dc863c9c464, user.id=3e47d0abc8e943c4901e38f8fb511077) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:39.390374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca53e99-6eae-4e5a-9cea-89d051c26cc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:39.390374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca53e99-6eae-4e5a-9cea-89d051c26cc6 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:39.390374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 539/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:18:39 2022] GET /identity/v3/role_assignments?user.id=3e47d0abc8e943c4901e38f8fb511077&scope.project.id=7ca4edaa3c104cc98dd06dc863c9c464&role.id=f60b6d7b309a4537a233198456c7aa34 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:41.482836 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdc331-43fb-4096-b1ba-794b1a7eea16 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:41.483363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdc331-43fb-4096-b1ba-794b1a7eea16 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:41.483363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdc331-43fb-4096-b1ba-794b1a7eea16 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:41.484759 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 579/1118] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:41.489937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de73612-353d-4512-a36e-483af1bdd784 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:41.490335 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de73612-353d-4512-a36e-483af1bdd784 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:41.490484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de73612-353d-4512-a36e-483af1bdd784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:41.508785 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-8de73612-353d-4512-a36e-483af1bdd784 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:41.509966 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-8de73612-353d-4512-a36e-483af1bdd784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:41.574869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 540/1119] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:41.848457 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdc331-43fb-4096-b1ba-794b1a7eea16 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:41.902886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:41.946304 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdc331-43fb-4096-b1ba-794b1a7eea16 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:41.978825 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b8d07-5628-44f8-8488-a0c50d210c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:41.979430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b8d07-5628-44f8-8488-a0c50d210c45 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:41.979726 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b8d07-5628-44f8-8488-a0c50d210c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:41.979993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b8d07-5628-44f8-8488-a0c50d210c45 None admin] PATH_INFO: `/v3/roles/f60b6d7b309a4537a233198456c7aa34` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:41.981382 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b8d07-5628-44f8-8488-a0c50d210c45 None admin] RBAC: Authorizing `identity:get_role(role_id=f60b6d7b309a4537a233198456c7aa34)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:41.982721 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b8d07-5628-44f8-8488-a0c50d210c45 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:41.983999 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 580/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:18:41 2022] GET /identity/v3/roles/f60b6d7b309a4537a233198456c7aa34 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:41.989676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de73612-353d-4512-a36e-483af1bdd784 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:42.084177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de73612-353d-4512-a36e-483af1bdd784 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:42.106896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:42.117288 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977af305-07d6-46d9-8b5c-1d730c572fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:42.117902 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977af305-07d6-46d9-8b5c-1d730c572fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:42.118178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977af305-07d6-46d9-8b5c-1d730c572fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:42.118444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977af305-07d6-46d9-8b5c-1d730c572fc8 None admin] PATH_INFO: `/v3/users/3e47d0abc8e943c4901e38f8fb511077` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:42.119531 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977af305-07d6-46d9-8b5c-1d730c572fc8 None admin] RBAC: Authorizing `identity:get_user(user_id=3e47d0abc8e943c4901e38f8fb511077)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:42.120995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977af305-07d6-46d9-8b5c-1d730c572fc8 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:42.122528 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 541/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:18:41 2022] GET /identity/v3/users/3e47d0abc8e943c4901e38f8fb511077 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:42.128384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b8d07-5628-44f8-8488-a0c50d210c45 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:42.223546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b8d07-5628-44f8-8488-a0c50d210c45 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:42.245316 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:42.256202 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f8a33-723b-4c40-bce0-e4d01462798c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:42.256837 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f8a33-723b-4c40-bce0-e4d01462798c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:42.261392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f8a33-723b-4c40-bce0-e4d01462798c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:42.261392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f8a33-723b-4c40-bce0-e4d01462798c None admin] PATH_INFO: `/v3/projects/7ca4edaa3c104cc98dd06dc863c9c464` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:42.261392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f8a33-723b-4c40-bce0-e4d01462798c None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4edaa3c104cc98dd06dc863c9c464)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:42.261392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f8a33-723b-4c40-bce0-e4d01462798c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:42.262007 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 581/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:18:42 2022] GET /identity/v3/projects/7ca4edaa3c104cc98dd06dc863c9c464 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:42.267778 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977af305-07d6-46d9-8b5c-1d730c572fc8 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:42.363212 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977af305-07d6-46d9-8b5c-1d730c572fc8 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:42.394841 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313d9cb-e5b9-4502-ac1e-1b0c8315de98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:42.395474 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313d9cb-e5b9-4502-ac1e-1b0c8315de98 None admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:42.395750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313d9cb-e5b9-4502-ac1e-1b0c8315de98 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:42.396022 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313d9cb-e5b9-4502-ac1e-1b0c8315de98 None admin] PATH_INFO: `/v3/projects/7ca4edaa3c104cc98dd06dc863c9c464/users/3e47d0abc8e943c4901e38f8fb511077/roles/f60b6d7b309a4537a233198456c7aa34` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:42.398133 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313d9cb-e5b9-4502-ac1e-1b0c8315de98 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ca4edaa3c104cc98dd06dc863c9c464, user_id=3e47d0abc8e943c4901e38f8fb511077, role_id=f60b6d7b309a4537a233198456c7aa34)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:42.399549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313d9cb-e5b9-4502-ac1e-1b0c8315de98 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:42.448692 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 542/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:18:42 2022] PUT /identity/v3/projects/7ca4edaa3c104cc98dd06dc863c9c464/users/3e47d0abc8e943c4901e38f8fb511077/roles/f60b6d7b309a4537a233198456c7aa34 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:18:44.536406 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8899398-4a8a-4ca9-b1f1-17b4651e065b None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:44.536971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8899398-4a8a-4ca9-b1f1-17b4651e065b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:44.536971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8899398-4a8a-4ca9-b1f1-17b4651e065b None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:44.538270 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 582/1124] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:44.543893 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02244915-cce5-4e15-9b0e-118bf559db8a None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:44.544314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02244915-cce5-4e15-9b0e-118bf559db8a None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:44.544480 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02244915-cce5-4e15-9b0e-118bf559db8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:44.563302 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-02244915-cce5-4e15-9b0e-118bf559db8a None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:44.564530 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-02244915-cce5-4e15-9b0e-118bf559db8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:44.610602 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:44.629127 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 543/1125] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:18:44.897294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8899398-4a8a-4ca9-b1f1-17b4651e065b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:44.995558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8899398-4a8a-4ca9-b1f1-17b4651e065b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:45.028635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b57c6-14ed-49d7-913f-ceb82fef394f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:45.029245 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b57c6-14ed-49d7-913f-ceb82fef394f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:45.029522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b57c6-14ed-49d7-913f-ceb82fef394f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:45.029793 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b57c6-14ed-49d7-913f-ceb82fef394f None admin] PATH_INFO: `/v3/roles/f60b6d7b309a4537a233198456c7aa34` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:45.031167 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b57c6-14ed-49d7-913f-ceb82fef394f None admin] RBAC: Authorizing `identity:get_role(role_id=f60b6d7b309a4537a233198456c7aa34)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:45.032549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b57c6-14ed-49d7-913f-ceb82fef394f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:45.033832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 583/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:18:44 2022] GET /identity/v3/roles/f60b6d7b309a4537a233198456c7aa34 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:45.039405 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02244915-cce5-4e15-9b0e-118bf559db8a None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:45.133988 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02244915-cce5-4e15-9b0e-118bf559db8a None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:45.167073 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a16be-2d51-4aa7-8606-745a5679e67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:45.167681 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a16be-2d51-4aa7-8606-745a5679e67b None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:45.167959 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a16be-2d51-4aa7-8606-745a5679e67b None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:45.168229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a16be-2d51-4aa7-8606-745a5679e67b None admin] PATH_INFO: `/v3/users/3e47d0abc8e943c4901e38f8fb511077` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:45.169365 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a16be-2d51-4aa7-8606-745a5679e67b None admin] RBAC: Authorizing `identity:get_user(user_id=3e47d0abc8e943c4901e38f8fb511077)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:45.171050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a16be-2d51-4aa7-8606-745a5679e67b None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:45.172617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 544/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:18:45 2022] GET /identity/v3/users/3e47d0abc8e943c4901e38f8fb511077 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:45.178078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b57c6-14ed-49d7-913f-ceb82fef394f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:45.234474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:45.273042 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b57c6-14ed-49d7-913f-ceb82fef394f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:45.305370 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486a87e-640b-412d-baa5-ca6b655eb18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:45.305949 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486a87e-640b-412d-baa5-ca6b655eb18d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:45.306223 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486a87e-640b-412d-baa5-ca6b655eb18d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:45.306491 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486a87e-640b-412d-baa5-ca6b655eb18d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:45.369996 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486a87e-640b-412d-baa5-ca6b655eb18d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:45.371430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486a87e-640b-412d-baa5-ca6b655eb18d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:45.424666 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:45.463697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 584/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:18:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 16:18:45.470222 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a16be-2d51-4aa7-8606-745a5679e67b None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:45.518417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:45.566749 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a16be-2d51-4aa7-8606-745a5679e67b None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:45.599331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6a72a-197f-4797-8c72-3683f2e41c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:45.599946 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6a72a-197f-4797-8c72-3683f2e41c43 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:45.600229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6a72a-197f-4797-8c72-3683f2e41c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:45.600536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6a72a-197f-4797-8c72-3683f2e41c43 None admin] PATH_INFO: `/v3/projects/7ca4edaa3c104cc98dd06dc863c9c464` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:45.601636 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6a72a-197f-4797-8c72-3683f2e41c43 None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4edaa3c104cc98dd06dc863c9c464)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:45.603064 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6a72a-197f-4797-8c72-3683f2e41c43 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:45.605292 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 545/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:18:45 2022] GET /identity/v3/projects/7ca4edaa3c104cc98dd06dc863c9c464 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:18:45.611292 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486a87e-640b-412d-baa5-ca6b655eb18d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:45.704904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486a87e-640b-412d-baa5-ca6b655eb18d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:45.736875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5af743-613c-443e-892d-ccd98af89f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:45.737452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5af743-613c-443e-892d-ccd98af89f79 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:45.737727 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5af743-613c-443e-892d-ccd98af89f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:45.737996 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5af743-613c-443e-892d-ccd98af89f79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:45.738691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5af743-613c-443e-892d-ccd98af89f79 None admin] RBAC: Adding query filter params (role.id=f60b6d7b309a4537a233198456c7aa34, scope.project.id=7ca4edaa3c104cc98dd06dc863c9c464, user.id=3e47d0abc8e943c4901e38f8fb511077) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:45.738993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5af743-613c-443e-892d-ccd98af89f79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:45.740400 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5af743-613c-443e-892d-ccd98af89f79 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:45.745872 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 585/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:18:45 2022] GET /identity/v3/role_assignments?user.id=3e47d0abc8e943c4901e38f8fb511077&scope.project.id=7ca4edaa3c104cc98dd06dc863c9c464&role.id=f60b6d7b309a4537a233198456c7aa34 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:47.889351 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5b0d4-2632-4ddb-a41a-9b71709c756a None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:47.889850 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5b0d4-2632-4ddb-a41a-9b71709c756a None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:47.889986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5b0d4-2632-4ddb-a41a-9b71709c756a None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:47.891228 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 546/1131] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:47.896384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30863d9c-39d9-4cb2-ba8d-1e99b3454091 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:47.896751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30863d9c-39d9-4cb2-ba8d-1e99b3454091 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:47.896929 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30863d9c-39d9-4cb2-ba8d-1e99b3454091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:47.915138 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-30863d9c-39d9-4cb2-ba8d-1e99b3454091 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:47.916313 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-30863d9c-39d9-4cb2-ba8d-1e99b3454091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:47.932925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:47.981310 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 586/1132] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:48.246043 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5b0d4-2632-4ddb-a41a-9b71709c756a None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:48.345705 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5b0d4-2632-4ddb-a41a-9b71709c756a None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:48.362512 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:48.379215 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75373973-1078-4f4c-ba91-dccc5b6f161b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:48.379836 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75373973-1078-4f4c-ba91-dccc5b6f161b None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:48.380125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75373973-1078-4f4c-ba91-dccc5b6f161b None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:48.380429 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75373973-1078-4f4c-ba91-dccc5b6f161b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:48.381544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75373973-1078-4f4c-ba91-dccc5b6f161b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:48.382981 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75373973-1078-4f4c-ba91-dccc5b6f161b None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:48.384608 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 547/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:48.391040 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30863d9c-39d9-4cb2-ba8d-1e99b3454091 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:48.484501 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30863d9c-39d9-4cb2-ba8d-1e99b3454091 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:48.517095 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4e547-0c48-40d9-b54a-5699ab841e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:48.517624 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4e547-0c48-40d9-b54a-5699ab841e04 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:48.517897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4e547-0c48-40d9-b54a-5699ab841e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:48.518166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4e547-0c48-40d9-b54a-5699ab841e04 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:48.518793 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4e547-0c48-40d9-b54a-5699ab841e04 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:48.520200 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4e547-0c48-40d9-b54a-5699ab841e04 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:48.610191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 587/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 27 16:18:48 2022] POST /identity/v3/projects => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:18:50.765524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8490fc8-3cb8-4d9b-9768-d9b22042e49e None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:50.766052 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8490fc8-3cb8-4d9b-9768-d9b22042e49e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:50.766169 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8490fc8-3cb8-4d9b-9768-d9b22042e49e None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:50.767416 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 548/1135] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:50.772562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12693944-f3a0-4581-9b4c-ec453ec41b37 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:50.772976 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12693944-f3a0-4581-9b4c-ec453ec41b37 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:50.773119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12693944-f3a0-4581-9b4c-ec453ec41b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:50.780282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:50.791064 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-12693944-f3a0-4581-9b4c-ec453ec41b37 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:50.792258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-12693944-f3a0-4581-9b4c-ec453ec41b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:50.856905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 588/1136] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:51.128507 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8490fc8-3cb8-4d9b-9768-d9b22042e49e None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:51.227100 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8490fc8-3cb8-4d9b-9768-d9b22042e49e None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:51.259088 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbba5f-62ea-4200-b871-549812a530e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:51.259699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbba5f-62ea-4200-b871-549812a530e2 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:51.259982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbba5f-62ea-4200-b871-549812a530e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:51.260258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbba5f-62ea-4200-b871-549812a530e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:51.261927 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbba5f-62ea-4200-b871-549812a530e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:51.263356 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbba5f-62ea-4200-b871-549812a530e2 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:51.264909 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 549/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:18:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:51.270529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12693944-f3a0-4581-9b4c-ec453ec41b37 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:51.365609 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12693944-f3a0-4581-9b4c-ec453ec41b37 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:51.398575 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86dea5-72a9-41a7-9a2e-0f1011ade039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:51.399108 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86dea5-72a9-41a7-9a2e-0f1011ade039 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:51.399383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86dea5-72a9-41a7-9a2e-0f1011ade039 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:51.399653 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86dea5-72a9-41a7-9a2e-0f1011ade039 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:51.400284 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86dea5-72a9-41a7-9a2e-0f1011ade039 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:51.402231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86dea5-72a9-41a7-9a2e-0f1011ade039 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:51.410030 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:51.510936 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 589/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 27 16:18:51 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:18:53.656241 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e768724-ae0d-4def-88c9-ce6d082b53e9 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:53.656821 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e768724-ae0d-4def-88c9-ce6d082b53e9 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:53.656821 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e768724-ae0d-4def-88c9-ce6d082b53e9 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:53.658151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 550/1139] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:18:53.667439 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9deb2d-a95d-4aa8-a33a-060e03c1d1b7 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:53.667856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9deb2d-a95d-4aa8-a33a-060e03c1d1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:53.667993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9deb2d-a95d-4aa8-a33a-060e03c1d1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:53.689057 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-0e9deb2d-a95d-4aa8-a33a-060e03c1d1b7 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:53.690221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0e9deb2d-a95d-4aa8-a33a-060e03c1d1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:53.753069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 590/1140] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:54.018708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e768724-ae0d-4def-88c9-ce6d082b53e9 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:54.075591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:54.119925 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e768724-ae0d-4def-88c9-ce6d082b53e9 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:54.153438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdabf22-afa2-4487-9b02-3bdcef388bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:54.154055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdabf22-afa2-4487-9b02-3bdcef388bee None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:54.154338 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdabf22-afa2-4487-9b02-3bdcef388bee None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:54.154615 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdabf22-afa2-4487-9b02-3bdcef388bee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:54.164487 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdabf22-afa2-4487-9b02-3bdcef388bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:18:54.169301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-cbdabf22-afa2-4487-9b02-3bdcef388bee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:18:54.169301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:54.169301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:54.169301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:54.169301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:54.169301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:54.169301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:54.169301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:54.169301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:54.169301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:54.169301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:54.169301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:54.169301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:18:54.169301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:18:54.169301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:18:54.169301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:18:54.170669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:18:54.170669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:18:54.170669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:18:54.170669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:18:54.170669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:54.170669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:54.170669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:54.170669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:54.170669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:54.170669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:54.170669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:54.170669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:54.170669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:54.170669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:54.170669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:54.170669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:54.171695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:54.171695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:54.171695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:54.171695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:54.171695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:18:54.171695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:18:54.171695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:18:54.171695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:18:54.171695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:18:54.171695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:18:54.171695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:18:54.171695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:54.171695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 551/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:18:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:54.176889 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9deb2d-a95d-4aa8-a33a-060e03c1d1b7 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:54.270937 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9deb2d-a95d-4aa8-a33a-060e03c1d1b7 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:54.290384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:54.303860 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3f10f-86e1-47bb-8708-d1983c6c2dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:54.304546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3f10f-86e1-47bb-8708-d1983c6c2dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:54.309856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3f10f-86e1-47bb-8708-d1983c6c2dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:54.309856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3f10f-86e1-47bb-8708-d1983c6c2dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:54.309856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3f10f-86e1-47bb-8708-d1983c6c2dc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:54.309856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3f10f-86e1-47bb-8708-d1983c6c2dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:54.309856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3f10f-86e1-47bb-8708-d1983c6c2dc4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:54.315497 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 591/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:18:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:54.321302 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdabf22-afa2-4487-9b02-3bdcef388bee None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:54.498542 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdabf22-afa2-4487-9b02-3bdcef388bee None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:54.512543 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:54.531525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887a035-0144-49d7-b44b-db84553bbeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:54.532081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887a035-0144-49d7-b44b-db84553bbeaa None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:54.532394 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887a035-0144-49d7-b44b-db84553bbeaa None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:54.532669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887a035-0144-49d7-b44b-db84553bbeaa None admin] PATH_INFO: `/v3/users/23c28a40835e48b5967b19d76ac3a421` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:54.545338 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887a035-0144-49d7-b44b-db84553bbeaa None admin] RBAC: Authorizing `identity:get_user(user_id=23c28a40835e48b5967b19d76ac3a421)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:54.546765 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887a035-0144-49d7-b44b-db84553bbeaa None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:54.548328 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 552/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:18:54 2022] GET /identity/v3/users/23c28a40835e48b5967b19d76ac3a421 => generated 286 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:54.554208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3f10f-86e1-47bb-8708-d1983c6c2dc4 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:54.648989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3f10f-86e1-47bb-8708-d1983c6c2dc4 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:54.680229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245cad4-b3df-406a-b235-265c2dd3af33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:54.680924 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245cad4-b3df-406a-b235-265c2dd3af33 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:54.681204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245cad4-b3df-406a-b235-265c2dd3af33 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:54.681475 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245cad4-b3df-406a-b235-265c2dd3af33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:54.728619 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:54.747046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245cad4-b3df-406a-b235-265c2dd3af33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:54.748520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245cad4-b3df-406a-b235-265c2dd3af33 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:54.843103 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 592/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:18:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 16:18:54.848960 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887a035-0144-49d7-b44b-db84553bbeaa None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:54.945481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887a035-0144-49d7-b44b-db84553bbeaa None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:54.977415 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae77b40-5031-40e8-9f8d-99100a701904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:54.978028 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae77b40-5031-40e8-9f8d-99100a701904 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:54.978304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae77b40-5031-40e8-9f8d-99100a701904 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:54.978574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae77b40-5031-40e8-9f8d-99100a701904 None admin] PATH_INFO: `/v3/projects/0ad21fae0b0642ac82ff236bba89d1e7` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:54.980173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae77b40-5031-40e8-9f8d-99100a701904 None admin] RBAC: Authorizing `identity:get_project(project_id=0ad21fae0b0642ac82ff236bba89d1e7)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:54.981618 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae77b40-5031-40e8-9f8d-99100a701904 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:54.983201 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 553/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:18:54 2022] GET /identity/v3/projects/0ad21fae0b0642ac82ff236bba89d1e7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:54.989119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245cad4-b3df-406a-b235-265c2dd3af33 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:55.067696 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:55.084724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245cad4-b3df-406a-b235-265c2dd3af33 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:55.117883 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9f1e8-a28f-4aa2-9f8e-975e771ef6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:55.118461 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9f1e8-a28f-4aa2-9f8e-975e771ef6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:55.118735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9f1e8-a28f-4aa2-9f8e-975e771ef6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:55.119003 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9f1e8-a28f-4aa2-9f8e-975e771ef6d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:55.119697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9f1e8-a28f-4aa2-9f8e-975e771ef6d0 None admin] RBAC: Adding query filter params (role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.project.id=0ad21fae0b0642ac82ff236bba89d1e7, user.id=23c28a40835e48b5967b19d76ac3a421) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:55.120589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9f1e8-a28f-4aa2-9f8e-975e771ef6d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:55.121986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9f1e8-a28f-4aa2-9f8e-975e771ef6d0 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:55.127080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 593/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:18:54 2022] GET /identity/v3/role_assignments?user.id=23c28a40835e48b5967b19d76ac3a421&scope.project.id=0ad21fae0b0642ac82ff236bba89d1e7&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:57.219317 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da94482-b0d6-4df8-884e-76e211eb2c92 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:57.219815 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da94482-b0d6-4df8-884e-76e211eb2c92 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:57.219815 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da94482-b0d6-4df8-884e-76e211eb2c92 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:57.221133 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 554/1147] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:18:57.226149 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148ea3f-7ce2-43f6-ac8c-8df44d4b271c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:57.226515 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148ea3f-7ce2-43f6-ac8c-8df44d4b271c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:57.226698 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148ea3f-7ce2-43f6-ac8c-8df44d4b271c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:57.245566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-0148ea3f-7ce2-43f6-ac8c-8df44d4b271c None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:18:57.246738 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0148ea3f-7ce2-43f6-ac8c-8df44d4b271c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:18:57.310758 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 594/1148] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:18:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:18:57.577836 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da94482-b0d6-4df8-884e-76e211eb2c92 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:57.620863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:57.676297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da94482-b0d6-4df8-884e-76e211eb2c92 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:57.709426 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7edb64-8062-46d5-bf08-3378ff4866a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:57.710042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7edb64-8062-46d5-bf08-3378ff4866a5 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:57.710321 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7edb64-8062-46d5-bf08-3378ff4866a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:57.710593 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7edb64-8062-46d5-bf08-3378ff4866a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:57.720888 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7edb64-8062-46d5-bf08-3378ff4866a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:18:57.725656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-ba7edb64-8062-46d5-bf08-3378ff4866a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:18:57.725656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:18:57.725656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:18:57.725656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:18:57.725656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:18:57.725656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:18:57.725656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:18:57.725656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:18:57.725656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:18:57.725656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:18:57.725656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:18:57.725656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:18:57.725656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:18:57.725656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:18:57.725656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:18:57.725656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:18:57.726832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:18:57.726832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:18:57.726832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:18:57.726832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:18:57.726832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:18:57.726832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:18:57.726832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:18:57.726832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:18:57.726832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:18:57.726832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:18:57.726832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:18:57.726832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:18:57.726832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:18:57.726832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:18:57.726832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:18:57.726832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:18:57.727940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:18:57.727940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:18:57.727940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:18:57.727940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:18:57.727940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:18:57.727940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:18:57.727940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:18:57.727940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:18:57.727940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:18:57.727940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:18:57.727940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:18:57.727940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:18:57.727940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 555/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:18:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:18:57.732766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148ea3f-7ce2-43f6-ac8c-8df44d4b271c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:57.806559 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:57.828729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148ea3f-7ce2-43f6-ac8c-8df44d4b271c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:57.861011 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b77cd5-9f9e-4881-a07b-b6fbae1c4a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:57.861606 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b77cd5-9f9e-4881-a07b-b6fbae1c4a3b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:57.861880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b77cd5-9f9e-4881-a07b-b6fbae1c4a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:57.862148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b77cd5-9f9e-4881-a07b-b6fbae1c4a3b None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:57.862787 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b77cd5-9f9e-4881-a07b-b6fbae1c4a3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:18:57.863086 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b77cd5-9f9e-4881-a07b-b6fbae1c4a3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:57.864466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b77cd5-9f9e-4881-a07b-b6fbae1c4a3b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:57.872185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 595/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:18:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:57.878040 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7edb64-8062-46d5-bf08-3378ff4866a5 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:57.974293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:18:57.977174 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7edb64-8062-46d5-bf08-3378ff4866a5 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:58.009296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f6aae-d2fa-4842-b9ca-abd5584778cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:58.009907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f6aae-d2fa-4842-b9ca-abd5584778cb None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:58.010184 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f6aae-d2fa-4842-b9ca-abd5584778cb None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:58.010965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f6aae-d2fa-4842-b9ca-abd5584778cb None admin] PATH_INFO: `/v3/users/23c28a40835e48b5967b19d76ac3a421` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:58.012074 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f6aae-d2fa-4842-b9ca-abd5584778cb None admin] RBAC: Authorizing `identity:get_user(user_id=23c28a40835e48b5967b19d76ac3a421)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:58.013551 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f6aae-d2fa-4842-b9ca-abd5584778cb None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:58.015169 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 556/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:18:57 2022] GET /identity/v3/users/23c28a40835e48b5967b19d76ac3a421 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:58.020933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b77cd5-9f9e-4881-a07b-b6fbae1c4a3b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:58.117173 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b77cd5-9f9e-4881-a07b-b6fbae1c4a3b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:58.149644 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d13829-aa99-4dc3-a02e-e8ddc82fbaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:58.150252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d13829-aa99-4dc3-a02e-e8ddc82fbaa0 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:58.150529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d13829-aa99-4dc3-a02e-e8ddc82fbaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:58.150803 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d13829-aa99-4dc3-a02e-e8ddc82fbaa0 None admin] PATH_INFO: `/v3/projects/0ad21fae0b0642ac82ff236bba89d1e7` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:58.151925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d13829-aa99-4dc3-a02e-e8ddc82fbaa0 None admin] RBAC: Authorizing `identity:get_project(project_id=0ad21fae0b0642ac82ff236bba89d1e7)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:58.153371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d13829-aa99-4dc3-a02e-e8ddc82fbaa0 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:58.154975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 596/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:18:58 2022] GET /identity/v3/projects/0ad21fae0b0642ac82ff236bba89d1e7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:18:58.160944 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f6aae-d2fa-4842-b9ca-abd5584778cb None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:18:58.255698 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f6aae-d2fa-4842-b9ca-abd5584778cb None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:18:58.288140 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6caed-6c7d-48e2-ad0e-eb4fafe91a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:18:58.288802 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6caed-6c7d-48e2-ad0e-eb4fafe91a4c None admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:18:58.289079 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6caed-6c7d-48e2-ad0e-eb4fafe91a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:18:58.289347 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6caed-6c7d-48e2-ad0e-eb4fafe91a4c None admin] PATH_INFO: `/v3/projects/0ad21fae0b0642ac82ff236bba89d1e7/users/23c28a40835e48b5967b19d76ac3a421/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:18:58.291198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6caed-6c7d-48e2-ad0e-eb4fafe91a4c None admin] RBAC: Authorizing `identity:create_grant(project_id=0ad21fae0b0642ac82ff236bba89d1e7, user_id=23c28a40835e48b5967b19d76ac3a421, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:18:58.292667 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6caed-6c7d-48e2-ad0e-eb4fafe91a4c None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:18:58.397005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 557/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:18:58 2022] PUT /identity/v3/projects/0ad21fae0b0642ac82ff236bba89d1e7/users/23c28a40835e48b5967b19d76ac3a421/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:19:00.495113 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a7651-f3c7-4051-9889-529e04a67eca None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:00.495669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a7651-f3c7-4051-9889-529e04a67eca None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:00.495764 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a7651-f3c7-4051-9889-529e04a67eca None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:00.497108 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 597/1154] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:19:00.502347 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d185c2b-0a6f-46cb-968f-03e16342ed03 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:00.502790 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d185c2b-0a6f-46cb-968f-03e16342ed03 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:00.502901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d185c2b-0a6f-46cb-968f-03e16342ed03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:00.521732 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-9d185c2b-0a6f-46cb-968f-03e16342ed03 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:19:00.522901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-9d185c2b-0a6f-46cb-968f-03e16342ed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:19:00.544524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:00.587573 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 558/1155] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:19:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:19:00.860982 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a7651-f3c7-4051-9889-529e04a67eca None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:00.870842 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:00.961273 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a7651-f3c7-4051-9889-529e04a67eca None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:00.993424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e24f8-4343-4603-b29c-eb8d7320a795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:00.994033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e24f8-4343-4603-b29c-eb8d7320a795 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:00.994312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e24f8-4343-4603-b29c-eb8d7320a795 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:00.994608 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e24f8-4343-4603-b29c-eb8d7320a795 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:01.005348 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e24f8-4343-4603-b29c-eb8d7320a795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:19:01.010087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-a59e24f8-4343-4603-b29c-eb8d7320a795 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:19:01.010087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:19:01.010087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:19:01.010087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:19:01.010087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:19:01.010087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:19:01.010087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:19:01.010087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:19:01.010087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:19:01.010087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:19:01.010087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:19:01.010087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:19:01.010087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:19:01.010087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:19:01.010087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:19:01.010087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:19:01.011203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:19:01.011203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:19:01.011203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:19:01.011203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:19:01.011203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:19:01.011203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:19:01.011203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:19:01.011203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:19:01.011203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:19:01.011203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:19:01.011203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:19:01.011203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:19:01.011203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:19:01.011203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:19:01.011203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:19:01.011203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:19:01.012398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:19:01.012398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:19:01.012398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:19:01.012398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:19:01.012398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:19:01.012398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:19:01.012398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:19:01.012398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:19:01.012398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:19:01.012398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:19:01.012398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:19:01.012398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:19:01.012398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 598/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:19:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:19:01.017104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d185c2b-0a6f-46cb-968f-03e16342ed03 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:01.111468 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d185c2b-0a6f-46cb-968f-03e16342ed03 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:01.144196 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d530f-35f4-4c2f-9646-1012c62cf24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:01.144812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d530f-35f4-4c2f-9646-1012c62cf24b None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:01.145088 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d530f-35f4-4c2f-9646-1012c62cf24b None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:01.145355 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d530f-35f4-4c2f-9646-1012c62cf24b None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:01.146003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d530f-35f4-4c2f-9646-1012c62cf24b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:19:01.146301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d530f-35f4-4c2f-9646-1012c62cf24b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:01.147747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d530f-35f4-4c2f-9646-1012c62cf24b None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:01.155404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 559/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:19:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:19:01.161226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e24f8-4343-4603-b29c-eb8d7320a795 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:01.224200 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:01.256610 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e24f8-4343-4603-b29c-eb8d7320a795 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:01.288450 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b2558-f7d4-4fcd-9dab-dbf8bd3088b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:01.289060 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b2558-f7d4-4fcd-9dab-dbf8bd3088b3 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:01.289341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b2558-f7d4-4fcd-9dab-dbf8bd3088b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:01.289614 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b2558-f7d4-4fcd-9dab-dbf8bd3088b3 None admin] PATH_INFO: `/v3/users/23c28a40835e48b5967b19d76ac3a421` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:01.290714 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b2558-f7d4-4fcd-9dab-dbf8bd3088b3 None admin] RBAC: Authorizing `identity:get_user(user_id=23c28a40835e48b5967b19d76ac3a421)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:01.292152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b2558-f7d4-4fcd-9dab-dbf8bd3088b3 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:01.293723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 599/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:19:01 2022] GET /identity/v3/users/23c28a40835e48b5967b19d76ac3a421 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:19:01.299678 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d530f-35f4-4c2f-9646-1012c62cf24b None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:01.321473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:01.396072 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d530f-35f4-4c2f-9646-1012c62cf24b None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:01.428049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d71734-a53a-4957-8186-b8af56f3ba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:01.428671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d71734-a53a-4957-8186-b8af56f3ba1d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:01.428950 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d71734-a53a-4957-8186-b8af56f3ba1d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:01.429223 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d71734-a53a-4957-8186-b8af56f3ba1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:01.493887 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d71734-a53a-4957-8186-b8af56f3ba1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:01.495868 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d71734-a53a-4957-8186-b8af56f3ba1d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:01.515194 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:01.589499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 560/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:19:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 16:19:01.595402 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b2558-f7d4-4fcd-9dab-dbf8bd3088b3 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:01.692598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b2558-f7d4-4fcd-9dab-dbf8bd3088b3 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:01.723933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec41420-6595-4dfb-8c52-617e90a1bf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:01.724609 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec41420-6595-4dfb-8c52-617e90a1bf29 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:01.724891 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec41420-6595-4dfb-8c52-617e90a1bf29 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:01.725164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec41420-6595-4dfb-8c52-617e90a1bf29 None admin] PATH_INFO: `/v3/projects/0ad21fae0b0642ac82ff236bba89d1e7` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:01.726266 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec41420-6595-4dfb-8c52-617e90a1bf29 None admin] RBAC: Authorizing `identity:get_project(project_id=0ad21fae0b0642ac82ff236bba89d1e7)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:01.727672 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec41420-6595-4dfb-8c52-617e90a1bf29 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:01.729796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 600/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:19:01 2022] GET /identity/v3/projects/0ad21fae0b0642ac82ff236bba89d1e7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:19:01.735564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d71734-a53a-4957-8186-b8af56f3ba1d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:01.831180 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d71734-a53a-4957-8186-b8af56f3ba1d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:01.850880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:01.864924 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf59474-544e-41db-b896-a2742a8c28ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:01.865527 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf59474-544e-41db-b896-a2742a8c28ef None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:01.865809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf59474-544e-41db-b896-a2742a8c28ef None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:01.866084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf59474-544e-41db-b896-a2742a8c28ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:01.866795 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf59474-544e-41db-b896-a2742a8c28ef None admin] RBAC: Adding query filter params (role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.project.id=0ad21fae0b0642ac82ff236bba89d1e7, user.id=23c28a40835e48b5967b19d76ac3a421) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:19:01.867104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf59474-544e-41db-b896-a2742a8c28ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:01.868557 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf59474-544e-41db-b896-a2742a8c28ef None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:01.874170 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 561/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:19:01 2022] GET /identity/v3/role_assignments?user.id=23c28a40835e48b5967b19d76ac3a421&scope.project.id=0ad21fae0b0642ac82ff236bba89d1e7&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:19:04.015846 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1236dc-02f5-4770-b0af-fbca3d52d5c4 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:04.016413 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1236dc-02f5-4770-b0af-fbca3d52d5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:04.016413 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1236dc-02f5-4770-b0af-fbca3d52d5c4 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:04.017747 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 601/1162] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:19:04.022879 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc89ed-3340-4408-946d-35af1ab6562a None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:04.023252 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc89ed-3340-4408-946d-35af1ab6562a None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:04.023433 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc89ed-3340-4408-946d-35af1ab6562a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:04.041797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-6ecc89ed-3340-4408-946d-35af1ab6562a None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:19:04.042976 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6ecc89ed-3340-4408-946d-35af1ab6562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:19:04.109713 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 562/1163] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:19:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:19:04.374566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1236dc-02f5-4770-b0af-fbca3d52d5c4 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:04.377392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:04.475293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1236dc-02f5-4770-b0af-fbca3d52d5c4 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:04.508027 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84167431-60ea-434d-a9a6-840c3a7d4158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:04.508651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84167431-60ea-434d-a9a6-840c3a7d4158 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:04.508933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84167431-60ea-434d-a9a6-840c3a7d4158 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:04.509207 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84167431-60ea-434d-a9a6-840c3a7d4158 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:04.573323 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84167431-60ea-434d-a9a6-840c3a7d4158 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:04.574749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84167431-60ea-434d-a9a6-840c3a7d4158 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:04.576476 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:04.668616 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 602/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:19:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 16:19:04.674749 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc89ed-3340-4408-946d-35af1ab6562a None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:04.776050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc89ed-3340-4408-946d-35af1ab6562a None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:04.789557 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:04.810313 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de4c2c-9b90-4f43-b673-1a428cf2198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:04.810935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de4c2c-9b90-4f43-b673-1a428cf2198d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:04.811212 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de4c2c-9b90-4f43-b673-1a428cf2198d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:04.811481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de4c2c-9b90-4f43-b673-1a428cf2198d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:04.818530 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de4c2c-9b90-4f43-b673-1a428cf2198d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:04.819966 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de4c2c-9b90-4f43-b673-1a428cf2198d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:04.831023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-62de4c2c-9b90-4f43-b673-1a428cf2198d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 27 16:19:04.831023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:19:04.831023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 27 16:19:04.831023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 27 16:19:04.831023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:19:04.831023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:19:04.831023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:19:04.831023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:19:04.831023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 27 16:19:04.831023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:19:04.831023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:19:04.831023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:19:04.831023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:19:04.831023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:19:04.831023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:19:04.831023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:19:04.831023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:19:04.832274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:19:04.832274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:19:04.832274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:19:04.832274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:19:04.832274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:19:04.832274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:19:04.832274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:19:04.832274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:19:04.832274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:19:04.832274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:19:04.832274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:19:04.832274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:19:04.832274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:19:04.832274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:19:04.832274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:19:04.832274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:19:04.833240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:19:04.833240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:19:04.833240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:19:04.833240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:19:04.833240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:19:04.833240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:19:04.833240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:19:04.833240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:19:04.833240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:19:04.833240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:19:04.833240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 27 16:19:04.833240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:19:04.833240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 27 16:19:04.833240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:19:04.833240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 563/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 27 16:19:04 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:19:04.838720 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84167431-60ea-434d-a9a6-840c3a7d4158 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:04.933756 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84167431-60ea-434d-a9a6-840c3a7d4158 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:04.935177 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:04.967830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f688ebf-2bdd-422d-9bb5-75c554b64b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:04.968451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f688ebf-2bdd-422d-9bb5-75c554b64b52 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:04.968729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f688ebf-2bdd-422d-9bb5-75c554b64b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:04.969000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f688ebf-2bdd-422d-9bb5-75c554b64b52 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:04.969628 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f688ebf-2bdd-422d-9bb5-75c554b64b52 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:19:04.969930 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f688ebf-2bdd-422d-9bb5-75c554b64b52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:04.971275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f688ebf-2bdd-422d-9bb5-75c554b64b52 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:04.978126 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 603/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Sep 27 16:19:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:19:07.067784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e6539-a2ae-4f80-94b4-a9f0fc9e2a73 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:07.068281 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e6539-a2ae-4f80-94b4-a9f0fc9e2a73 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:07.068281 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e6539-a2ae-4f80-94b4-a9f0fc9e2a73 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:07.069606 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 564/1167] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:19:07.075490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c6f34-e6e4-46c1-93fb-beeb2fdec25e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:07.075918 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c6f34-e6e4-46c1-93fb-beeb2fdec25e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:07.076027 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c6f34-e6e4-46c1-93fb-beeb2fdec25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:07.093556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-606c6f34-e6e4-46c1-93fb-beeb2fdec25e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:19:07.094717 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-606c6f34-e6e4-46c1-93fb-beeb2fdec25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:19:07.158151 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 604/1168] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:19:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:19:07.422229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e6539-a2ae-4f80-94b4-a9f0fc9e2a73 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:07.519446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e6539-a2ae-4f80-94b4-a9f0fc9e2a73 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:07.551682 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8501e-e9d5-4ca4-bde5-15d5dc72d12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:07.552268 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8501e-e9d5-4ca4-bde5-15d5dc72d12e None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:07.552570 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8501e-e9d5-4ca4-bde5-15d5dc72d12e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:07.552840 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8501e-e9d5-4ca4-bde5-15d5dc72d12e None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:07.553489 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8501e-e9d5-4ca4-bde5-15d5dc72d12e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:07.554826 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8501e-e9d5-4ca4-bde5-15d5dc72d12e None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:07.631517 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 565/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Tue Sep 27 16:19:07 2022] POST /identity/v3/domains => generated 267 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:19:09.781254 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9453c-eca8-4fe9-9fda-95ff55c5f4a6 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:09.781805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9453c-eca8-4fe9-9fda-95ff55c5f4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:09.781805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9453c-eca8-4fe9-9fda-95ff55c5f4a6 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:09.783150 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 605/1170] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:19:09.788427 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8fd5b-40c5-47ac-99ce-dd09aa45b14f None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:09.788842 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8fd5b-40c5-47ac-99ce-dd09aa45b14f None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:09.788984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8fd5b-40c5-47ac-99ce-dd09aa45b14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:09.807210 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-edf8fd5b-40c5-47ac-99ce-dd09aa45b14f None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:19:09.808430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-edf8fd5b-40c5-47ac-99ce-dd09aa45b14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:19:09.833939 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:09.872409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 566/1171] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:19:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:19:10.143695 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9453c-eca8-4fe9-9fda-95ff55c5f4a6 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:10.233444 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:10.239927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9453c-eca8-4fe9-9fda-95ff55c5f4a6 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:10.273165 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fffcf1-0e62-42ac-bc07-c4dfa7d26228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:10.273778 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fffcf1-0e62-42ac-bc07-c4dfa7d26228 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:10.274054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fffcf1-0e62-42ac-bc07-c4dfa7d26228 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:10.274326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fffcf1-0e62-42ac-bc07-c4dfa7d26228 None admin] PATH_INFO: `/v3/domains/38505dbbf9c840f98ca53224f1823885` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:10.284420 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fffcf1-0e62-42ac-bc07-c4dfa7d26228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=38505dbbf9c840f98ca53224f1823885)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:10.285873 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fffcf1-0e62-42ac-bc07-c4dfa7d26228 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:10.287439 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 606/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Tue Sep 27 16:19:10 2022] GET /identity/v3/domains/38505dbbf9c840f98ca53224f1823885 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:19:10.293239 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8fd5b-40c5-47ac-99ce-dd09aa45b14f None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:10.389098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8fd5b-40c5-47ac-99ce-dd09aa45b14f None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:10.422058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8374be4-e8fb-4e9d-a647-cc2c7e18d3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:10.422594 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8374be4-e8fb-4e9d-a647-cc2c7e18d3d5 None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:10.422873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8374be4-e8fb-4e9d-a647-cc2c7e18d3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:10.423146 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8374be4-e8fb-4e9d-a647-cc2c7e18d3d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:10.423798 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8374be4-e8fb-4e9d-a647-cc2c7e18d3d5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:10.425323 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8374be4-e8fb-4e9d-a647-cc2c7e18d3d5 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:10.506107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 567/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 27 16:19:10 2022] POST /identity/v3/projects => generated 361 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:19:12.663426 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f408116-7275-4cb7-a1fd-a1c55a7d9627 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:12.663954 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f408116-7275-4cb7-a1fd-a1c55a7d9627 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:12.663954 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f408116-7275-4cb7-a1fd-a1c55a7d9627 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:12.665354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 607/1174] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:19:12.670947 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df79c8b-863f-45da-add4-2b70f989f85d None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:12.671323 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df79c8b-863f-45da-add4-2b70f989f85d None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:12.671498 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df79c8b-863f-45da-add4-2b70f989f85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:12.689767 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-5df79c8b-863f-45da-add4-2b70f989f85d None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:19:12.690943 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-5df79c8b-863f-45da-add4-2b70f989f85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:19:12.701952 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:12.756740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 568/1175] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:19:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:19:13.022062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f408116-7275-4cb7-a1fd-a1c55a7d9627 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:13.120755 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f408116-7275-4cb7-a1fd-a1c55a7d9627 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:13.152733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad5238-ed17-41e9-abb8-eac6fde6326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:13.153337 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad5238-ed17-41e9-abb8-eac6fde6326b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:13.153615 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad5238-ed17-41e9-abb8-eac6fde6326b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:13.153887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad5238-ed17-41e9-abb8-eac6fde6326b None admin] PATH_INFO: `/v3/domains/38505dbbf9c840f98ca53224f1823885` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:13.154979 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad5238-ed17-41e9-abb8-eac6fde6326b None admin] RBAC: Authorizing `identity:get_domain(domain_id=38505dbbf9c840f98ca53224f1823885)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:13.156426 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad5238-ed17-41e9-abb8-eac6fde6326b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:13.157942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 608/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Tue Sep 27 16:19:13 2022] GET /identity/v3/domains/38505dbbf9c840f98ca53224f1823885 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:19:13.163379 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df79c8b-863f-45da-add4-2b70f989f85d None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:13.257849 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df79c8b-863f-45da-add4-2b70f989f85d None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:13.290245 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba14555-f9bd-41e9-af4d-83e713eec41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:13.290767 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba14555-f9bd-41e9-af4d-83e713eec41e None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:13.291039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba14555-f9bd-41e9-af4d-83e713eec41e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:13.291853 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba14555-f9bd-41e9-af4d-83e713eec41e None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:13.292525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba14555-f9bd-41e9-af4d-83e713eec41e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:13.293929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba14555-f9bd-41e9-af4d-83e713eec41e None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:13.442732 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 569/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 27 16:19:13 2022] POST /identity/v3/users => generated 311 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:19:15.626377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8326c-1160-42ab-8943-1a72081e1d3f None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:15.626920 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8326c-1160-42ab-8943-1a72081e1d3f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:15.626920 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8326c-1160-42ab-8943-1a72081e1d3f None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:15.628261 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 609/1178] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:19:15.633579 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f528962-baeb-453f-9b61-db0ec6229b6c None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:15.633947 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f528962-baeb-453f-9b61-db0ec6229b6c None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:15.634139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f528962-baeb-453f-9b61-db0ec6229b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:15.641002 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:15.655670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-6f528962-baeb-453f-9b61-db0ec6229b6c None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:19:15.656890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6f528962-baeb-453f-9b61-db0ec6229b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:19:15.722338 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 570/1179] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:19:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:19:15.991746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8326c-1160-42ab-8943-1a72081e1d3f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:16.018192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:16.091704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8326c-1160-42ab-8943-1a72081e1d3f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:16.124237 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa068bb1-acd0-41ba-a3b9-9608e1d20d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:16.124873 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa068bb1-acd0-41ba-a3b9-9608e1d20d35 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:16.125151 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa068bb1-acd0-41ba-a3b9-9608e1d20d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:16.125425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa068bb1-acd0-41ba-a3b9-9608e1d20d35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:16.136210 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa068bb1-acd0-41ba-a3b9-9608e1d20d35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:19:16.140989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-aa068bb1-acd0-41ba-a3b9-9608e1d20d35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:19:16.140989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:19:16.140989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:19:16.140989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:19:16.140989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:19:16.140989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:19:16.140989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:19:16.140989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:19:16.140989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:19:16.140989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:19:16.140989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:19:16.140989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:19:16.140989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:19:16.140989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:19:16.140989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:19:16.140989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:19:16.142068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:19:16.142068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:19:16.142068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:19:16.142068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:19:16.142068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:19:16.142068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:19:16.142068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:19:16.142068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:19:16.142068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:19:16.142068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:19:16.142068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:19:16.142068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:19:16.142068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:19:16.142068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:19:16.142068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:19:16.142068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:19:16.142983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:19:16.142983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:19:16.142983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:19:16.142983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:19:16.142983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:19:16.142983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:19:16.142983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:19:16.142983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:19:16.142983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:19:16.142983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:19:16.142983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:19:16.142983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:19:16.142983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 610/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:19:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:19:16.148130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f528962-baeb-453f-9b61-db0ec6229b6c None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:16.242897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f528962-baeb-453f-9b61-db0ec6229b6c None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:16.271361 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:16.275947 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056b37e-69f2-4ced-af10-c20c677a646a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:16.276562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056b37e-69f2-4ced-af10-c20c677a646a None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:16.276840 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056b37e-69f2-4ced-af10-c20c677a646a None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:16.277110 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056b37e-69f2-4ced-af10-c20c677a646a None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:16.277763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056b37e-69f2-4ced-af10-c20c677a646a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:19:16.278064 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056b37e-69f2-4ced-af10-c20c677a646a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:16.279422 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056b37e-69f2-4ced-af10-c20c677a646a None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:16.287091 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 571/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:19:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:19:16.292808 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa068bb1-acd0-41ba-a3b9-9608e1d20d35 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:16.374347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:16.389838 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa068bb1-acd0-41ba-a3b9-9608e1d20d35 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:16.421735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91686854-e71e-42c5-8dbd-94216a8aaa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:16.422344 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91686854-e71e-42c5-8dbd-94216a8aaa71 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:16.422622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91686854-e71e-42c5-8dbd-94216a8aaa71 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:16.422893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91686854-e71e-42c5-8dbd-94216a8aaa71 None admin] PATH_INFO: `/v3/users/976af43f3c6d4124807c5fb94f12ce29` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:16.436801 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91686854-e71e-42c5-8dbd-94216a8aaa71 None admin] RBAC: Authorizing `identity:get_user(user_id=976af43f3c6d4124807c5fb94f12ce29)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:16.438227 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91686854-e71e-42c5-8dbd-94216a8aaa71 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:16.439768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 611/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:19:16 2022] GET /identity/v3/users/976af43f3c6d4124807c5fb94f12ce29 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:19:16.445417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056b37e-69f2-4ced-af10-c20c677a646a None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:16.542575 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056b37e-69f2-4ced-af10-c20c677a646a None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:16.575704 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b0291-f2b3-4045-8b7b-94c322c5c3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:16.576300 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b0291-f2b3-4045-8b7b-94c322c5c3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:16.576610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b0291-f2b3-4045-8b7b-94c322c5c3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:16.576885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b0291-f2b3-4045-8b7b-94c322c5c3e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:16.634555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:16.641738 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b0291-f2b3-4045-8b7b-94c322c5c3e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:16.643285 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b0291-f2b3-4045-8b7b-94c322c5c3e5 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:16.738626 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 572/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:19:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 16:19:16.745209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91686854-e71e-42c5-8dbd-94216a8aaa71 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:16.842465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91686854-e71e-42c5-8dbd-94216a8aaa71 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:16.875136 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5c0c2-ca03-4234-a26f-5fc9bdd8c08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:16.875748 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c0c2-ca03-4234-a26f-5fc9bdd8c08d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:16.876025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c0c2-ca03-4234-a26f-5fc9bdd8c08d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:16.876295 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c0c2-ca03-4234-a26f-5fc9bdd8c08d None admin] PATH_INFO: `/v3/projects/baa75317b56e42139973f46ebdcb3708` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:16.877412 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5c0c2-ca03-4234-a26f-5fc9bdd8c08d None admin] RBAC: Authorizing `identity:get_project(project_id=baa75317b56e42139973f46ebdcb3708)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:16.878820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5c0c2-ca03-4234-a26f-5fc9bdd8c08d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:16.880616 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 612/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:19:16 2022] GET /identity/v3/projects/baa75317b56e42139973f46ebdcb3708 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:19:16.886405 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b0291-f2b3-4045-8b7b-94c322c5c3e5 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:16.975077 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:16.982077 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b0291-f2b3-4045-8b7b-94c322c5c3e5 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:17.015237 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b31e7-a9f8-483f-9c08-7f579dabd774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:17.015829 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b31e7-a9f8-483f-9c08-7f579dabd774 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:17.016107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b31e7-a9f8-483f-9c08-7f579dabd774 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:17.016401 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b31e7-a9f8-483f-9c08-7f579dabd774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:17.017114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b31e7-a9f8-483f-9c08-7f579dabd774 None admin] RBAC: Adding query filter params (role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.project.id=baa75317b56e42139973f46ebdcb3708, user.id=976af43f3c6d4124807c5fb94f12ce29) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:19:17.017423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b31e7-a9f8-483f-9c08-7f579dabd774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:17.018843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b31e7-a9f8-483f-9c08-7f579dabd774 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:17.023944 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 573/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:19:16 2022] GET /identity/v3/role_assignments?user.id=976af43f3c6d4124807c5fb94f12ce29&scope.project.id=baa75317b56e42139973f46ebdcb3708&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:19:19.119974 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c59ff1-818e-4d29-bcb1-fc397623445d None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:19.120506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c59ff1-818e-4d29-bcb1-fc397623445d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:19.120506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c59ff1-818e-4d29-bcb1-fc397623445d None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:19.121832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 613/1186] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:19:19.127089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda06d92-32d6-4afa-9779-01699c764ab3 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:19.127490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda06d92-32d6-4afa-9779-01699c764ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:19.127639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda06d92-32d6-4afa-9779-01699c764ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:19.146437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-bda06d92-32d6-4afa-9779-01699c764ab3 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:19:19.147625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-bda06d92-32d6-4afa-9779-01699c764ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:19:19.211968 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 574/1187] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:19:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:19:19.483271 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c59ff1-818e-4d29-bcb1-fc397623445d None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:19.496104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:19.582846 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c59ff1-818e-4d29-bcb1-fc397623445d None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:19.615622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0099cb-2469-4f5f-9b5b-49f2f94dbb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:19.616233 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0099cb-2469-4f5f-9b5b-49f2f94dbb5a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:19.616537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0099cb-2469-4f5f-9b5b-49f2f94dbb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:19.616809 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0099cb-2469-4f5f-9b5b-49f2f94dbb5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:19.627086 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0099cb-2469-4f5f-9b5b-49f2f94dbb5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:19:19.631903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-ac0099cb-2469-4f5f-9b5b-49f2f94dbb5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:19:19.631903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:19:19.631903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:19:19.631903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:19:19.631903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:19:19.631903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:19:19.631903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:19:19.631903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:19:19.631903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:19:19.631903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:19:19.631903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:19:19.631903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:19:19.631903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:19:19.631903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:19:19.631903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:19:19.631903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:19:19.633038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:19:19.633038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:19:19.633038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:19:19.633038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:19:19.633038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:19:19.633038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:19:19.633038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:19:19.633038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:19:19.633038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:19:19.633038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:19:19.633038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:19:19.633038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:19:19.633038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:19:19.633038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:19:19.633038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:19:19.633038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:19:19.633913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:19:19.633913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:19:19.633913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:19:19.633913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:19:19.633913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:19:19.633913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:19:19.633913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:19:19.633913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:19:19.633913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:19:19.633913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:19:19.633913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:19:19.633913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:19:19.633913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 614/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:19:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:19:19.639033 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda06d92-32d6-4afa-9779-01699c764ab3 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:19.722396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:19.735874 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda06d92-32d6-4afa-9779-01699c764ab3 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:19.767138 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839a627-586d-4935-abd9-62f7febdb2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:19.767739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839a627-586d-4935-abd9-62f7febdb2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:19.768019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839a627-586d-4935-abd9-62f7febdb2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:19.768291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839a627-586d-4935-abd9-62f7febdb2e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:19.768983 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839a627-586d-4935-abd9-62f7febdb2e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:19:19.769289 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839a627-586d-4935-abd9-62f7febdb2e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:19.770656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839a627-586d-4935-abd9-62f7febdb2e4 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:19.778402 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 575/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:19:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:19:19.784190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0099cb-2469-4f5f-9b5b-49f2f94dbb5a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:19.852820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:19.881750 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0099cb-2469-4f5f-9b5b-49f2f94dbb5a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:19.914870 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9939b-528c-4ea2-961b-7280dc09ead4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:19.915489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9939b-528c-4ea2-961b-7280dc09ead4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:19.915769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9939b-528c-4ea2-961b-7280dc09ead4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:19.916664 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9939b-528c-4ea2-961b-7280dc09ead4 None admin] PATH_INFO: `/v3/users/976af43f3c6d4124807c5fb94f12ce29` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:19.917767 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9939b-528c-4ea2-961b-7280dc09ead4 None admin] RBAC: Authorizing `identity:get_user(user_id=976af43f3c6d4124807c5fb94f12ce29)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:19.919188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9939b-528c-4ea2-961b-7280dc09ead4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:19.921042 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 615/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:19:19 2022] GET /identity/v3/users/976af43f3c6d4124807c5fb94f12ce29 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:19:19.926767 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839a627-586d-4935-abd9-62f7febdb2e4 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:20.023289 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839a627-586d-4935-abd9-62f7febdb2e4 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:20.057779 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee53365-932e-4b82-a3eb-395932544b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:20.057779 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee53365-932e-4b82-a3eb-395932544b3c None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:20.057779 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee53365-932e-4b82-a3eb-395932544b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:20.059175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee53365-932e-4b82-a3eb-395932544b3c None admin] PATH_INFO: `/v3/projects/baa75317b56e42139973f46ebdcb3708` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:20.059175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee53365-932e-4b82-a3eb-395932544b3c None admin] RBAC: Authorizing `identity:get_project(project_id=baa75317b56e42139973f46ebdcb3708)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:20.060437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee53365-932e-4b82-a3eb-395932544b3c None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:20.062029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 576/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:19:19 2022] GET /identity/v3/projects/baa75317b56e42139973f46ebdcb3708 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:19:20.067764 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9939b-528c-4ea2-961b-7280dc09ead4 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:20.163560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9939b-528c-4ea2-961b-7280dc09ead4 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:20.196175 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27dabd-fced-4f4e-b976-b9f9ffff380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:20.196848 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27dabd-fced-4f4e-b976-b9f9ffff380e None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:20.197127 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27dabd-fced-4f4e-b976-b9f9ffff380e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:20.197898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27dabd-fced-4f4e-b976-b9f9ffff380e None admin] PATH_INFO: `/v3/projects/baa75317b56e42139973f46ebdcb3708/users/976af43f3c6d4124807c5fb94f12ce29/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:20.199767 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27dabd-fced-4f4e-b976-b9f9ffff380e None admin] RBAC: Authorizing `identity:create_grant(project_id=baa75317b56e42139973f46ebdcb3708, user_id=976af43f3c6d4124807c5fb94f12ce29, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:20.201221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27dabd-fced-4f4e-b976-b9f9ffff380e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:20.282745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:20.287740 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 616/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:19:20 2022] PUT /identity/v3/projects/baa75317b56e42139973f46ebdcb3708/users/976af43f3c6d4124807c5fb94f12ce29/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:19:22.402088 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe668b60-b9b2-42a0-b5f7-de037ef9d5ee None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:22.402654 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe668b60-b9b2-42a0-b5f7-de037ef9d5ee None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:22.402654 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe668b60-b9b2-42a0-b5f7-de037ef9d5ee None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:22.404060 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 577/1193] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:19:22.409252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0fef7-f86c-42ed-a76c-11e91c1caa68 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:22.409646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0fef7-f86c-42ed-a76c-11e91c1caa68 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:22.409792 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0fef7-f86c-42ed-a76c-11e91c1caa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:22.427700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-99e0fef7-f86c-42ed-a76c-11e91c1caa68 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:19:22.428902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-99e0fef7-f86c-42ed-a76c-11e91c1caa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:19:22.492322 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 617/1194] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:19:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:19:22.762875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe668b60-b9b2-42a0-b5f7-de037ef9d5ee None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:22.781788 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:22.862203 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe668b60-b9b2-42a0-b5f7-de037ef9d5ee None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:22.893325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2af99-0b81-41a8-9944-024eff85e861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:22.893937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2af99-0b81-41a8-9944-024eff85e861 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:22.894214 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2af99-0b81-41a8-9944-024eff85e861 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:22.894481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2af99-0b81-41a8-9944-024eff85e861 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:22.904997 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2af99-0b81-41a8-9944-024eff85e861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:19:22.909680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-1ca2af99-0b81-41a8-9944-024eff85e861 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:19:22.909680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:19:22.909680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:19:22.909680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:19:22.909680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:19:22.909680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:19:22.909680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:19:22.909680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:19:22.909680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:19:22.909680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:19:22.909680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:19:22.909680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:19:22.909680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:19:22.909680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:19:22.909680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:19:22.909680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:19:22.910776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:19:22.910776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:19:22.910776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:19:22.910776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:19:22.910776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:19:22.910776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:19:22.910776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:19:22.910776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:19:22.910776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:19:22.910776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:19:22.910776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:19:22.910776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:19:22.910776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:19:22.910776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:19:22.910776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:19:22.910776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:19:22.911816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:19:22.911816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:19:22.911816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:19:22.911816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:19:22.911816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:19:22.911816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:19:22.911816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:19:22.911816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:19:22.911816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:19:22.911816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:19:22.911816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:19:22.911816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:19:22.911816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 578/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:19:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:19:22.917424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0fef7-f86c-42ed-a76c-11e91c1caa68 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:23.012321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0fef7-f86c-42ed-a76c-11e91c1caa68 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:23.037994 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:23.046304 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b521ae1-d733-4b52-91a6-13c5ed4fce50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:23.046902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521ae1-d733-4b52-91a6-13c5ed4fce50 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:23.048328 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521ae1-d733-4b52-91a6-13c5ed4fce50 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:23.048328 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521ae1-d733-4b52-91a6-13c5ed4fce50 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:23.048328 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b521ae1-d733-4b52-91a6-13c5ed4fce50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:19:23.048622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b521ae1-d733-4b52-91a6-13c5ed4fce50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:23.049729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b521ae1-d733-4b52-91a6-13c5ed4fce50 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:23.057566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 618/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:19:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:19:23.063605 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2af99-0b81-41a8-9944-024eff85e861 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:23.139840 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:23.160562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2af99-0b81-41a8-9944-024eff85e861 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:23.193055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1373a88-e27e-4be4-bb70-e54f1ba8cba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:23.193666 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1373a88-e27e-4be4-bb70-e54f1ba8cba6 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:23.193967 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1373a88-e27e-4be4-bb70-e54f1ba8cba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:23.194237 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1373a88-e27e-4be4-bb70-e54f1ba8cba6 None admin] PATH_INFO: `/v3/users/976af43f3c6d4124807c5fb94f12ce29` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:23.195322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1373a88-e27e-4be4-bb70-e54f1ba8cba6 None admin] RBAC: Authorizing `identity:get_user(user_id=976af43f3c6d4124807c5fb94f12ce29)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:23.196776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1373a88-e27e-4be4-bb70-e54f1ba8cba6 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:23.198810 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 579/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 27 16:19:23 2022] GET /identity/v3/users/976af43f3c6d4124807c5fb94f12ce29 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:19:23.204585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b521ae1-d733-4b52-91a6-13c5ed4fce50 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:23.299008 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b521ae1-d733-4b52-91a6-13c5ed4fce50 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:23.330450 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b9c71-1826-4709-bfe0-ed3604270ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:23.331029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b9c71-1826-4709-bfe0-ed3604270ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:23.331302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b9c71-1826-4709-bfe0-ed3604270ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:23.331570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b9c71-1826-4709-bfe0-ed3604270ed1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:23.385127 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:23.394689 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b9c71-1826-4709-bfe0-ed3604270ed1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:23.397232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b9c71-1826-4709-bfe0-ed3604270ed1 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:23.488774 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 619/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:19:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 16:19:23.494474 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1373a88-e27e-4be4-bb70-e54f1ba8cba6 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:23.591472 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1373a88-e27e-4be4-bb70-e54f1ba8cba6 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:23.623402 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7ab59-47c1-4728-ae72-81bb447f3b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:23.624007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7ab59-47c1-4728-ae72-81bb447f3b65 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:23.624280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7ab59-47c1-4728-ae72-81bb447f3b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:23.624574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7ab59-47c1-4728-ae72-81bb447f3b65 None admin] PATH_INFO: `/v3/projects/baa75317b56e42139973f46ebdcb3708` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:23.625665 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7ab59-47c1-4728-ae72-81bb447f3b65 None admin] RBAC: Authorizing `identity:get_project(project_id=baa75317b56e42139973f46ebdcb3708)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:23.627078 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7ab59-47c1-4728-ae72-81bb447f3b65 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:23.628669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 580/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 27 16:19:23 2022] GET /identity/v3/projects/baa75317b56e42139973f46ebdcb3708 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:19:23.634587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b9c71-1826-4709-bfe0-ed3604270ed1 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:19:23.719338 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:23.727967 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b9c71-1826-4709-bfe0-ed3604270ed1 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:19:23.761141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc540e-e8eb-4456-9b18-48071c91ba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:19:23.761718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc540e-e8eb-4456-9b18-48071c91ba92 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:19:23.761994 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc540e-e8eb-4456-9b18-48071c91ba92 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:19:23.762262 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc540e-e8eb-4456-9b18-48071c91ba92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:19:23.762961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc540e-e8eb-4456-9b18-48071c91ba92 None admin] RBAC: Adding query filter params (role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.project.id=baa75317b56e42139973f46ebdcb3708, user.id=976af43f3c6d4124807c5fb94f12ce29) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:19:23.763262 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc540e-e8eb-4456-9b18-48071c91ba92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:19:23.764685 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc540e-e8eb-4456-9b18-48071c91ba92 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:19:23.770133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 620/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:19:23 2022] GET /identity/v3/role_assignments?user.id=976af43f3c6d4124807c5fb94f12ce29&scope.project.id=baa75317b56e42139973f46ebdcb3708&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:19:33.619346 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=93 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:19:33.767695 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=23 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:34.345859 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997679e-239c-4c64-89fe-90b7e22daad2 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:34.346440 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997679e-239c-4c64-89fe-90b7e22daad2 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:34.346440 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997679e-239c-4c64-89fe-90b7e22daad2 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:34.347735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 581/1201] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:20:34.353152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa2c7a-97aa-40c3-a0dd-b240a92e2728 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:34.353628 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa2c7a-97aa-40c3-a0dd-b240a92e2728 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:34.353861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa2c7a-97aa-40c3-a0dd-b240a92e2728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:34.372122 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-e9aa2c7a-97aa-40c3-a0dd-b240a92e2728 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:20:34.373325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e9aa2c7a-97aa-40c3-a0dd-b240a92e2728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:20:34.437616 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 621/1202] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:20:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 16:20:34.705697 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997679e-239c-4c64-89fe-90b7e22daad2 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:34.806083 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997679e-239c-4c64-89fe-90b7e22daad2 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:34.839262 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1065e-1dea-4256-8ed2-0a38be422091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:34.839886 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1065e-1dea-4256-8ed2-0a38be422091 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:34.840165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1065e-1dea-4256-8ed2-0a38be422091 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:34.840468 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1065e-1dea-4256-8ed2-0a38be422091 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:34.850570 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1065e-1dea-4256-8ed2-0a38be422091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:34.852003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1065e-1dea-4256-8ed2-0a38be422091 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:34.865709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-62a1065e-1dea-4256-8ed2-0a38be422091 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:34.865709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:34.865709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:34.865709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:34.865709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:34.865709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:34.865709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:34.865709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:34.865709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:34.865709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:34.865709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:34.865709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:34.865709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:20:34.865709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:20:34.865709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:20:34.865709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:20:34.866880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:34.866880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:34.866880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:34.866880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:34.866880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:34.866880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:34.866880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:34.866880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:34.866880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:34.866880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:34.866880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:34.866880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:34.866880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:34.866880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:34.866880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:34.866880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:34.866880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:20:34.868026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:20:34.868026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:34.868026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:20:34.868026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 582/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:20:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:34.873672 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa2c7a-97aa-40c3-a0dd-b240a92e2728 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:34.971165 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa2c7a-97aa-40c3-a0dd-b240a92e2728 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:34.999756 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:35.005571 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690e6bc-d6e7-4968-a2d0-7e3326ceecd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:35.006167 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690e6bc-d6e7-4968-a2d0-7e3326ceecd3 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:35.006443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690e6bc-d6e7-4968-a2d0-7e3326ceecd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:35.006712 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690e6bc-d6e7-4968-a2d0-7e3326ceecd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:35.007341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690e6bc-d6e7-4968-a2d0-7e3326ceecd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:35.007640 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690e6bc-d6e7-4968-a2d0-7e3326ceecd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:35.009027 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690e6bc-d6e7-4968-a2d0-7e3326ceecd3 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:35.019667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 622/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:35.025960 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1065e-1dea-4256-8ed2-0a38be422091 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:35.077503 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:35.123062 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1065e-1dea-4256-8ed2-0a38be422091 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:35.155821 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a2a97-28b2-4e1e-9e99-12e4cea0baa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:35.156449 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a2a97-28b2-4e1e-9e99-12e4cea0baa5 None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:35.156727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a2a97-28b2-4e1e-9e99-12e4cea0baa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:35.156997 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a2a97-28b2-4e1e-9e99-12e4cea0baa5 None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:35.157629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a2a97-28b2-4e1e-9e99-12e4cea0baa5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:35.159057 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a2a97-28b2-4e1e-9e99-12e4cea0baa5 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:35.337715 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 583/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 27 16:20:35 2022] POST /identity/v3/users => generated 251 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:20:37.489347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf519b-497e-4d58-a8d3-8c0e2ffde073 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:37.489913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf519b-497e-4d58-a8d3-8c0e2ffde073 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:37.489913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf519b-497e-4d58-a8d3-8c0e2ffde073 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:37.491288 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 623/1206] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:20:37.497121 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f820cd4-8424-4734-954a-11f32e289b60 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:37.497543 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f820cd4-8424-4734-954a-11f32e289b60 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:37.497683 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f820cd4-8424-4734-954a-11f32e289b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:37.516255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-2f820cd4-8424-4734-954a-11f32e289b60 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:20:37.517471 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-2f820cd4-8424-4734-954a-11f32e289b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:20:37.583187 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 584/1207] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:20:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:20:37.864022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf519b-497e-4d58-a8d3-8c0e2ffde073 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:37.964638 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf519b-497e-4d58-a8d3-8c0e2ffde073 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:37.996682 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420b3b7-8044-455d-9dca-4dd7010ca3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:37.997299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420b3b7-8044-455d-9dca-4dd7010ca3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:37.997578 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420b3b7-8044-455d-9dca-4dd7010ca3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:37.997848 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420b3b7-8044-455d-9dca-4dd7010ca3d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:38.007968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420b3b7-8044-455d-9dca-4dd7010ca3d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:20:38.013307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-c420b3b7-8044-455d-9dca-4dd7010ca3d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:20:38.013307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:38.013307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:38.013307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:38.013307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:38.013307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:38.013307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:38.013307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:38.013307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:38.013307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:38.013307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:38.013307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:38.013307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:20:38.013307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:20:38.013307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:20:38.013307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:20:38.014265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:20:38.014265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:20:38.014265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:20:38.014265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:20:38.014265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:38.014265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:38.014265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:38.014265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:38.014265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:38.014265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:38.014265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:38.014265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:38.014265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:38.014265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:38.014265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:38.014265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:38.015489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:38.015489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:38.015489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:38.015489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:38.015489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:20:38.015489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:20:38.015489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:20:38.015489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:20:38.015489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:20:38.015489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:20:38.015489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:20:38.015489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:20:38.015489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 624/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:20:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:38.020599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f820cd4-8424-4734-954a-11f32e289b60 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:38.061668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:38.120952 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f820cd4-8424-4734-954a-11f32e289b60 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:38.154474 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de6213-19e8-494d-9b24-2542ceb25bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:38.155079 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de6213-19e8-494d-9b24-2542ceb25bfd None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:38.155362 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de6213-19e8-494d-9b24-2542ceb25bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:38.155635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de6213-19e8-494d-9b24-2542ceb25bfd None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:38.156288 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de6213-19e8-494d-9b24-2542ceb25bfd None admin] RBAC: Adding query filter params (name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:38.156622 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de6213-19e8-494d-9b24-2542ceb25bfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:38.157985 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de6213-19e8-494d-9b24-2542ceb25bfd None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:38.167217 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 585/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:20:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:38.173509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420b3b7-8044-455d-9dca-4dd7010ca3d9 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:38.221518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:38.269769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420b3b7-8044-455d-9dca-4dd7010ca3d9 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:38.302028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a9bab-3925-4e4d-b820-2468515befe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:38.302634 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a9bab-3925-4e4d-b820-2468515befe5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:38.302909 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a9bab-3925-4e4d-b820-2468515befe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:38.303186 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a9bab-3925-4e4d-b820-2468515befe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:38.314961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a9bab-3925-4e4d-b820-2468515befe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:38.315922 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a9bab-3925-4e4d-b820-2468515befe5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:38.329613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-8e5a9bab-3925-4e4d-b820-2468515befe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:38.329613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:38.329613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:38.329613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:38.329613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:38.329613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:38.329613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:38.329613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:38.329613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:38.329613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:38.329613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:38.329613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:38.329613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:20:38.329613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:20:38.329613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:20:38.329613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:20:38.330760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:38.330760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:38.330760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:38.330760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:38.330760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:38.330760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:38.330760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:38.330760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:38.330760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:38.330760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:38.330760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:38.330760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:38.330760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:38.330760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:38.330760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:38.330760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:38.330760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:20:38.331864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:20:38.331864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:38.331864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:20:38.331864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 625/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:38.336680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de6213-19e8-494d-9b24-2542ceb25bfd None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:38.434984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:38.437959 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de6213-19e8-494d-9b24-2542ceb25bfd None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:38.471078 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe92bd-cdbf-4e0a-acf8-d7697190c6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:38.471682 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe92bd-cdbf-4e0a-acf8-d7697190c6ab None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:38.471964 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe92bd-cdbf-4e0a-acf8-d7697190c6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:38.472243 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe92bd-cdbf-4e0a-acf8-d7697190c6ab None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:38.472919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe92bd-cdbf-4e0a-acf8-d7697190c6ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:38.473296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe92bd-cdbf-4e0a-acf8-d7697190c6ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:38.474669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe92bd-cdbf-4e0a-acf8-d7697190c6ab None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:38.487032 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 586/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:20:38.492873 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a9bab-3925-4e4d-b820-2468515befe5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:38.591068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a9bab-3925-4e4d-b820-2468515befe5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:38.592494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:38.623516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52b1b8-f10e-4ee6-aaa0-cc5fec6ce045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:38.624130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52b1b8-f10e-4ee6-aaa0-cc5fec6ce045 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:38.624448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52b1b8-f10e-4ee6-aaa0-cc5fec6ce045 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:38.624725 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52b1b8-f10e-4ee6-aaa0-cc5fec6ce045 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:38.631957 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52b1b8-f10e-4ee6-aaa0-cc5fec6ce045 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:38.633419 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52b1b8-f10e-4ee6-aaa0-cc5fec6ce045 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:38.644163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-eb52b1b8-f10e-4ee6-aaa0-cc5fec6ce045 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 16:20:38.644163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:38.644163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:38.644163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:38.644163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:38.644163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:38.644163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:38.644163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:38.644163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:38.644163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:38.644163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:38.644163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:38.644163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:20:38.644163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:20:38.644163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:20:38.644163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:20:38.645342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:38.645342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:38.645342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:20:38.645342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:20:38.645342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:20:38.645342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:20:38.645342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:38.645342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:38.645342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:38.645342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:38.645342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:38.645342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:38.645342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:38.645342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:38.645342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:38.645342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:38.645342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:38.645342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:38.646572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:38.646572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:38.646572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:20:38.646572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:20:38.646572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:20:38.646572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:20:38.646572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:20:38.646572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:20:38.646572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 16:20:38.646572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:20:38.646572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 626/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:20:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:38.651882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe92bd-cdbf-4e0a-acf8-d7697190c6ab None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:38.754919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe92bd-cdbf-4e0a-acf8-d7697190c6ab None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:38.788455 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44a3a3-3052-4fc6-9704-bd2970f44fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:38.789057 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44a3a3-3052-4fc6-9704-bd2970f44fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:38.789330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44a3a3-3052-4fc6-9704-bd2970f44fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:38.789596 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44a3a3-3052-4fc6-9704-bd2970f44fd7 None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:38.790344 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44a3a3-3052-4fc6-9704-bd2970f44fd7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:38.790636 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44a3a3-3052-4fc6-9704-bd2970f44fd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:38.792713 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44a3a3-3052-4fc6-9704-bd2970f44fd7 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:38.809922 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 587/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Sep 27 16:20:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:38.815624 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52b1b8-f10e-4ee6-aaa0-cc5fec6ce045 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:38.912527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52b1b8-f10e-4ee6-aaa0-cc5fec6ce045 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:38.945129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db11228-1f9c-4707-8116-770774758425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:38.945715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db11228-1f9c-4707-8116-770774758425 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:38.945988 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db11228-1f9c-4707-8116-770774758425 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:38.946262 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db11228-1f9c-4707-8116-770774758425 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:38.976445 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:39.012000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db11228-1f9c-4707-8116-770774758425 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:39.013556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db11228-1f9c-4707-8116-770774758425 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:39.110091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 627/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:20:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 16:20:39.115554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44a3a3-3052-4fc6-9704-bd2970f44fd7 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:39.134359 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:39.213577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44a3a3-3052-4fc6-9704-bd2970f44fd7 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:39.246226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc469f-89cc-48ca-9535-bc8f7c64e39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:39.246846 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc469f-89cc-48ca-9535-bc8f7c64e39d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:39.247121 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc469f-89cc-48ca-9535-bc8f7c64e39d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:39.247391 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc469f-89cc-48ca-9535-bc8f7c64e39d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:39.258064 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc469f-89cc-48ca-9535-bc8f7c64e39d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:39.259513 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc469f-89cc-48ca-9535-bc8f7c64e39d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:39.274934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-d8dc469f-89cc-48ca-9535-bc8f7c64e39d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:39.274934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:39.274934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:39.274934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:39.274934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:39.274934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:39.274934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:39.274934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:39.274934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:39.274934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:39.274934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:39.274934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:39.274934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:20:39.274934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:20:39.274934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:20:39.274934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:20:39.276159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:39.276159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:39.276159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:39.276159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:39.276159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:39.276159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:39.276159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:39.276159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:39.276159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:39.276159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:39.276159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:39.276159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:39.276159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:39.276159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:39.276159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:39.276159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:39.276159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:20:39.277331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:20:39.277331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:39.277331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:20:39.277331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 588/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:20:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:39.281851 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db11228-1f9c-4707-8116-770774758425 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:39.340561 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:39.376873 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db11228-1f9c-4707-8116-770774758425 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:39.410548 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c51b1-5225-47ec-a427-5e8225487f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:39.411133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c51b1-5225-47ec-a427-5e8225487f99 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:39.411410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c51b1-5225-47ec-a427-5e8225487f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:39.411682 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c51b1-5225-47ec-a427-5e8225487f99 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:39.412307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c51b1-5225-47ec-a427-5e8225487f99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:39.412640 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c51b1-5225-47ec-a427-5e8225487f99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:39.413991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c51b1-5225-47ec-a427-5e8225487f99 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:39.425109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 628/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:39.430886 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc469f-89cc-48ca-9535-bc8f7c64e39d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:39.499523 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:39.529970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc469f-89cc-48ca-9535-bc8f7c64e39d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:39.563315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b715fa-4321-49b0-87a8-3c26a7d4600b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:39.563931 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b715fa-4321-49b0-87a8-3c26a7d4600b None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:39.564209 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b715fa-4321-49b0-87a8-3c26a7d4600b None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:39.564512 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b715fa-4321-49b0-87a8-3c26a7d4600b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:39.571052 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b715fa-4321-49b0-87a8-3c26a7d4600b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:39.573111 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b715fa-4321-49b0-87a8-3c26a7d4600b None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:39.584118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-62b715fa-4321-49b0-87a8-3c26a7d4600b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:20:39.584118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:39.584118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:39.584118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:39.584118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:39.584118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:39.584118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:39.584118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:39.584118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:39.584118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:39.584118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:39.584118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:39.584118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:20:39.584118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:20:39.584118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:20:39.585226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:20:39.585226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:39.585226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:39.585226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:39.585226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:39.585226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:39.585226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:39.585226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:39.585226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:39.585226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:39.585226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:39.585226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:39.585226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:39.585226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:39.585226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:39.585226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:39.585226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:39.586558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:20:39.586558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:20:39.586558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:20:39.586558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:20:39.586558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:20:39.586558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:20:39.586558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:20:39.586558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:20:39.586558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 589/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:20:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:39.591289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c51b1-5225-47ec-a427-5e8225487f99 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:39.688778 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c51b1-5225-47ec-a427-5e8225487f99 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:39.709979 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:39.721012 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cf54c-dd44-45c3-8907-c3fd41783898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:39.721611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cf54c-dd44-45c3-8907-c3fd41783898 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:39.721889 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cf54c-dd44-45c3-8907-c3fd41783898 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:39.722161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cf54c-dd44-45c3-8907-c3fd41783898 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:39.722832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cf54c-dd44-45c3-8907-c3fd41783898 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:39.723136 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cf54c-dd44-45c3-8907-c3fd41783898 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:39.724575 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cf54c-dd44-45c3-8907-c3fd41783898 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:39.736405 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 629/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:20:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:39.742624 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b715fa-4321-49b0-87a8-3c26a7d4600b None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:39.843104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b715fa-4321-49b0-87a8-3c26a7d4600b None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:39.870010 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:39.875820 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebfdb8-8e1b-4953-b3d1-a5a1eb584618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:39.876442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebfdb8-8e1b-4953-b3d1-a5a1eb584618 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:39.876720 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebfdb8-8e1b-4953-b3d1-a5a1eb584618 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:39.876989 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebfdb8-8e1b-4953-b3d1-a5a1eb584618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:39.877699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebfdb8-8e1b-4953-b3d1-a5a1eb584618 None admin] RBAC: Adding query filter params (role.id=2696068001744b38a289a59c56f56a95, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=5deb7370bc3045c5be2d391d3b1dbd82) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:39.878007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebfdb8-8e1b-4953-b3d1-a5a1eb584618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:39.879492 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebfdb8-8e1b-4953-b3d1-a5a1eb584618 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:39.885284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 590/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:20:39 2022] GET /identity/v3/role_assignments?user.id=5deb7370bc3045c5be2d391d3b1dbd82&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=2696068001744b38a289a59c56f56a95 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:41.981220 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949e4c9-144e-4082-8f6e-30c6bc227dc4 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:41.981787 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949e4c9-144e-4082-8f6e-30c6bc227dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:41.981787 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949e4c9-144e-4082-8f6e-30c6bc227dc4 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:41.983153 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 630/1220] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:20:41.988572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592f6f7-a118-4c65-b764-8ee82a2fad86 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:41.989011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592f6f7-a118-4c65-b764-8ee82a2fad86 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:41.989108 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592f6f7-a118-4c65-b764-8ee82a2fad86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:42.006910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-9592f6f7-a118-4c65-b764-8ee82a2fad86 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:20:42.009244 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-9592f6f7-a118-4c65-b764-8ee82a2fad86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:20:42.074503 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 591/1221] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:20:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:20:42.347707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949e4c9-144e-4082-8f6e-30c6bc227dc4 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:42.446969 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949e4c9-144e-4082-8f6e-30c6bc227dc4 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:42.480145 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3f8dc-5759-4e5f-92f2-4d1c78f54789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:42.480788 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3f8dc-5759-4e5f-92f2-4d1c78f54789 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:42.481071 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3f8dc-5759-4e5f-92f2-4d1c78f54789 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:42.481378 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3f8dc-5759-4e5f-92f2-4d1c78f54789 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:42.491126 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3f8dc-5759-4e5f-92f2-4d1c78f54789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:20:42.496484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-2da3f8dc-5759-4e5f-92f2-4d1c78f54789 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:20:42.496484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:42.496484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:42.496484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:42.496484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:42.496484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:42.496484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:42.496484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:42.496484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:42.496484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:42.496484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:42.496484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:42.496484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:20:42.496484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:20:42.496484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:20:42.496484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:20:42.497622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:20:42.497622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:20:42.497622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:20:42.497622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:20:42.497622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:42.497622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:42.497622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:42.497622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:42.497622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:42.497622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:42.497622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:42.497622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:42.497622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:42.497622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:42.497622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:42.497622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:42.498864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:42.498864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:42.498864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:42.498864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:42.498864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:20:42.498864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:20:42.498864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:20:42.498864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:20:42.498864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:20:42.498864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:20:42.498864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:20:42.498864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:20:42.498864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 631/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:20:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:42.503610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592f6f7-a118-4c65-b764-8ee82a2fad86 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:42.600178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592f6f7-a118-4c65-b764-8ee82a2fad86 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:42.623072 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:42.633336 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd486ad-f597-46d7-8704-05e95685281d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:42.633938 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd486ad-f597-46d7-8704-05e95685281d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:42.634217 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd486ad-f597-46d7-8704-05e95685281d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:42.634490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd486ad-f597-46d7-8704-05e95685281d None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:42.635720 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd486ad-f597-46d7-8704-05e95685281d None admin] RBAC: Adding query filter params (name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:42.636022 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd486ad-f597-46d7-8704-05e95685281d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:42.637423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd486ad-f597-46d7-8704-05e95685281d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:42.645006 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 592/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:20:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:42.650822 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3f8dc-5759-4e5f-92f2-4d1c78f54789 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:42.695273 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:42.750561 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3f8dc-5759-4e5f-92f2-4d1c78f54789 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:42.784314 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9675872-f625-48b9-97ad-8eb3bf7ff4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:42.784962 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9675872-f625-48b9-97ad-8eb3bf7ff4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:42.785238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9675872-f625-48b9-97ad-8eb3bf7ff4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:42.785509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9675872-f625-48b9-97ad-8eb3bf7ff4a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:42.796199 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9675872-f625-48b9-97ad-8eb3bf7ff4a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:42.797792 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9675872-f625-48b9-97ad-8eb3bf7ff4a8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:42.812876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-f9675872-f625-48b9-97ad-8eb3bf7ff4a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:42.812876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:42.812876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:42.812876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:42.812876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:42.812876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:42.812876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:42.812876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:42.812876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:42.812876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:42.812876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:42.812876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:42.812876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:20:42.812876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:20:42.812876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:20:42.812876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:20:42.814019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:42.814019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:42.814019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:42.814019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:42.814019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:42.814019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:42.814019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:42.814019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:42.814019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:42.814019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:42.814019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:42.814019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:42.814019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:42.814019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:42.814019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:42.814019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:42.814019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:20:42.815150 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:20:42.815150 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:42.815150 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:20:42.815150 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 632/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:42.819806 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd486ad-f597-46d7-8704-05e95685281d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:42.916673 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd486ad-f597-46d7-8704-05e95685281d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:42.949801 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3f5f8-1c13-47cc-8510-b157827013e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:42.950396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3f5f8-1c13-47cc-8510-b157827013e2 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:42.950672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3f5f8-1c13-47cc-8510-b157827013e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:42.950940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3f5f8-1c13-47cc-8510-b157827013e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:42.951592 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3f5f8-1c13-47cc-8510-b157827013e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:42.951861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3f5f8-1c13-47cc-8510-b157827013e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:42.953243 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3f5f8-1c13-47cc-8510-b157827013e2 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:42.964557 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 593/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:42.970360 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9675872-f625-48b9-97ad-8eb3bf7ff4a8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:43.062841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:43.069404 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9675872-f625-48b9-97ad-8eb3bf7ff4a8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:43.101553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2b5ab-c55d-4546-a2b4-a981fb9bcd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:43.102180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2b5ab-c55d-4546-a2b4-a981fb9bcd0d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:43.102457 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2b5ab-c55d-4546-a2b4-a981fb9bcd0d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:43.102730 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2b5ab-c55d-4546-a2b4-a981fb9bcd0d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:43.109870 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2b5ab-c55d-4546-a2b4-a981fb9bcd0d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:43.111298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2b5ab-c55d-4546-a2b4-a981fb9bcd0d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:43.122743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-82d2b5ab-c55d-4546-a2b4-a981fb9bcd0d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 16:20:43.122743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:43.122743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:43.122743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:43.122743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:43.122743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:43.122743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:43.122743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:43.122743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:43.122743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:43.122743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:43.122743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:43.122743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:20:43.122743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:20:43.122743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:20:43.122743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:20:43.123893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:43.123893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:43.123893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:20:43.123893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:20:43.123893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:20:43.123893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:20:43.123893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:43.123893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:43.123893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:43.123893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:43.123893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:43.123893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:43.123893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:43.123893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:43.123893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:43.123893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:43.123893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:43.123893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:43.130205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:43.130205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:43.130205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:20:43.130205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:20:43.130205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:20:43.130205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:20:43.130205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:20:43.130205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:20:43.130205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 16:20:43.130205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:20:43.130205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 633/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:20:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:43.131021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3f5f8-1c13-47cc-8510-b157827013e2 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:43.177339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:43.228832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3f5f8-1c13-47cc-8510-b157827013e2 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:43.263296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c99e5-299e-43df-a5d9-4b36fcebde90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:43.266658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c99e5-299e-43df-a5d9-4b36fcebde90 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:43.266658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c99e5-299e-43df-a5d9-4b36fcebde90 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:43.266658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c99e5-299e-43df-a5d9-4b36fcebde90 None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:43.266658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c99e5-299e-43df-a5d9-4b36fcebde90 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:43.266658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c99e5-299e-43df-a5d9-4b36fcebde90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:43.267185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c99e5-299e-43df-a5d9-4b36fcebde90 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:43.283231 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 594/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Sep 27 16:20:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:43.289128 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2b5ab-c55d-4546-a2b4-a981fb9bcd0d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:43.387573 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2b5ab-c55d-4546-a2b4-a981fb9bcd0d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:43.420245 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20ba41-6ad2-4e08-bae5-5adb4da40e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:43.421148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20ba41-6ad2-4e08-bae5-5adb4da40e6c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:43.421429 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20ba41-6ad2-4e08-bae5-5adb4da40e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:43.421799 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20ba41-6ad2-4e08-bae5-5adb4da40e6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:43.432119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20ba41-6ad2-4e08-bae5-5adb4da40e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:43.433462 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20ba41-6ad2-4e08-bae5-5adb4da40e6c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:43.447713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-8f20ba41-6ad2-4e08-bae5-5adb4da40e6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:43.447713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:43.447713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:43.447713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:43.447713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:43.447713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:43.447713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:43.447713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:43.447713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:43.447713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:43.447713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:43.447713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:43.447713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:20:43.447713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:20:43.447713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:20:43.447713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:20:43.448893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:43.448893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:43.448893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:43.448893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:43.448893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:43.448893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:43.448893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:43.448893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:43.448893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:43.448893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:43.448893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:43.448893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:43.448893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:43.448893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:43.448893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:43.448893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:43.448893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:20:43.450102 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:20:43.450102 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:43.450102 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:20:43.450102 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 634/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:20:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:43.454652 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c99e5-299e-43df-a5d9-4b36fcebde90 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:43.552690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c99e5-299e-43df-a5d9-4b36fcebde90 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:43.554998 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:43.587156 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba41013-ee69-4952-8a79-ee23078f3b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:43.588395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba41013-ee69-4952-8a79-ee23078f3b1f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:43.588683 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba41013-ee69-4952-8a79-ee23078f3b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:43.588957 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba41013-ee69-4952-8a79-ee23078f3b1f None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:43.589594 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba41013-ee69-4952-8a79-ee23078f3b1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:43.589900 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba41013-ee69-4952-8a79-ee23078f3b1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:43.591261 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba41013-ee69-4952-8a79-ee23078f3b1f None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:43.602434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 595/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:43.608397 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20ba41-6ad2-4e08-bae5-5adb4da40e6c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:43.617700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:43.708248 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20ba41-6ad2-4e08-bae5-5adb4da40e6c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:43.741010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74f930-0ccd-423f-ad47-bfbbfd0ef69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:43.741667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74f930-0ccd-423f-ad47-bfbbfd0ef69b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:43.741947 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74f930-0ccd-423f-ad47-bfbbfd0ef69b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:43.742223 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74f930-0ccd-423f-ad47-bfbbfd0ef69b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:43.749301 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74f930-0ccd-423f-ad47-bfbbfd0ef69b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:43.753117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74f930-0ccd-423f-ad47-bfbbfd0ef69b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:43.763926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-5e74f930-0ccd-423f-ad47-bfbbfd0ef69b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:20:43.763926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:43.763926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:43.763926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:43.763926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:43.763926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:43.763926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:43.763926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:43.763926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:43.763926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:43.763926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:43.763926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:43.763926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:20:43.763926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:20:43.763926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:20:43.765046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:20:43.765046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:43.765046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:43.765046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:43.765046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:43.765046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:43.765046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:43.765046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:43.765046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:43.765046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:43.765046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:43.765046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:43.765046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:43.765046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:43.765046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:43.765046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:43.765046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:43.766146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:20:43.766146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:20:43.766146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:20:43.766146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:20:43.766146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:20:43.766146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:20:43.766146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:20:43.766146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:20:43.766146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 635/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:20:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:43.770849 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba41013-ee69-4952-8a79-ee23078f3b1f None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:43.869956 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba41013-ee69-4952-8a79-ee23078f3b1f None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:43.903010 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13757b07-8343-4d43-876a-53b6a41ea5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:43.903610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13757b07-8343-4d43-876a-53b6a41ea5dd None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:43.903890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13757b07-8343-4d43-876a-53b6a41ea5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:43.904165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13757b07-8343-4d43-876a-53b6a41ea5dd None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:43.904888 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13757b07-8343-4d43-876a-53b6a41ea5dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:43.905194 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13757b07-8343-4d43-876a-53b6a41ea5dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:43.906624 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13757b07-8343-4d43-876a-53b6a41ea5dd None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:43.918343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 596/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:20:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:43.924839 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74f930-0ccd-423f-ad47-bfbbfd0ef69b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:43.987993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:44.022793 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74f930-0ccd-423f-ad47-bfbbfd0ef69b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:44.055558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf9d99-14b5-4a8a-9a38-36837f5e35d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:44.056281 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf9d99-14b5-4a8a-9a38-36837f5e35d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:44.057092 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf9d99-14b5-4a8a-9a38-36837f5e35d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:44.057360 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf9d99-14b5-4a8a-9a38-36837f5e35d6 None admin] PATH_INFO: `/v3/projects/ad230723d90a439daf38443915c2282f/users/5deb7370bc3045c5be2d391d3b1dbd82/roles/2696068001744b38a289a59c56f56a95` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:44.071078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf9d99-14b5-4a8a-9a38-36837f5e35d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad230723d90a439daf38443915c2282f, user_id=5deb7370bc3045c5be2d391d3b1dbd82, role_id=2696068001744b38a289a59c56f56a95)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:44.073155 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf9d99-14b5-4a8a-9a38-36837f5e35d6 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:44.131507 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 636/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:20:43 2022] PUT /identity/v3/projects/ad230723d90a439daf38443915c2282f/users/5deb7370bc3045c5be2d391d3b1dbd82/roles/2696068001744b38a289a59c56f56a95 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:20:46.241475 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e576c0-399a-46bf-98b1-58ba312aae50 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:46.242009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e576c0-399a-46bf-98b1-58ba312aae50 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:46.242009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e576c0-399a-46bf-98b1-58ba312aae50 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:46.243335 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 597/1233] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:20:46.249058 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f3dc1-fec9-4719-a53b-9474a95ae05f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:46.249502 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f3dc1-fec9-4719-a53b-9474a95ae05f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:46.249592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f3dc1-fec9-4719-a53b-9474a95ae05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:46.267795 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a14f3dc1-fec9-4719-a53b-9474a95ae05f None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:20:46.269015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a14f3dc1-fec9-4719-a53b-9474a95ae05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:20:46.332834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 637/1234] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:20:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:20:46.598021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e576c0-399a-46bf-98b1-58ba312aae50 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:46.622346 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:46.695795 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e576c0-399a-46bf-98b1-58ba312aae50 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:46.730532 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58fefb-e1b6-4fb5-bbfe-de238d0b1839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:46.731348 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58fefb-e1b6-4fb5-bbfe-de238d0b1839 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:46.731807 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58fefb-e1b6-4fb5-bbfe-de238d0b1839 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:46.732081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58fefb-e1b6-4fb5-bbfe-de238d0b1839 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:46.741916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58fefb-e1b6-4fb5-bbfe-de238d0b1839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:20:46.747175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-ac58fefb-e1b6-4fb5-bbfe-de238d0b1839 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:20:46.747175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:46.747175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:46.747175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:46.747175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:46.747175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:46.747175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:46.747175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:46.747175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:46.747175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:46.747175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:46.747175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:46.747175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:20:46.747175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:20:46.747175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:20:46.747175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:20:46.748291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:20:46.748291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:20:46.748291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:20:46.748291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:20:46.748291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:46.748291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:46.748291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:46.748291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:46.748291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:46.748291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:46.748291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:46.748291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:46.748291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:46.748291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:46.748291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:46.748291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:46.749481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:46.749481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:46.749481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:46.749481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:46.749481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:20:46.749481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:20:46.749481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:20:46.749481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:20:46.749481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:20:46.749481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:20:46.749481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 16:20:46.749481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:20:46.749481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 598/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 27 16:20:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:46.754308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f3dc1-fec9-4719-a53b-9474a95ae05f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:46.800584 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:46.851288 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f3dc1-fec9-4719-a53b-9474a95ae05f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:46.883928 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fe7f1-f687-49a6-b0b7-d44aa0896172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:46.884581 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fe7f1-f687-49a6-b0b7-d44aa0896172 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:46.884863 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fe7f1-f687-49a6-b0b7-d44aa0896172 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:46.885137 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fe7f1-f687-49a6-b0b7-d44aa0896172 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:46.885787 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fe7f1-f687-49a6-b0b7-d44aa0896172 None admin] RBAC: Adding query filter params (name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:46.886089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fe7f1-f687-49a6-b0b7-d44aa0896172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:46.887449 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fe7f1-f687-49a6-b0b7-d44aa0896172 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:46.894968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 638/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 27 16:20:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:46.901301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58fefb-e1b6-4fb5-bbfe-de238d0b1839 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:46.985354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:47.000329 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58fefb-e1b6-4fb5-bbfe-de238d0b1839 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:47.033728 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb695f-dc81-483c-8d9e-11e16cccd3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:47.034429 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb695f-dc81-483c-8d9e-11e16cccd3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:47.034709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb695f-dc81-483c-8d9e-11e16cccd3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:47.034981 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb695f-dc81-483c-8d9e-11e16cccd3b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:47.045773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb695f-dc81-483c-8d9e-11e16cccd3b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:47.050357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb695f-dc81-483c-8d9e-11e16cccd3b8 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:47.062005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-0edb695f-dc81-483c-8d9e-11e16cccd3b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:47.062005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:47.062005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:47.062005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:47.062005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:47.062005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:47.062005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:47.062005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:47.062005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:47.062005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:47.062005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:47.062005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:47.062005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:20:47.062005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:20:47.062005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:20:47.062005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:20:47.062995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:47.062995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:47.062995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:47.062995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:47.062995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:47.062995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:47.062995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:47.062995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:47.062995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:47.062995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:47.062995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:47.062995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:47.062995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:47.062995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:47.062995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:47.062995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:47.062995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:20:47.063918 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:20:47.063918 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:47.063918 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:20:47.063918 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 599/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:20:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:47.069104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fe7f1-f687-49a6-b0b7-d44aa0896172 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:47.168809 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fe7f1-f687-49a6-b0b7-d44aa0896172 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:47.177797 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:47.201853 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877d659-a65c-4816-bc4b-c59ab4a1b73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:47.202450 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877d659-a65c-4816-bc4b-c59ab4a1b73f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:47.202954 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877d659-a65c-4816-bc4b-c59ab4a1b73f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:47.203124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877d659-a65c-4816-bc4b-c59ab4a1b73f None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:47.203752 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877d659-a65c-4816-bc4b-c59ab4a1b73f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:47.204054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877d659-a65c-4816-bc4b-c59ab4a1b73f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:47.205455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877d659-a65c-4816-bc4b-c59ab4a1b73f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:47.217945 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 639/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:47.223811 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb695f-dc81-483c-8d9e-11e16cccd3b8 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:47.324175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb695f-dc81-483c-8d9e-11e16cccd3b8 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:47.360355 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd3854-ec6c-4f29-9afe-fe7560bc3e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:47.360979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd3854-ec6c-4f29-9afe-fe7560bc3e4e None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:47.361259 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd3854-ec6c-4f29-9afe-fe7560bc3e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:47.361532 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd3854-ec6c-4f29-9afe-fe7560bc3e4e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:47.364168 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:47.370452 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd3854-ec6c-4f29-9afe-fe7560bc3e4e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:47.371889 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd3854-ec6c-4f29-9afe-fe7560bc3e4e None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:47.382708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-7bdd3854-ec6c-4f29-9afe-fe7560bc3e4e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 16:20:47.382708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:47.382708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:47.382708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:47.382708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:47.382708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:47.382708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:47.382708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:47.382708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:47.382708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:47.382708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:47.382708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:47.382708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:20:47.382708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:20:47.382708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:20:47.382708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:20:47.383834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:47.383834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:47.383834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:20:47.383834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:20:47.383834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:20:47.383834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:20:47.383834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:47.383834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:47.383834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:47.383834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:47.383834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:47.383834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:47.383834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:47.383834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:47.383834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:47.383834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:47.383834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:47.383834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:47.384856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:47.384856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:47.384856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:20:47.384856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:20:47.384856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:20:47.384856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:20:47.384856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:20:47.384856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:20:47.384856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 16:20:47.384856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:20:47.384856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 600/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:20:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:20:47.389719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877d659-a65c-4816-bc4b-c59ab4a1b73f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:47.486228 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877d659-a65c-4816-bc4b-c59ab4a1b73f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:47.523384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220f8a1-b587-48ee-9702-811b4b037b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:47.523990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220f8a1-b587-48ee-9702-811b4b037b5f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:47.524270 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220f8a1-b587-48ee-9702-811b4b037b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:47.524595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220f8a1-b587-48ee-9702-811b4b037b5f None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:47.525780 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220f8a1-b587-48ee-9702-811b4b037b5f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:47.526083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220f8a1-b587-48ee-9702-811b4b037b5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:47.527492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220f8a1-b587-48ee-9702-811b4b037b5f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:47.544942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 640/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Sep 27 16:20:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:47.551224 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd3854-ec6c-4f29-9afe-fe7560bc3e4e None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:47.653394 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd3854-ec6c-4f29-9afe-fe7560bc3e4e None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:47.686900 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39802666-f466-4c33-b63d-c27a02c9c04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:47.687484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39802666-f466-4c33-b63d-c27a02c9c04b None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:47.687761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39802666-f466-4c33-b63d-c27a02c9c04b None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:47.688033 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39802666-f466-4c33-b63d-c27a02c9c04b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:47.748544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:47.754744 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39802666-f466-4c33-b63d-c27a02c9c04b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:47.756184 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39802666-f466-4c33-b63d-c27a02c9c04b None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:47.851236 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 601/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:20:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 16:20:47.857796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220f8a1-b587-48ee-9702-811b4b037b5f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:47.885255 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:47.956984 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220f8a1-b587-48ee-9702-811b4b037b5f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:47.991064 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e544ab-cd1d-4f94-a85a-2bcbeac9a7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:47.991685 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e544ab-cd1d-4f94-a85a-2bcbeac9a7bc None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:47.991964 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e544ab-cd1d-4f94-a85a-2bcbeac9a7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:47.992236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e544ab-cd1d-4f94-a85a-2bcbeac9a7bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:48.002021 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e544ab-cd1d-4f94-a85a-2bcbeac9a7bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:48.003402 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e544ab-cd1d-4f94-a85a-2bcbeac9a7bc None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:48.018000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-12e544ab-cd1d-4f94-a85a-2bcbeac9a7bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:48.018000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:48.018000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:48.018000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:48.018000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:48.018000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:48.018000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:48.018000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:48.018000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:48.018000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:48.018000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:48.018000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:48.018000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:20:48.018000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:20:48.018000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:20:48.018000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:20:48.019129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:48.019129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:48.019129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:48.019129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:48.019129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:48.019129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:48.019129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:48.019129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:48.019129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:48.019129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:48.019129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:48.019129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:48.019129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:48.019129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:48.019129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:48.019129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:48.019129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:20:48.020031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:20:48.020031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:48.020031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:20:48.020031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 641/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:20:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:48.025739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39802666-f466-4c33-b63d-c27a02c9c04b None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:48.121388 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:48.127079 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39802666-f466-4c33-b63d-c27a02c9c04b None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:48.160767 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45c944-e538-4093-b90a-3c4b95a6f061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:48.161449 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45c944-e538-4093-b90a-3c4b95a6f061 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:48.161724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45c944-e538-4093-b90a-3c4b95a6f061 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:48.161995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45c944-e538-4093-b90a-3c4b95a6f061 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:48.162618 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45c944-e538-4093-b90a-3c4b95a6f061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:48.162915 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45c944-e538-4093-b90a-3c4b95a6f061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:48.164302 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45c944-e538-4093-b90a-3c4b95a6f061 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:48.175548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 602/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:48.181580 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e544ab-cd1d-4f94-a85a-2bcbeac9a7bc None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:48.260648 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:48.280828 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e544ab-cd1d-4f94-a85a-2bcbeac9a7bc None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:48.313441 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61d82f-d777-4622-9573-d72ac303fb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:48.314052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61d82f-d777-4622-9573-d72ac303fb0c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:48.314333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61d82f-d777-4622-9573-d72ac303fb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:48.314616 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61d82f-d777-4622-9573-d72ac303fb0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:48.321014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61d82f-d777-4622-9573-d72ac303fb0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:48.323048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61d82f-d777-4622-9573-d72ac303fb0c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:48.334120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-bd61d82f-d777-4622-9573-d72ac303fb0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:20:48.334120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:48.334120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:48.334120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:48.334120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:48.334120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:48.334120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:48.334120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:48.334120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:48.334120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:48.334120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:48.334120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:48.334120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:20:48.334120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:20:48.334120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:20:48.335331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:20:48.335331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:48.335331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:48.335331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:48.335331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:48.335331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:48.335331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:48.335331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:48.335331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:48.335331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:48.335331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:48.335331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:48.335331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:48.335331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:48.335331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:48.335331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:48.335331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:48.336587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:20:48.336587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:20:48.336587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:20:48.336587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:20:48.336587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:20:48.336587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:20:48.336587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:20:48.336587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:20:48.336587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 642/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:20:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:48.341127 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45c944-e538-4093-b90a-3c4b95a6f061 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:48.438624 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45c944-e538-4093-b90a-3c4b95a6f061 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:48.471032 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfae99-a36c-4a1b-82b7-7e68429b7529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:48.471632 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfae99-a36c-4a1b-82b7-7e68429b7529 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:48.471910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfae99-a36c-4a1b-82b7-7e68429b7529 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:48.472179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfae99-a36c-4a1b-82b7-7e68429b7529 None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:48.472885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfae99-a36c-4a1b-82b7-7e68429b7529 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:48.473189 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfae99-a36c-4a1b-82b7-7e68429b7529 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:48.474610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfae99-a36c-4a1b-82b7-7e68429b7529 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:48.486255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 603/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:20:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:48.492430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61d82f-d777-4622-9573-d72ac303fb0c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:48.590711 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61d82f-d777-4622-9573-d72ac303fb0c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:48.623383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6d2ce-f2d9-43b1-b8cc-00e0ab052d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:48.624069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6d2ce-f2d9-43b1-b8cc-00e0ab052d71 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:48.624370 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6d2ce-f2d9-43b1-b8cc-00e0ab052d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:48.624643 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6d2ce-f2d9-43b1-b8cc-00e0ab052d71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:48.625346 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6d2ce-f2d9-43b1-b8cc-00e0ab052d71 None admin] RBAC: Adding query filter params (role.id=2696068001744b38a289a59c56f56a95, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=5deb7370bc3045c5be2d391d3b1dbd82) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:48.625648 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6d2ce-f2d9-43b1-b8cc-00e0ab052d71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:48.627051 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6d2ce-f2d9-43b1-b8cc-00e0ab052d71 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:48.632673 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 643/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:20:48 2022] GET /identity/v3/role_assignments?user.id=5deb7370bc3045c5be2d391d3b1dbd82&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=2696068001744b38a289a59c56f56a95 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:50.836734 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50663f8-ac05-4042-bdec-24a0402884d6 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:50.837202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50663f8-ac05-4042-bdec-24a0402884d6 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:50.837289 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50663f8-ac05-4042-bdec-24a0402884d6 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:50.839127 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 604/1247] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:20:50.845574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d265be-82cf-40b7-8e8f-3f8bb5284909 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:50.845971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d265be-82cf-40b7-8e8f-3f8bb5284909 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:50.846125 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d265be-82cf-40b7-8e8f-3f8bb5284909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:50.852527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:50.864978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b3d265be-82cf-40b7-8e8f-3f8bb5284909 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:20:50.866162 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b3d265be-82cf-40b7-8e8f-3f8bb5284909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:20:50.931065 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 644/1248] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:20:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:20:51.195979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50663f8-ac05-4042-bdec-24a0402884d6 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:51.215892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:51.298730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50663f8-ac05-4042-bdec-24a0402884d6 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:51.335418 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8275de-ab7b-4e77-92db-8d0d36f8b207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:51.336085 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8275de-ab7b-4e77-92db-8d0d36f8b207 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:51.336398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8275de-ab7b-4e77-92db-8d0d36f8b207 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:51.336677 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8275de-ab7b-4e77-92db-8d0d36f8b207 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:51.346761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8275de-ab7b-4e77-92db-8d0d36f8b207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:20:51.351496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-ba8275de-ab7b-4e77-92db-8d0d36f8b207 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:20:51.351496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:51.351496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:51.351496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:51.351496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:51.351496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:51.351496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:51.351496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:51.351496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:51.351496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:51.351496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:51.351496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:51.351496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:20:51.351496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:20:51.351496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:20:51.351496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:20:51.352699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:20:51.352699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:20:51.352699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:20:51.352699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:20:51.352699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:51.352699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:51.352699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:51.352699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:51.352699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:51.352699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:51.352699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:51.352699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:51.352699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:51.352699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:51.352699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:51.352699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:51.353752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:51.353752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:51.353752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:51.353752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:51.353752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:20:51.353752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:20:51.353752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:20:51.353752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:20:51.353752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:20:51.353752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:20:51.353752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:20:51.353752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:20:51.353752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 605/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:20:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:51.358617 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d265be-82cf-40b7-8e8f-3f8bb5284909 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:51.454964 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d265be-82cf-40b7-8e8f-3f8bb5284909 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:51.482409 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:51.487119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560fb59-fe1a-4681-af77-4841a5ec5431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:51.487715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560fb59-fe1a-4681-af77-4841a5ec5431 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:51.487991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560fb59-fe1a-4681-af77-4841a5ec5431 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:51.488259 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560fb59-fe1a-4681-af77-4841a5ec5431 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:51.488940 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560fb59-fe1a-4681-af77-4841a5ec5431 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:51.489243 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560fb59-fe1a-4681-af77-4841a5ec5431 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:51.490615 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560fb59-fe1a-4681-af77-4841a5ec5431 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:51.499061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 645/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:20:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:51.505077 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8275de-ab7b-4e77-92db-8d0d36f8b207 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:51.581093 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:51.602831 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8275de-ab7b-4e77-92db-8d0d36f8b207 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:51.636089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d5f01-c88d-450f-a384-862f26826530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:51.636763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d5f01-c88d-450f-a384-862f26826530 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:51.637056 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d5f01-c88d-450f-a384-862f26826530 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:51.637315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d5f01-c88d-450f-a384-862f26826530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:51.647898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d5f01-c88d-450f-a384-862f26826530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:51.649376 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d5f01-c88d-450f-a384-862f26826530 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:51.663466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-d04d5f01-c88d-450f-a384-862f26826530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:51.663466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:51.663466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:51.663466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:51.663466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:51.663466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:51.663466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:51.663466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:51.663466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:51.663466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:51.663466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:51.663466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:51.663466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:20:51.663466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:20:51.663466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:20:51.663466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:20:51.664462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:51.664462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:51.664462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:51.664462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:51.664462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:51.664462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:51.664462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:51.664462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:51.664462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:51.664462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:51.664462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:51.664462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:51.664462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:51.664462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:51.664462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:51.664462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:51.664462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:20:51.666202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:20:51.666202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:51.666202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:20:51.666202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 606/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:20:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:51.671108 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560fb59-fe1a-4681-af77-4841a5ec5431 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:51.769537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560fb59-fe1a-4681-af77-4841a5ec5431 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:51.803208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d38390-7a9a-4dcc-b824-3f3c388f34a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:51.803809 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d38390-7a9a-4dcc-b824-3f3c388f34a3 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:51.804086 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d38390-7a9a-4dcc-b824-3f3c388f34a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:51.804384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d38390-7a9a-4dcc-b824-3f3c388f34a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:51.805021 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d38390-7a9a-4dcc-b824-3f3c388f34a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:51.805320 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d38390-7a9a-4dcc-b824-3f3c388f34a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:51.807631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d38390-7a9a-4dcc-b824-3f3c388f34a3 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:51.819208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 646/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:51.824972 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d5f01-c88d-450f-a384-862f26826530 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:51.934013 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d5f01-c88d-450f-a384-862f26826530 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:51.959346 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:51.966810 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6c3f4-a098-468b-ba4d-aff39b283235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:51.967473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6c3f4-a098-468b-ba4d-aff39b283235 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:51.967747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6c3f4-a098-468b-ba4d-aff39b283235 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:51.968030 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6c3f4-a098-468b-ba4d-aff39b283235 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:51.975193 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6c3f4-a098-468b-ba4d-aff39b283235 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:51.976758 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6c3f4-a098-468b-ba4d-aff39b283235 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:51.988197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-90a6c3f4-a098-468b-ba4d-aff39b283235 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 16:20:51.988197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:51.988197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:51.988197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:51.988197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:51.988197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:51.988197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:51.988197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:51.988197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:51.988197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:51.988197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:51.988197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:51.988197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:20:51.988197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:20:51.988197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:20:51.988197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:20:51.989370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:51.989370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:51.989370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:20:51.989370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:20:51.989370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:20:51.989370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:20:51.989370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:51.989370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:51.989370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:51.989370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:51.989370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:51.989370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:51.989370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:51.989370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:51.989370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:51.989370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:51.989370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:51.989370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:51.990747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:51.990747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:51.990747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:20:51.990747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:20:51.990747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:20:51.990747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:20:51.990747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:20:51.990747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:20:51.990747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 16:20:51.990747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:20:51.990747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 607/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:20:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:51.995790 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d38390-7a9a-4dcc-b824-3f3c388f34a3 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:52.051314 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:52.093275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d38390-7a9a-4dcc-b824-3f3c388f34a3 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:52.126401 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb9c1f-bde5-4757-8410-01d9a40d1a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:52.126993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb9c1f-bde5-4757-8410-01d9a40d1a87 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:52.127266 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb9c1f-bde5-4757-8410-01d9a40d1a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:52.127535 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb9c1f-bde5-4757-8410-01d9a40d1a87 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:52.128370 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb9c1f-bde5-4757-8410-01d9a40d1a87 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:52.128670 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb9c1f-bde5-4757-8410-01d9a40d1a87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:52.130179 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb9c1f-bde5-4757-8410-01d9a40d1a87 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:52.146815 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 647/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Sep 27 16:20:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:52.153176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6c3f4-a098-468b-ba4d-aff39b283235 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:52.262666 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6c3f4-a098-468b-ba4d-aff39b283235 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:52.297370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e564fff-634f-4b39-80f7-361fd684ccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:52.297971 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e564fff-634f-4b39-80f7-361fd684ccf5 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:52.298253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e564fff-634f-4b39-80f7-361fd684ccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:52.298532 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e564fff-634f-4b39-80f7-361fd684ccf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:52.352187 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:52.364752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e564fff-634f-4b39-80f7-361fd684ccf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:52.366195 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e564fff-634f-4b39-80f7-361fd684ccf5 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:52.460116 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 608/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:20:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 16:20:52.466800 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb9c1f-bde5-4757-8410-01d9a40d1a87 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:52.566433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb9c1f-bde5-4757-8410-01d9a40d1a87 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:52.579696 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:52.600775 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041b993-b276-47c6-8a97-da16250f9e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:52.601398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041b993-b276-47c6-8a97-da16250f9e73 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:52.601674 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041b993-b276-47c6-8a97-da16250f9e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:52.601948 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041b993-b276-47c6-8a97-da16250f9e73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:52.611590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041b993-b276-47c6-8a97-da16250f9e73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:52.613007 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041b993-b276-47c6-8a97-da16250f9e73 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:52.627069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-b041b993-b276-47c6-8a97-da16250f9e73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:52.627069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:52.627069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:52.627069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:52.627069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:52.627069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:52.627069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:52.627069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:52.627069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:52.627069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:52.627069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:52.627069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:52.627069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:20:52.627069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:20:52.627069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:20:52.627069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:20:52.630942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:52.630942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:52.630942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:52.630942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:52.630942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:52.630942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:52.630942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:52.630942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:52.630942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:52.630942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:52.630942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:52.630942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:52.630942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:52.630942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:52.630942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:52.630942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:52.630942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:20:52.631869 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:20:52.631869 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:52.631869 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:20:52.631869 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 648/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:52.634047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e564fff-634f-4b39-80f7-361fd684ccf5 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:52.721104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:52.732566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e564fff-634f-4b39-80f7-361fd684ccf5 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:52.765673 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe7061-9418-4828-b225-4cc40f0ec8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:52.766268 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe7061-9418-4828-b225-4cc40f0ec8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:52.766546 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe7061-9418-4828-b225-4cc40f0ec8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:52.766818 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe7061-9418-4828-b225-4cc40f0ec8a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:52.767449 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe7061-9418-4828-b225-4cc40f0ec8a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:52.767751 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe7061-9418-4828-b225-4cc40f0ec8a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:52.769139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe7061-9418-4828-b225-4cc40f0ec8a6 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:52.779996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 609/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:52.785795 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041b993-b276-47c6-8a97-da16250f9e73 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:52.887045 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041b993-b276-47c6-8a97-da16250f9e73 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:52.919516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec0e6d-5c1d-4468-80c5-12df195b15fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:52.920132 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec0e6d-5c1d-4468-80c5-12df195b15fb None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:52.920443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec0e6d-5c1d-4468-80c5-12df195b15fb None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:52.920970 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec0e6d-5c1d-4468-80c5-12df195b15fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:52.927468 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec0e6d-5c1d-4468-80c5-12df195b15fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:52.928941 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec0e6d-5c1d-4468-80c5-12df195b15fb None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:52.940635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-b9ec0e6d-5c1d-4468-80c5-12df195b15fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:20:52.940635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:52.940635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:52.940635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:52.940635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:52.940635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:52.940635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:52.940635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:52.940635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:52.940635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:52.940635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:52.940635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:52.940635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:20:52.940635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:20:52.940635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:20:52.941713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:20:52.941713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:52.941713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:52.941713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:52.941713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:52.941713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:52.941713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:52.941713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:52.941713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:52.941713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:52.941713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:52.941713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:52.941713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:52.941713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:52.941713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:52.941713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:52.941713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:52.942700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:20:52.942700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:20:52.942700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:20:52.942700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:20:52.942700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:20:52.942700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:20:52.942700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:20:52.942700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:20:52.942700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 649/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:20:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:52.948356 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe7061-9418-4828-b225-4cc40f0ec8a6 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:53.048688 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe7061-9418-4828-b225-4cc40f0ec8a6 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:53.082885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26bbb3f-929f-425a-b7d2-fde9b811a14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:53.083486 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bbb3f-929f-425a-b7d2-fde9b811a14d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:53.083779 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bbb3f-929f-425a-b7d2-fde9b811a14d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:53.084057 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bbb3f-929f-425a-b7d2-fde9b811a14d None admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:53.084764 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26bbb3f-929f-425a-b7d2-fde9b811a14d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:53.085069 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26bbb3f-929f-425a-b7d2-fde9b811a14d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:53.086535 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26bbb3f-929f-425a-b7d2-fde9b811a14d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:53.098752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 610/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:20:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:53.105037 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec0e6d-5c1d-4468-80c5-12df195b15fb None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:53.132109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:53.209133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec0e6d-5c1d-4468-80c5-12df195b15fb None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:53.241584 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd116f25-24ae-4438-9b36-5835a99a78cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:53.242178 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd116f25-24ae-4438-9b36-5835a99a78cd None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:53.242460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd116f25-24ae-4438-9b36-5835a99a78cd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:53.242731 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd116f25-24ae-4438-9b36-5835a99a78cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:53.243437 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd116f25-24ae-4438-9b36-5835a99a78cd None admin] RBAC: Adding query filter params (role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=5deb7370bc3045c5be2d391d3b1dbd82) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:53.244398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd116f25-24ae-4438-9b36-5835a99a78cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:53.245843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd116f25-24ae-4438-9b36-5835a99a78cd None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:53.251008 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 650/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:20:53 2022] GET /identity/v3/role_assignments?user.id=5deb7370bc3045c5be2d391d3b1dbd82&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:55.353894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efc812-4e25-44fe-aacd-6484720f5766 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:55.354450 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efc812-4e25-44fe-aacd-6484720f5766 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:55.354450 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efc812-4e25-44fe-aacd-6484720f5766 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:55.355770 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 611/1261] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:20:55.361087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b319b-b5c1-4b74-9164-c39a98463d48 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:55.361504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b319b-b5c1-4b74-9164-c39a98463d48 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:55.361630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b319b-b5c1-4b74-9164-c39a98463d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:55.381219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6f5b319b-b5c1-4b74-9164-c39a98463d48 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:20:55.382448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6f5b319b-b5c1-4b74-9164-c39a98463d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:20:55.448032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 651/1262] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:20:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:20:55.718308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efc812-4e25-44fe-aacd-6484720f5766 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:55.729709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:55.823646 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efc812-4e25-44fe-aacd-6484720f5766 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:55.858567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8849b7-9a81-4c42-922f-011464b78ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:55.859243 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8849b7-9a81-4c42-922f-011464b78ede None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:55.859525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8849b7-9a81-4c42-922f-011464b78ede None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:55.859796 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8849b7-9a81-4c42-922f-011464b78ede None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:55.869788 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8849b7-9a81-4c42-922f-011464b78ede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:20:55.874582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-3a8849b7-9a81-4c42-922f-011464b78ede None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:20:55.874582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:55.874582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:55.874582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:55.874582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:55.874582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:55.874582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:55.874582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:55.874582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:55.874582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:55.874582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:55.874582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:55.874582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:20:55.874582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:20:55.874582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:20:55.874582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:20:55.876387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:20:55.876387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:20:55.876387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:20:55.876387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:20:55.876387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:55.876387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:55.876387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:55.876387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:55.876387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:55.876387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:55.876387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:55.876387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:55.876387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:55.876387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:55.876387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:55.876387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:55.882025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:55.882025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:55.882025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:55.882025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:55.882025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:20:55.882025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:20:55.882025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:20:55.882025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:20:55.882025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:20:55.882025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:20:55.882025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:20:55.882025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:20:55.882025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 612/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:20:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:55.882908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b319b-b5c1-4b74-9164-c39a98463d48 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:55.900820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:55.981026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b319b-b5c1-4b74-9164-c39a98463d48 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:56.013508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6fddd-d31d-4872-9b94-ca80b200993d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:56.014109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6fddd-d31d-4872-9b94-ca80b200993d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:56.014395 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6fddd-d31d-4872-9b94-ca80b200993d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:56.014669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6fddd-d31d-4872-9b94-ca80b200993d None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:56.015324 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6fddd-d31d-4872-9b94-ca80b200993d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:56.015629 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6fddd-d31d-4872-9b94-ca80b200993d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:56.017035 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6fddd-d31d-4872-9b94-ca80b200993d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:56.025851 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 652/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:20:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:56.031640 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8849b7-9a81-4c42-922f-011464b78ede None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:56.096805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:56.128413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8849b7-9a81-4c42-922f-011464b78ede None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:56.162751 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0c111-1744-4121-827d-76d1cbed6549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:56.163383 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0c111-1744-4121-827d-76d1cbed6549 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:56.163658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0c111-1744-4121-827d-76d1cbed6549 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:56.163938 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0c111-1744-4121-827d-76d1cbed6549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:56.174769 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0c111-1744-4121-827d-76d1cbed6549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:56.176320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0c111-1744-4121-827d-76d1cbed6549 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:56.190908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-dfa0c111-1744-4121-827d-76d1cbed6549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:56.190908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:56.190908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:56.190908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:56.190908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:56.190908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:56.190908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:56.190908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:56.190908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:56.190908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:56.190908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:56.190908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:56.190908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:20:56.190908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:20:56.190908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:20:56.190908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:20:56.192084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:56.192084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:56.192084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:56.192084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:56.192084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:56.192084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:56.192084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:56.192084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:56.192084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:56.192084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:56.192084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:56.192084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:56.192084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:56.192084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:56.192084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:56.192084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:56.192084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:20:56.193254 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:20:56.193254 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:56.193254 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:20:56.193254 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 613/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 16:20:56.198364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6fddd-d31d-4872-9b94-ca80b200993d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:56.280878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:56.300613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6fddd-d31d-4872-9b94-ca80b200993d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:56.332852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54b7d4-7f7b-4c65-8928-2e77a7c61a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:56.333448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54b7d4-7f7b-4c65-8928-2e77a7c61a4b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:56.333724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54b7d4-7f7b-4c65-8928-2e77a7c61a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:56.333993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54b7d4-7f7b-4c65-8928-2e77a7c61a4b None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:56.334710 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54b7d4-7f7b-4c65-8928-2e77a7c61a4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:56.335102 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54b7d4-7f7b-4c65-8928-2e77a7c61a4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:56.336626 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54b7d4-7f7b-4c65-8928-2e77a7c61a4b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:56.348736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 653/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:56.354872 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0c111-1744-4121-827d-76d1cbed6549 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:56.455843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0c111-1744-4121-827d-76d1cbed6549 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:56.475057 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:56.489521 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3021e6-3306-4e83-9e69-5568a3bcac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:56.490222 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3021e6-3306-4e83-9e69-5568a3bcac0e None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:56.490496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3021e6-3306-4e83-9e69-5568a3bcac0e None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:56.490765 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3021e6-3306-4e83-9e69-5568a3bcac0e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:56.498632 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3021e6-3306-4e83-9e69-5568a3bcac0e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:56.500136 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3021e6-3306-4e83-9e69-5568a3bcac0e None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:56.511185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-1f3021e6-3306-4e83-9e69-5568a3bcac0e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 16:20:56.511185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:56.511185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:56.511185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:56.511185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:56.511185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:56.511185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:56.511185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:56.511185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:56.511185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:56.511185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:56.511185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:56.511185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:20:56.511185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:20:56.511185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:20:56.511185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:20:56.512385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:56.512385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:56.512385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:20:56.512385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:20:56.512385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:20:56.512385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:20:56.512385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:56.512385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:56.512385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:56.512385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:56.512385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:56.512385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:56.512385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:56.512385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:56.512385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:56.512385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:56.512385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:56.512385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:56.513476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:56.513476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:56.513476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:20:56.513476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:20:56.513476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:20:56.513476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:20:56.513476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:20:56.513476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:20:56.513476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 16:20:56.513476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:20:56.513476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 614/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:20:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:56.518549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54b7d4-7f7b-4c65-8928-2e77a7c61a4b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:56.617484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54b7d4-7f7b-4c65-8928-2e77a7c61a4b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:56.650727 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55900ef3-c61e-407f-ab2b-3f0fc6c5c50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:56.651326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55900ef3-c61e-407f-ab2b-3f0fc6c5c50c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:56.651608 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55900ef3-c61e-407f-ab2b-3f0fc6c5c50c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:56.651883 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55900ef3-c61e-407f-ab2b-3f0fc6c5c50c None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:56.652623 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55900ef3-c61e-407f-ab2b-3f0fc6c5c50c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:56.652930 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55900ef3-c61e-407f-ab2b-3f0fc6c5c50c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:56.654373 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55900ef3-c61e-407f-ab2b-3f0fc6c5c50c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:56.662771 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:56.671745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 654/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Sep 27 16:20:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:56.678107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3021e6-3306-4e83-9e69-5568a3bcac0e None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:56.776284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3021e6-3306-4e83-9e69-5568a3bcac0e None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:56.810209 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65639b-8b8d-472b-951a-7663d20c2cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:56.810833 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65639b-8b8d-472b-951a-7663d20c2cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:56.811108 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65639b-8b8d-472b-951a-7663d20c2cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:56.811376 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65639b-8b8d-472b-951a-7663d20c2cf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:56.821730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65639b-8b8d-472b-951a-7663d20c2cf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:56.823306 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65639b-8b8d-472b-951a-7663d20c2cf4 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:56.837092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-8a65639b-8b8d-472b-951a-7663d20c2cf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:56.837092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:56.837092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:56.837092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:56.837092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:56.837092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:56.837092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:56.837092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:56.837092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:56.837092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:56.837092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:56.837092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:56.837092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:20:56.837092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:20:56.837092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:20:56.837092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:20:56.838748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:56.838748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:56.838748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:56.838748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:56.838748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:56.838748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:56.838748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:56.838748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:56.838748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:56.838748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:56.838748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:56.838748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:56.838748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:56.838748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:56.838748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:56.838748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:56.838748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:20:56.839961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:20:56.839961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:20:56.839961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:20:56.839961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 615/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:56.845228 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55900ef3-c61e-407f-ab2b-3f0fc6c5c50c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:56.945844 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55900ef3-c61e-407f-ab2b-3f0fc6c5c50c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:56.979195 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e3eff-7cf6-4a23-94bb-55fd237d5c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:56.979778 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e3eff-7cf6-4a23-94bb-55fd237d5c21 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:56.980055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e3eff-7cf6-4a23-94bb-55fd237d5c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:56.980361 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e3eff-7cf6-4a23-94bb-55fd237d5c21 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:56.984162 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e3eff-7cf6-4a23-94bb-55fd237d5c21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:56.984162 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e3eff-7cf6-4a23-94bb-55fd237d5c21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:56.984162 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e3eff-7cf6-4a23-94bb-55fd237d5c21 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:56.993877 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 655/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:56.999957 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65639b-8b8d-472b-951a-7663d20c2cf4 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:57.032311 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:57.100621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65639b-8b8d-472b-951a-7663d20c2cf4 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:57.133451 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28189aee-a631-4987-9b92-848ee351f90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:57.134071 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28189aee-a631-4987-9b92-848ee351f90b None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:57.134851 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28189aee-a631-4987-9b92-848ee351f90b None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:57.135120 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28189aee-a631-4987-9b92-848ee351f90b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:57.141609 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28189aee-a631-4987-9b92-848ee351f90b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:57.143036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28189aee-a631-4987-9b92-848ee351f90b None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:57.154465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-28189aee-a631-4987-9b92-848ee351f90b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:20:57.154465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:20:57.154465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:20:57.154465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:20:57.154465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:20:57.154465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:20:57.154465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:20:57.154465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:20:57.154465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:20:57.154465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:20:57.154465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:20:57.154465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:20:57.154465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:20:57.154465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:20:57.154465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:20:57.155561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:20:57.155561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:20:57.155561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:20:57.155561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:20:57.155561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:20:57.155561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:20:57.155561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:20:57.155561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:20:57.155561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:20:57.155561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:20:57.155561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:20:57.155561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:20:57.155561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:20:57.155561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:20:57.155561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:20:57.155561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:20:57.155561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:20:57.156826 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:20:57.156826 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:20:57.156826 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:20:57.156826 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:20:57.156826 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:20:57.156826 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:20:57.156826 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:20:57.156826 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:20:57.160279 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 616/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:20:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:20:57.161465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e3eff-7cf6-4a23-94bb-55fd237d5c21 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:57.223355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:57.264611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e3eff-7cf6-4a23-94bb-55fd237d5c21 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:57.296672 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c47c5a-22c6-47e9-b743-978f8144fde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:57.313893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c47c5a-22c6-47e9-b743-978f8144fde6 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:57.313893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c47c5a-22c6-47e9-b743-978f8144fde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:57.313893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c47c5a-22c6-47e9-b743-978f8144fde6 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:57.313893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c47c5a-22c6-47e9-b743-978f8144fde6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:20:57.313893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c47c5a-22c6-47e9-b743-978f8144fde6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:57.313893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c47c5a-22c6-47e9-b743-978f8144fde6 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:57.314406 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 656/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:20:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:20:57.318329 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28189aee-a631-4987-9b92-848ee351f90b None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:20:57.409292 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:20:57.420037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28189aee-a631-4987-9b92-848ee351f90b None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:20:57.453807 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf21ee7-e33d-4e9f-ba5c-5d6554ba23aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:20:57.454457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf21ee7-e33d-4e9f-ba5c-5d6554ba23aa None admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:57.454736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf21ee7-e33d-4e9f-ba5c-5d6554ba23aa None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:57.455011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf21ee7-e33d-4e9f-ba5c-5d6554ba23aa None admin] PATH_INFO: `/v3/projects/ad230723d90a439daf38443915c2282f/users/5deb7370bc3045c5be2d391d3b1dbd82/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:57.456950 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf21ee7-e33d-4e9f-ba5c-5d6554ba23aa None admin] RBAC: Authorizing `identity:create_grant(project_id=ad230723d90a439daf38443915c2282f, user_id=5deb7370bc3045c5be2d391d3b1dbd82, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:20:57.458421 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf21ee7-e33d-4e9f-ba5c-5d6554ba23aa None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:20:57.572736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 617/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 27 16:20:57 2022] PUT /identity/v3/projects/ad230723d90a439daf38443915c2282f/users/5deb7370bc3045c5be2d391d3b1dbd82/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:20:59.724138 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9a0ea-b347-4d5c-96fb-7c13ff1d51c0 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:59.724716 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9a0ea-b347-4d5c-96fb-7c13ff1d51c0 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:59.724716 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9a0ea-b347-4d5c-96fb-7c13ff1d51c0 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:59.726110 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 657/1274] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:20:59.731940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183edcd3-13d4-4554-954b-06436a089249 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:20:59.732399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183edcd3-13d4-4554-954b-06436a089249 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:20:59.732518 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183edcd3-13d4-4554-954b-06436a089249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:20:59.750383 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-183edcd3-13d4-4554-954b-06436a089249 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:20:59.751577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-183edcd3-13d4-4554-954b-06436a089249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:20:59.821561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 618/1275] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:20:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:21:00.096151 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9a0ea-b347-4d5c-96fb-7c13ff1d51c0 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:00.194404 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9a0ea-b347-4d5c-96fb-7c13ff1d51c0 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:00.211710 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:21:00.228653 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef8790-5271-4565-857c-bf239c4e666c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:00.229287 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef8790-5271-4565-857c-bf239c4e666c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:00.229599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef8790-5271-4565-857c-bf239c4e666c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:00.229874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef8790-5271-4565-857c-bf239c4e666c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:00.239578 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef8790-5271-4565-857c-bf239c4e666c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 16:21:00.245299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-15ef8790-5271-4565-857c-bf239c4e666c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:21:00.245299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:21:00.245299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:21:00.245299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:21:00.245299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:21:00.245299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:21:00.245299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:21:00.245299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:21:00.245299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:21:00.245299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:21:00.245299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:21:00.245299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:21:00.245299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 16:21:00.245299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 16:21:00.245299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 16:21:00.245299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 16:21:00.246518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 16:21:00.246518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 16:21:00.246518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 16:21:00.246518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 16:21:00.246518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:21:00.246518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:21:00.246518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:21:00.246518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:21:00.246518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:21:00.246518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:21:00.246518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:21:00.246518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:21:00.246518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:21:00.246518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:21:00.246518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:21:00.246518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:21:00.247574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:21:00.247574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:21:00.247574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:21:00.247574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:21:00.247574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 16:21:00.247574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 16:21:00.247574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 16:21:00.247574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 16:21:00.247574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 16:21:00.247574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 16:21:00.247574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 16:21:00.247574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:21:00.247574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 658/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 27 16:21:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:21:00.252875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183edcd3-13d4-4554-954b-06436a089249 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:00.333039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:21:00.350436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183edcd3-13d4-4554-954b-06436a089249 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:00.382741 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059f770-4cf5-40c6-b299-3b7d7befb1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:00.383334 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059f770-4cf5-40c6-b299-3b7d7befb1df None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:00.383607 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059f770-4cf5-40c6-b299-3b7d7befb1df None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:00.383874 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059f770-4cf5-40c6-b299-3b7d7befb1df None admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:00.385155 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059f770-4cf5-40c6-b299-3b7d7befb1df None admin] RBAC: Adding query filter params (name=admin) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:21:00.385493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059f770-4cf5-40c6-b299-3b7d7befb1df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:00.386885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059f770-4cf5-40c6-b299-3b7d7befb1df None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:00.395913 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 619/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 27 16:21:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:21:00.420019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef8790-5271-4565-857c-bf239c4e666c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:00.505246 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef8790-5271-4565-857c-bf239c4e666c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:00.538922 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acad2b-3b8b-461a-a37a-d6aaf8824e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:00.539540 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acad2b-3b8b-461a-a37a-d6aaf8824e7e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:00.539827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acad2b-3b8b-461a-a37a-d6aaf8824e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:00.540102 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acad2b-3b8b-461a-a37a-d6aaf8824e7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:00.550272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acad2b-3b8b-461a-a37a-d6aaf8824e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:00.551706 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acad2b-3b8b-461a-a37a-d6aaf8824e7e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:00.566421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-25acad2b-3b8b-461a-a37a-d6aaf8824e7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:21:00.566421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:21:00.566421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:21:00.566421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:21:00.566421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:21:00.566421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:21:00.566421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:21:00.566421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:21:00.566421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:21:00.566421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:21:00.566421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:21:00.566421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:21:00.566421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:21:00.566421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:21:00.566421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:21:00.566421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:21:00.568201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:21:00.568201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:21:00.568201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:21:00.568201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:21:00.568201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:21:00.568201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:21:00.568201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:21:00.568201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:21:00.568201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:21:00.568201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:21:00.568201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:21:00.568201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:21:00.568201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:21:00.568201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:21:00.568201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:21:00.568201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:21:00.568201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:21:00.569422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:21:00.569422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:21:00.569422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:21:00.569422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 659/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:21:00.573909 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059f770-4cf5-40c6-b299-3b7d7befb1df None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:00.672198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059f770-4cf5-40c6-b299-3b7d7befb1df None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:00.704956 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d4144-eae5-4acb-aa38-ae68851eef3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:00.705553 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d4144-eae5-4acb-aa38-ae68851eef3f None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:00.705831 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d4144-eae5-4acb-aa38-ae68851eef3f None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:00.706100 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d4144-eae5-4acb-aa38-ae68851eef3f None admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:00.706728 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d4144-eae5-4acb-aa38-ae68851eef3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:21:00.707029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d4144-eae5-4acb-aa38-ae68851eef3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:00.708455 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d4144-eae5-4acb-aa38-ae68851eef3f None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:00.720105 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 620/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:21:00.725857 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acad2b-3b8b-461a-a37a-d6aaf8824e7e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:00.757147 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:21:00.826154 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acad2b-3b8b-461a-a37a-d6aaf8824e7e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:00.860218 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55787c3e-6512-4327-92e1-a93c14b88368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:00.860869 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55787c3e-6512-4327-92e1-a93c14b88368 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:00.861153 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55787c3e-6512-4327-92e1-a93c14b88368 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:00.861429 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55787c3e-6512-4327-92e1-a93c14b88368 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:00.869526 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55787c3e-6512-4327-92e1-a93c14b88368 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:00.870988 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55787c3e-6512-4327-92e1-a93c14b88368 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:00.882300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-55787c3e-6512-4327-92e1-a93c14b88368 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 16:21:00.882300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:21:00.882300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:21:00.882300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:21:00.882300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:21:00.882300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:21:00.882300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:21:00.882300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:21:00.882300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:21:00.882300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:21:00.882300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:21:00.882300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:21:00.882300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 16:21:00.882300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 16:21:00.882300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 16:21:00.882300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 16:21:00.883595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:21:00.883595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:21:00.883595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 16:21:00.883595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:21:00.883595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 16:21:00.883595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 16:21:00.883595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:21:00.883595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:21:00.883595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:21:00.883595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:21:00.883595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:21:00.883595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:21:00.883595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:21:00.883595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:21:00.883595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:21:00.883595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:21:00.883595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:21:00.883595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:21:00.884735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:21:00.884735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:21:00.884735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 16:21:00.884735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 16:21:00.884735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 16:21:00.884735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 16:21:00.884735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 16:21:00.884735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 16:21:00.884735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 16:21:00.884735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:21:00.884735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 660/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:21:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:21:00.889362 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d4144-eae5-4acb-aa38-ae68851eef3f None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:00.893159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:21:00.986667 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d4144-eae5-4acb-aa38-ae68851eef3f None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:01.021053 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c3cb5-1dcb-46ce-b535-f1d34bacf237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:01.021763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c3cb5-1dcb-46ce-b535-f1d34bacf237 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:01.022035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c3cb5-1dcb-46ce-b535-f1d34bacf237 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:01.022304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c3cb5-1dcb-46ce-b535-f1d34bacf237 None admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:01.023007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c3cb5-1dcb-46ce-b535-f1d34bacf237 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:21:01.023307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c3cb5-1dcb-46ce-b535-f1d34bacf237 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:01.025312 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c3cb5-1dcb-46ce-b535-f1d34bacf237 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:01.050433 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 621/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Sep 27 16:21:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:21:01.056325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55787c3e-6512-4327-92e1-a93c14b88368 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:01.145405 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:21:01.155400 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55787c3e-6512-4327-92e1-a93c14b88368 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:01.188077 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe4157-48a6-4ae4-bd01-57653dcf328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:01.188701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe4157-48a6-4ae4-bd01-57653dcf328f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:01.188979 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe4157-48a6-4ae4-bd01-57653dcf328f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:01.189252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe4157-48a6-4ae4-bd01-57653dcf328f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:01.270239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe4157-48a6-4ae4-bd01-57653dcf328f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:01.271611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe4157-48a6-4ae4-bd01-57653dcf328f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:01.357831 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:21:01.367905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 661/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 27 16:21:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 16:21:01.373880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c3cb5-1dcb-46ce-b535-f1d34bacf237 None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:01.435154 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:21:01.474852 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c3cb5-1dcb-46ce-b535-f1d34bacf237 None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:01.507652 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53131c3-f89d-4846-a95f-247e01b4ed5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:01.508277 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53131c3-f89d-4846-a95f-247e01b4ed5d None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:01.508583 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53131c3-f89d-4846-a95f-247e01b4ed5d None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:01.508853 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53131c3-f89d-4846-a95f-247e01b4ed5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:01.519041 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53131c3-f89d-4846-a95f-247e01b4ed5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:01.520574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53131c3-f89d-4846-a95f-247e01b4ed5d None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:01.539226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-c53131c3-f89d-4846-a95f-247e01b4ed5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:21:01.539226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:21:01.539226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:21:01.539226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:21:01.539226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:21:01.539226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:21:01.539226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:21:01.539226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:21:01.539226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:21:01.539226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:21:01.539226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:21:01.539226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:21:01.539226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 16:21:01.539226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 16:21:01.539226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 16:21:01.539226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 16:21:01.540404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:21:01.540404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:21:01.540404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:21:01.540404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:21:01.540404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:21:01.540404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:21:01.540404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:21:01.540404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:21:01.540404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:21:01.540404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:21:01.540404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:21:01.540404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:21:01.540404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:21:01.540404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:21:01.540404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:21:01.540404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:21:01.540404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 16:21:01.541444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 16:21:01.541444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 16:21:01.541444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:21:01.541444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 622/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:21:01.546421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe4157-48a6-4ae4-bd01-57653dcf328f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:01.643081 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe4157-48a6-4ae4-bd01-57653dcf328f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:01.676536 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1019194-e21e-4872-8a81-337789051571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:01.677130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1019194-e21e-4872-8a81-337789051571 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:01.677412 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1019194-e21e-4872-8a81-337789051571 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:01.677685 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1019194-e21e-4872-8a81-337789051571 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:01.678316 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1019194-e21e-4872-8a81-337789051571 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:21:01.678619 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1019194-e21e-4872-8a81-337789051571 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:01.679987 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1019194-e21e-4872-8a81-337789051571 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:01.690960 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 662/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 27 16:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:21:01.697222 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53131c3-f89d-4846-a95f-247e01b4ed5d None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:01.796693 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53131c3-f89d-4846-a95f-247e01b4ed5d None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:01.810543 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:21:01.830183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a25c6-0aac-4934-9ccb-679f41d3387a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:01.830805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a25c6-0aac-4934-9ccb-679f41d3387a None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:01.831083 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a25c6-0aac-4934-9ccb-679f41d3387a None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:01.831355 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a25c6-0aac-4934-9ccb-679f41d3387a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:01.837742 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a25c6-0aac-4934-9ccb-679f41d3387a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:01.842700 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a25c6-0aac-4934-9ccb-679f41d3387a None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:01.850407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application [None req-e11a25c6-0aac-4934-9ccb-679f41d3387a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:21:01.850407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:21:01.850407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:21:01.850407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:21:01.850407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:21:01.850407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:21:01.850407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:21:01.850407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:21:01.850407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:21:01.850407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:21:01.850407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:21:01.850407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:21:01.850407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 16:21:01.850407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 16:21:01.850407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 16:21:01.851497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 16:21:01.851497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:21:01.851497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:21:01.851497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:21:01.851497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:21:01.851497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:21:01.851497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:21:01.851497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:21:01.851497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application with Lock( Sep 27 16:21:01.851497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:21:01.851497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:21:01.851497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:21:01.851497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:21:01.851497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:21:01.851497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:21:01.851497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:21:01.851497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:21:01.852719 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 16:21:01.852719 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 16:21:01.852719 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 16:21:01.852719 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 16:21:01.852719 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 16:21:01.852719 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 16:21:01.852719 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 16:21:01.852719 dv-cinder-855060-2-smb devstack@keystone.service[81630]: ERROR keystone.server.flask.application Sep 27 16:21:01.852719 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 623/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 27 16:21:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:21:01.857474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1019194-e21e-4872-8a81-337789051571 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:01.906859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:21:01.955463 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1019194-e21e-4872-8a81-337789051571 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:01.986726 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638e030-c12f-43f0-907c-cd0df41d9d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:01.987319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638e030-c12f-43f0-907c-cd0df41d9d96 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:01.993950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638e030-c12f-43f0-907c-cd0df41d9d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:01.993950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638e030-c12f-43f0-907c-cd0df41d9d96 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:01.993950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638e030-c12f-43f0-907c-cd0df41d9d96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:21:01.993950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638e030-c12f-43f0-907c-cd0df41d9d96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:01.993950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638e030-c12f-43f0-907c-cd0df41d9d96 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:02.003176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 663/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 27 16:21:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:21:02.009967 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a25c6-0aac-4934-9ccb-679f41d3387a None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:02.108322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a25c6-0aac-4934-9ccb-679f41d3387a None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:02.142083 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97792fc-3e36-4775-a232-e2a69197a75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:02.142679 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97792fc-3e36-4775-a232-e2a69197a75c None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:02.142962 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97792fc-3e36-4775-a232-e2a69197a75c None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:02.143236 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97792fc-3e36-4775-a232-e2a69197a75c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:02.144004 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97792fc-3e36-4775-a232-e2a69197a75c None admin] RBAC: Adding query filter params (role.id=0a55cc35c9c84cd4969edd4038dc7724, scope.project.id=ad230723d90a439daf38443915c2282f, user.id=5deb7370bc3045c5be2d391d3b1dbd82) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:21:02.144313 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97792fc-3e36-4775-a232-e2a69197a75c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:02.145772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97792fc-3e36-4775-a232-e2a69197a75c None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:02.151702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 624/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 27 16:21:02 2022] GET /identity/v3/role_assignments?user.id=5deb7370bc3045c5be2d391d3b1dbd82&scope.project.id=ad230723d90a439daf38443915c2282f&role.id=0a55cc35c9c84cd4969edd4038dc7724 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:21:04.297302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b162d74-1bd7-4940-856f-62ddb160391b None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:04.297851 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b162d74-1bd7-4940-856f-62ddb160391b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:04.297851 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b162d74-1bd7-4940-856f-62ddb160391b None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:04.299168 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 664/1288] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:21:04.304302 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda132c6-064d-4a81-89e7-81abe7f5c8e2 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:04.304756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda132c6-064d-4a81-89e7-81abe7f5c8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:04.304893 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda132c6-064d-4a81-89e7-81abe7f5c8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:04.322881 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-dda132c6-064d-4a81-89e7-81abe7f5c8e2 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:21:04.324065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-dda132c6-064d-4a81-89e7-81abe7f5c8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:21:04.353382 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:21:04.388941 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 625/1289] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:21:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:21:04.655726 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b162d74-1bd7-4940-856f-62ddb160391b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:04.753992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b162d74-1bd7-4940-856f-62ddb160391b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:04.765278 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:21:04.787606 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ec541-23a0-449f-8ebb-0dee6f73b7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:04.788223 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ec541-23a0-449f-8ebb-0dee6f73b7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:04.788531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ec541-23a0-449f-8ebb-0dee6f73b7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:04.788804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ec541-23a0-449f-8ebb-0dee6f73b7f6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:04.789382 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ec541-23a0-449f-8ebb-0dee6f73b7f6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:04.790839 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ec541-23a0-449f-8ebb-0dee6f73b7f6 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:04.801097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-602ec541-23a0-449f-8ebb-0dee6f73b7f6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 16:21:04.801097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:21:04.801097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:21:04.801097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:21:04.801097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:21:04.801097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:21:04.801097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:21:04.801097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:21:04.801097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 16:21:04.801097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:21:04.801097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:21:04.801097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:21:04.801097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:21:04.801097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:21:04.801097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:21:04.801097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:21:04.801097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:21:04.802347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:21:04.802347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:21:04.802347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:21:04.802347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:21:04.802347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:21:04.802347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:21:04.802347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:21:04.802347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:21:04.802347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:21:04.802347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:21:04.802347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:21:04.802347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:21:04.802347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:21:04.802347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:21:04.802347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:21:04.802347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:21:04.803508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:21:04.803508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:21:04.803508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:21:04.803508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:21:04.803508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:21:04.803508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:21:04.803508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:21:04.803508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:21:04.803508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:21:04.803508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:21:04.803508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:21:04.803508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:21:04.803508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 16:21:04.803508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:21:04.803508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 665/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 27 16:21:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:21:04.807404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda132c6-064d-4a81-89e7-81abe7f5c8e2 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:04.905469 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda132c6-064d-4a81-89e7-81abe7f5c8e2 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:04.938717 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a9a7f-0589-4872-b68e-def0361d155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:04.939253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a9a7f-0589-4872-b68e-def0361d155b None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:04.939531 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a9a7f-0589-4872-b68e-def0361d155b None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:04.939804 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a9a7f-0589-4872-b68e-def0361d155b None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:04.940448 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a9a7f-0589-4872-b68e-def0361d155b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:21:04.940747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a9a7f-0589-4872-b68e-def0361d155b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:04.942162 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a9a7f-0589-4872-b68e-def0361d155b None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:04.947340 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 626/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Sep 27 16:21:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:21:04.953278 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ec541-23a0-449f-8ebb-0dee6f73b7f6 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:05.049760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ec541-23a0-449f-8ebb-0dee6f73b7f6 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:05.082152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c98c1-fdb9-4363-b09d-07c00917db4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:05.082742 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c98c1-fdb9-4363-b09d-07c00917db4a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:05.083014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c98c1-fdb9-4363-b09d-07c00917db4a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:05.083281 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c98c1-fdb9-4363-b09d-07c00917db4a None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:05.083940 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c98c1-fdb9-4363-b09d-07c00917db4a None admin] RBAC: Adding query filter params (type=placement) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:21:05.084242 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c98c1-fdb9-4363-b09d-07c00917db4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:05.085614 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c98c1-fdb9-4363-b09d-07c00917db4a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:05.090067 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 666/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Sep 27 16:21:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:21:07.216867 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77699e8e-bf78-44bd-8f6a-112cd14337db None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:07.217401 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77699e8e-bf78-44bd-8f6a-112cd14337db None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:07.217401 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77699e8e-bf78-44bd-8f6a-112cd14337db None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:07.218679 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 627/1293] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:21:07.223849 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11b935-c30b-458f-a307-a6a7c85402df None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:07.224279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11b935-c30b-458f-a307-a6a7c85402df None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:07.224431 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11b935-c30b-458f-a307-a6a7c85402df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:07.242800 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3c11b935-c30b-458f-a307-a6a7c85402df None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:21:07.244529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3c11b935-c30b-458f-a307-a6a7c85402df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:21:07.282727 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:21:07.319234 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 667/1294] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:21:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:21:07.587369 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77699e8e-bf78-44bd-8f6a-112cd14337db None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:07.618237 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:21:07.687898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77699e8e-bf78-44bd-8f6a-112cd14337db None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:07.720827 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59c27b-3e41-446e-8a52-0f97a5ed2138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:07.721424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59c27b-3e41-446e-8a52-0f97a5ed2138 None admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:07.721713 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59c27b-3e41-446e-8a52-0f97a5ed2138 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:07.721987 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59c27b-3e41-446e-8a52-0f97a5ed2138 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:07.722625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59c27b-3e41-446e-8a52-0f97a5ed2138 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:07.724024 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59c27b-3e41-446e-8a52-0f97a5ed2138 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:07.811403 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 628/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 27 16:21:07 2022] POST /identity/v3/services => generated 246 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:21:09.960348 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d93269-88e5-4521-b82e-27909d1694a3 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:09.960902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d93269-88e5-4521-b82e-27909d1694a3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:09.960902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d93269-88e5-4521-b82e-27909d1694a3 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:09.962260 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 668/1296] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:21:09.967450 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4722bef-0dc5-43a2-882b-cd7edba33d38 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:09.967883 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4722bef-0dc5-43a2-882b-cd7edba33d38 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:09.968005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4722bef-0dc5-43a2-882b-cd7edba33d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:09.986445 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-a4722bef-0dc5-43a2-882b-cd7edba33d38 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:21:09.987657 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a4722bef-0dc5-43a2-882b-cd7edba33d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:21:10.059008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 629/1297] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:21:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:21:10.327597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d93269-88e5-4521-b82e-27909d1694a3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:10.426293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d93269-88e5-4521-b82e-27909d1694a3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:10.458939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0acf3-758f-49d3-bb1f-d3c1700e50da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:10.459555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0acf3-758f-49d3-bb1f-d3c1700e50da None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:10.459833 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0acf3-758f-49d3-bb1f-d3c1700e50da None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:10.460103 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0acf3-758f-49d3-bb1f-d3c1700e50da None admin] PATH_INFO: `/v3/services/placement` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:10.460716 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0acf3-758f-49d3-bb1f-d3c1700e50da None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:10.462705 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0acf3-758f-49d3-bb1f-d3c1700e50da None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:10.471297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-bde0acf3-758f-49d3-bb1f-d3c1700e50da None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 16:21:10.471297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:21:10.471297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:21:10.471297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:21:10.471297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:21:10.471297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:21:10.471297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:21:10.471297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:21:10.471297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 16:21:10.471297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:21:10.471297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:21:10.471297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:21:10.471297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:21:10.471297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:21:10.471297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:21:10.471297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:21:10.471297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:21:10.472522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:21:10.472522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:21:10.472522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:21:10.472522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:21:10.472522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:21:10.472522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:21:10.472522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:21:10.472522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:21:10.472522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:21:10.472522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:21:10.472522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:21:10.472522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:21:10.472522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:21:10.472522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:21:10.472522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:21:10.472522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:21:10.473553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:21:10.473553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:21:10.473553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:21:10.473553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:21:10.473553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:21:10.473553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:21:10.473553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:21:10.473553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:21:10.473553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:21:10.473553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:21:10.473553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:21:10.473553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:21:10.473553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 16:21:10.473553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:21:10.473553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 669/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 27 16:21:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:21:10.478408 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4722bef-0dc5-43a2-882b-cd7edba33d38 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:10.496528 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:21:10.574453 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4722bef-0dc5-43a2-882b-cd7edba33d38 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:10.607586 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66269eb5-f52f-40e9-b3d7-50f4a7326b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:10.608129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66269eb5-f52f-40e9-b3d7-50f4a7326b4c None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:10.608434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66269eb5-f52f-40e9-b3d7-50f4a7326b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:10.608710 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66269eb5-f52f-40e9-b3d7-50f4a7326b4c None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:10.609333 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66269eb5-f52f-40e9-b3d7-50f4a7326b4c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:21:10.609629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66269eb5-f52f-40e9-b3d7-50f4a7326b4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:10.610983 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66269eb5-f52f-40e9-b3d7-50f4a7326b4c None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:10.615960 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 630/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Sep 27 16:21:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:21:10.622000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0acf3-758f-49d3-bb1f-d3c1700e50da None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:10.653992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:21:10.719565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0acf3-758f-49d3-bb1f-d3c1700e50da None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:10.751989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255bd18-4649-4588-a672-219e4b2f9ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:10.752602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255bd18-4649-4588-a672-219e4b2f9ebe None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:10.752880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255bd18-4649-4588-a672-219e4b2f9ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:10.753150 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255bd18-4649-4588-a672-219e4b2f9ebe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:10.753829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255bd18-4649-4588-a672-219e4b2f9ebe None admin] RBAC: Adding query filter params (interface=public, service_id=7cf919cd29124bbebad157b46daee4a6, region_id=RegionOne) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:21:10.754131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255bd18-4649-4588-a672-219e4b2f9ebe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:10.755481 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255bd18-4649-4588-a672-219e4b2f9ebe None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:10.760958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 670/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Sep 27 16:21:10 2022] GET /identity/v3/endpoints?service_id=7cf919cd29124bbebad157b46daee4a6&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:21:10.766708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66269eb5-f52f-40e9-b3d7-50f4a7326b4c None admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:10.847258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:21:10.864389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66269eb5-f52f-40e9-b3d7-50f4a7326b4c None admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:10.897010 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800db565-8e2b-4e1a-9fe2-f70b4fb62763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:10.897603 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800db565-8e2b-4e1a-9fe2-f70b4fb62763 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:10.897877 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800db565-8e2b-4e1a-9fe2-f70b4fb62763 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:10.898146 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800db565-8e2b-4e1a-9fe2-f70b4fb62763 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:10.898731 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800db565-8e2b-4e1a-9fe2-f70b4fb62763 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:10.900111 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800db565-8e2b-4e1a-9fe2-f70b4fb62763 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:10.906589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 631/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Sep 27 16:21:10 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:21:13.016695 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438add6a-bbfb-4971-af31-950833c36bd2 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:13.017246 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438add6a-bbfb-4971-af31-950833c36bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:13.017246 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438add6a-bbfb-4971-af31-950833c36bd2 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:13.018564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 671/1302] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:21:13.023647 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a6445-8587-4db4-afb4-0ff227f9bf09 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:13.024066 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a6445-8587-4db4-afb4-0ff227f9bf09 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:13.024230 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a6445-8587-4db4-afb4-0ff227f9bf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:13.043104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-025a6445-8587-4db4-afb4-0ff227f9bf09 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:21:13.044284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-025a6445-8587-4db4-afb4-0ff227f9bf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:21:13.109056 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 632/1303] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:21:13 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 16:21:13.373942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438add6a-bbfb-4971-af31-950833c36bd2 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:13.465873 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:21:13.472066 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438add6a-bbfb-4971-af31-950833c36bd2 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:13.505055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a1b5a-eb3f-463a-bed3-c8a303398894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:13.505671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a1b5a-eb3f-463a-bed3-c8a303398894 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:13.505960 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a1b5a-eb3f-463a-bed3-c8a303398894 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:13.506216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a1b5a-eb3f-463a-bed3-c8a303398894 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:13.506783 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a1b5a-eb3f-463a-bed3-c8a303398894 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:13.508136 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a1b5a-eb3f-463a-bed3-c8a303398894 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:13.517133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-da7a1b5a-eb3f-463a-bed3-c8a303398894 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 16:21:13.517133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:21:13.517133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 16:21:13.517133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 16:21:13.517133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 16:21:13.517133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 16:21:13.517133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 16:21:13.517133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:21:13.517133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 16:21:13.517133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:21:13.517133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 16:21:13.517133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:21:13.517133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 16:21:13.517133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 16:21:13.517133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 16:21:13.517133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 16:21:13.517133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 16:21:13.522380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 16:21:13.522380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 16:21:13.522380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 16:21:13.522380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 16:21:13.522380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 16:21:13.522380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 16:21:13.522380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 16:21:13.522380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 16:21:13.522380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 16:21:13.522380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 16:21:13.522380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 16:21:13.522380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 16:21:13.522380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 16:21:13.522380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 16:21:13.522380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 16:21:13.522380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 16:21:13.523537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 16:21:13.523537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Sep 27 16:21:13.523537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 16:21:13.523537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Sep 27 16:21:13.523537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 16:21:13.523537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 16:21:13.523537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 16:21:13.523537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Sep 27 16:21:13.523537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 16:21:13.523537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Sep 27 16:21:13.523537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 16:21:13.523537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 16:21:13.523537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 16:21:13.523537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Sep 27 16:21:13.523537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 672/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 27 16:21:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 16:21:13.524616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a6445-8587-4db4-afb4-0ff227f9bf09 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:13.599080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:21:13.622441 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a6445-8587-4db4-afb4-0ff227f9bf09 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:13.655098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d4457-e05e-4afd-9885-30fe4d857036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:13.655664 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d4457-e05e-4afd-9885-30fe4d857036 None admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:13.655951 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d4457-e05e-4afd-9885-30fe4d857036 None admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:13.656227 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d4457-e05e-4afd-9885-30fe4d857036 None admin] PATH_INFO: `/v3/services` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:13.656881 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d4457-e05e-4afd-9885-30fe4d857036 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:21:13.657187 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d4457-e05e-4afd-9885-30fe4d857036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:13.658551 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d4457-e05e-4afd-9885-30fe4d857036 None admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:13.663786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 633/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Sep 27 16:21:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:21:13.669875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a1b5a-eb3f-463a-bed3-c8a303398894 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:21:13.766717 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a1b5a-eb3f-463a-bed3-c8a303398894 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:21:13.800113 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e843f33-6faa-4c3a-a9d7-e8d5bab7b575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:21:13.800736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e843f33-6faa-4c3a-a9d7-e8d5bab7b575 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:21:13.801031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e843f33-6faa-4c3a-a9d7-e8d5bab7b575 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:21:13.801280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e843f33-6faa-4c3a-a9d7-e8d5bab7b575 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:21:13.801938 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e843f33-6faa-4c3a-a9d7-e8d5bab7b575 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:21:13.803299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e843f33-6faa-4c3a-a9d7-e8d5bab7b575 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:21:13.908455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 673/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:21:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:21:23.660723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=30 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:21:23.904039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:16.837694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8174cb-b09d-4040-8b5f-0e3d1c992bc8 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:16.839129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8174cb-b09d-4040-8b5f-0e3d1c992bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:16.840082 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8174cb-b09d-4040-8b5f-0e3d1c992bc8 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:16.844739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 634/1307] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:28:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:28:16.849713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e99cb-3fa6-4179-b53d-3a2112da4c66 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:16.850378 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e99cb-3fa6-4179-b53d-3a2112da4c66 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:16.850378 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e99cb-3fa6-4179-b53d-3a2112da4c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:16.978699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-568e99cb-3fa6-4179-b53d-3a2112da4c66 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:28:16.980512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-568e99cb-3fa6-4179-b53d-3a2112da4c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:17.136436 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 674/1308] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:28:17.422836 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0523bd-36ab-4b77-84eb-461e53120ad1 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:17.423660 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0523bd-36ab-4b77-84eb-461e53120ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:17.423942 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0523bd-36ab-4b77-84eb-461e53120ad1 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:17.425353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 635/1309] 10.222.0.26 () {54 vars in 964 bytes} [Tue Sep 27 16:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:28:17.432362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d6339-d2ab-4b5d-a7b7-db288adbd8dd None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:17.432816 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d6339-d2ab-4b5d-a7b7-db288adbd8dd None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:17.433347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d6339-d2ab-4b5d-a7b7-db288adbd8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:17.536808 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-123d6339-d2ab-4b5d-a7b7-db288adbd8dd None None] MFA Rules not processed for user `758380280e33458f8f9112147d5a7819`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:28:17.538448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-123d6339-d2ab-4b5d-a7b7-db288adbd8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:17.567002 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:17.644754 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 675/1310] 10.222.0.26 () {58 vars in 1061 bytes} [Tue Sep 27 16:28:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:28:17.655363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0523bd-36ab-4b77-84eb-461e53120ad1 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:28:17.657089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-5e0523bd-36ab-4b77-84eb-461e53120ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:17.791644 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0523bd-36ab-4b77-84eb-461e53120ad1 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:28:17.883494 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace1605-22f9-46bf-95c5-915d586a8dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:28:17.885026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace1605-22f9-46bf-95c5-915d586a8dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:17.885532 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace1605-22f9-46bf-95c5-915d586a8dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:17.886021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace1605-22f9-46bf-95c5-915d586a8dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:17.888392 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4ace1605-22f9-46bf-95c5-915d586a8dd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:17.965148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:18.032812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace1605-22f9-46bf-95c5-915d586a8dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:28:18.034616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace1605-22f9-46bf-95c5-915d586a8dd0 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:28:18.058123 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 636/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:28:20.564632 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f0eb6-93e5-4190-903e-66889dba7056 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:20.565185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f0eb6-93e5-4190-903e-66889dba7056 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:20.565185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f0eb6-93e5-4190-903e-66889dba7056 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:20.566537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 676/1312] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:28:20.572613 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53446d9-a662-4d68-a9db-cc042ac26b88 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:20.573065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53446d9-a662-4d68-a9db-cc042ac26b88 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:20.573186 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53446d9-a662-4d68-a9db-cc042ac26b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:20.642601 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-a53446d9-a662-4d68-a9db-cc042ac26b88 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:28:20.643820 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a53446d9-a662-4d68-a9db-cc042ac26b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:20.738013 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 637/1313] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:28:21.022099 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f0eb6-93e5-4190-903e-66889dba7056 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:28:21.024186 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a75f0eb6-93e5-4190-903e-66889dba7056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:21.126345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f0eb6-93e5-4190-903e-66889dba7056 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:28:21.197749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:21.200026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a53bc2-823c-4059-96b4-c8e64ce7c8e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:28:21.200655 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a53bc2-823c-4059-96b4-c8e64ce7c8e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:21.200933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a53bc2-823c-4059-96b4-c8e64ce7c8e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:21.201205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a53bc2-823c-4059-96b4-c8e64ce7c8e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:21.202794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-12a53bc2-823c-4059-96b4-c8e64ce7c8e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:21.309497 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a53bc2-823c-4059-96b4-c8e64ce7c8e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:28:21.310837 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a53bc2-823c-4059-96b4-c8e64ce7c8e5 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:28:21.329815 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 677/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:28:23.991417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96db668-f248-4425-8f82-a5616915fe86 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:23.991980 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96db668-f248-4425-8f82-a5616915fe86 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:23.991980 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96db668-f248-4425-8f82-a5616915fe86 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:23.993346 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 638/1315] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:28:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:28:23.998749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189ad45-e914-4050-bac0-8b56a57037f3 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:23.999190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189ad45-e914-4050-bac0-8b56a57037f3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:23.999290 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189ad45-e914-4050-bac0-8b56a57037f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:24.064719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1189ad45-e914-4050-bac0-8b56a57037f3 None None] MFA Rules not processed for user `3e16364861b54675955ca4da10f6c281`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:28:24.065841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1189ad45-e914-4050-bac0-8b56a57037f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:24.121315 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:24.174480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 678/1316] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:28:23 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:28:24.462015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96db668-f248-4425-8f82-a5616915fe86 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:28:24.463550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-d96db668-f248-4425-8f82-a5616915fe86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:24.473233 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:24.564529 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96db668-f248-4425-8f82-a5616915fe86 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:28:24.636294 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652304f4-91c3-431b-8aca-eea164af10e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:28:24.636854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652304f4-91c3-431b-8aca-eea164af10e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:24.637135 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652304f4-91c3-431b-8aca-eea164af10e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:24.637408 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652304f4-91c3-431b-8aca-eea164af10e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:24.638966 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-652304f4-91c3-431b-8aca-eea164af10e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:24.700511 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:24.747235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652304f4-91c3-431b-8aca-eea164af10e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:28:24.748699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652304f4-91c3-431b-8aca-eea164af10e2 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:28:24.766229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 639/1317] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:28:24 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:28:27.830068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd526d17-d8ec-4585-af76-a6ea821272e2 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:27.830562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd526d17-d8ec-4585-af76-a6ea821272e2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:27.830653 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd526d17-d8ec-4585-af76-a6ea821272e2 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:27.831961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 679/1318] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:28:27.837821 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e797-3c19-4d42-97f0-d5b8a78e7e59 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:27.838223 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e797-3c19-4d42-97f0-d5b8a78e7e59 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:27.838473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e797-3c19-4d42-97f0-d5b8a78e7e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:27.903158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-fdd3e797-3c19-4d42-97f0-d5b8a78e7e59 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:28:27.904406 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-fdd3e797-3c19-4d42-97f0-d5b8a78e7e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:27.999179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 640/1319] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:28:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:28:28.297747 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744132f-c896-414c-82ae-6c544507baf4 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:28.298290 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744132f-c896-414c-82ae-6c544507baf4 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:28.298566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744132f-c896-414c-82ae-6c544507baf4 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:28.300003 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 680/1320] 10.222.0.26 () {54 vars in 964 bytes} [Tue Sep 27 16:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:28:28.306050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8e262-8aca-4343-b139-c45e0ae5f911 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:28.306330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8e262-8aca-4343-b139-c45e0ae5f911 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:28.306601 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8e262-8aca-4343-b139-c45e0ae5f911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:28.329145 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:28.382190 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-37d8e262-8aca-4343-b139-c45e0ae5f911 None None] MFA Rules not processed for user `758380280e33458f8f9112147d5a7819`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:28:28.383714 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-37d8e262-8aca-4343-b139-c45e0ae5f911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:28.458054 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 641/1321] 10.222.0.26 () {58 vars in 1061 bytes} [Tue Sep 27 16:28:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:28:28.467848 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744132f-c896-414c-82ae-6c544507baf4 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:28:28.469406 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1744132f-c896-414c-82ae-6c544507baf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:28.570587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744132f-c896-414c-82ae-6c544507baf4 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:28:28.641198 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0012b67-be52-4bd3-a126-9623ebcd5c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:28:28.641787 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0012b67-be52-4bd3-a126-9623ebcd5c8d service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:28.642060 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0012b67-be52-4bd3-a126-9623ebcd5c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:28.642325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0012b67-be52-4bd3-a126-9623ebcd5c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:28.643895 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f0012b67-be52-4bd3-a126-9623ebcd5c8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:28.650631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:28.750782 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0012b67-be52-4bd3-a126-9623ebcd5c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:28:28.752206 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0012b67-be52-4bd3-a126-9623ebcd5c8d service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:28:28.770742 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 681/1322] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:28:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:28:32.550894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e5382-7aac-4607-bb2b-30d00e05128e None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:32.551432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e5382-7aac-4607-bb2b-30d00e05128e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:32.551432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e5382-7aac-4607-bb2b-30d00e05128e None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:32.552831 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 642/1323] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:28:32.559089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14a6a1-44aa-48af-8c96-37ac20159f5e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:32.559595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14a6a1-44aa-48af-8c96-37ac20159f5e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:32.559711 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14a6a1-44aa-48af-8c96-37ac20159f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:32.632486 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ce14a6a1-44aa-48af-8c96-37ac20159f5e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:28:32.633659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ce14a6a1-44aa-48af-8c96-37ac20159f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:32.694697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:32.735267 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 682/1324] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:28:33.013544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e5382-7aac-4607-bb2b-30d00e05128e None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:28:33.015117 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-502e5382-7aac-4607-bb2b-30d00e05128e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:33.120850 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e5382-7aac-4607-bb2b-30d00e05128e None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:28:33.133742 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:33.195679 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd07d4-875a-45d0-9d50-ec58cc4477cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:28:33.196284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd07d4-875a-45d0-9d50-ec58cc4477cb service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:33.196591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd07d4-875a-45d0-9d50-ec58cc4477cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:33.196863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd07d4-875a-45d0-9d50-ec58cc4477cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:33.198441 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-efbd07d4-875a-45d0-9d50-ec58cc4477cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:33.309945 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd07d4-875a-45d0-9d50-ec58cc4477cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:28:33.311461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd07d4-875a-45d0-9d50-ec58cc4477cb service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:28:33.329786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 643/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:28:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:28:35.539797 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c4c93-2fc9-4f60-b16e-d64ddf18d10e None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:35.540371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c4c93-2fc9-4f60-b16e-d64ddf18d10e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:35.540371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c4c93-2fc9-4f60-b16e-d64ddf18d10e None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:35.541717 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 683/1326] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:28:35.547100 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbab75-e71d-440b-b446-6ff5525fe481 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:35.547544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbab75-e71d-440b-b446-6ff5525fe481 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:35.547806 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbab75-e71d-440b-b446-6ff5525fe481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:35.602826 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:35.622050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-a7fbab75-e71d-440b-b446-6ff5525fe481 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:28:35.622050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a7fbab75-e71d-440b-b446-6ff5525fe481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:35.719313 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 644/1327] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:28:36.001240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c4c93-2fc9-4f60-b16e-d64ddf18d10e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:28:36.002849 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2a4c4c93-2fc9-4f60-b16e-d64ddf18d10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:36.106485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c4c93-2fc9-4f60-b16e-d64ddf18d10e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:28:36.179957 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc49070-2e0b-4498-92e9-a658f09c6cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:28:36.180607 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc49070-2e0b-4498-92e9-a658f09c6cdd service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:36.180891 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc49070-2e0b-4498-92e9-a658f09c6cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:36.181163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc49070-2e0b-4498-92e9-a658f09c6cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:36.182762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-dbc49070-2e0b-4498-92e9-a658f09c6cdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:36.200077 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:36.295122 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc49070-2e0b-4498-92e9-a658f09c6cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:28:36.296505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc49070-2e0b-4498-92e9-a658f09c6cdd service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:28:36.314917 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 684/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:28:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:28:38.556788 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e9e98-cc28-4044-aea4-6ce69ccc6698 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:38.557282 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e9e98-cc28-4044-aea4-6ce69ccc6698 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:38.557366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e9e98-cc28-4044-aea4-6ce69ccc6698 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:38.558764 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 645/1329] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:28:38.564583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab67ee-e9b8-4859-b39b-5afb2edcdfdf None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:38.565158 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab67ee-e9b8-4859-b39b-5afb2edcdfdf None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:38.565418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab67ee-e9b8-4859-b39b-5afb2edcdfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:38.635572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-54ab67ee-e9b8-4859-b39b-5afb2edcdfdf None None] MFA Rules not processed for user `3e16364861b54675955ca4da10f6c281`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:28:38.636835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-54ab67ee-e9b8-4859-b39b-5afb2edcdfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:38.704212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:38.736575 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 685/1330] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:28:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:28:39.025153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e9e98-cc28-4044-aea4-6ce69ccc6698 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:28:39.026706 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-285e9e98-cc28-4044-aea4-6ce69ccc6698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:39.132384 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e9e98-cc28-4044-aea4-6ce69ccc6698 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:28:39.154703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:39.210320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52353e-7983-4a45-9a63-75508f21692c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:28:39.210934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52353e-7983-4a45-9a63-75508f21692c service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:39.211213 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52353e-7983-4a45-9a63-75508f21692c service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:39.211488 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52353e-7983-4a45-9a63-75508f21692c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:39.213117 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ba52353e-7983-4a45-9a63-75508f21692c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:39.323232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52353e-7983-4a45-9a63-75508f21692c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:28:39.324632 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52353e-7983-4a45-9a63-75508f21692c service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:28:39.342864 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 646/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:28:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:28:41.996343 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82e637-3154-4671-bbfd-ec5a1a99df6b None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:41.996929 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82e637-3154-4671-bbfd-ec5a1a99df6b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:41.996929 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82e637-3154-4671-bbfd-ec5a1a99df6b None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:41.998259 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 686/1332] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:28:42.003447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6066f2-3a5f-442d-96f1-bb2be0b52ff1 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:42.003876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6066f2-3a5f-442d-96f1-bb2be0b52ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:42.003980 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6066f2-3a5f-442d-96f1-bb2be0b52ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:42.066448 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:42.069540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-2f6066f2-3a5f-442d-96f1-bb2be0b52ff1 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:28:42.070733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-2f6066f2-3a5f-442d-96f1-bb2be0b52ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:42.165482 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 647/1333] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:28:42.443234 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82e637-3154-4671-bbfd-ec5a1a99df6b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:28:42.445339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7e82e637-3154-4671-bbfd-ec5a1a99df6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:42.546699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82e637-3154-4671-bbfd-ec5a1a99df6b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:28:42.618542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71b4bc-020a-4d30-b88f-5968926608d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:28:42.619079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71b4bc-020a-4d30-b88f-5968926608d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:42.619360 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71b4bc-020a-4d30-b88f-5968926608d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:42.619633 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71b4bc-020a-4d30-b88f-5968926608d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:42.621235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6c71b4bc-020a-4d30-b88f-5968926608d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:42.648182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:42.727660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71b4bc-020a-4d30-b88f-5968926608d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:28:42.729108 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71b4bc-020a-4d30-b88f-5968926608d0 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:28:42.747567 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 687/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:28:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:28:44.955222 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14844e-7f94-4b6d-b3db-3c657a12dfcf None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:44.955771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14844e-7f94-4b6d-b3db-3c657a12dfcf None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:44.955771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14844e-7f94-4b6d-b3db-3c657a12dfcf None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:44.957144 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 648/1335] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:28:44.963044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf7b33-6449-40dc-884d-d8292630aa2b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:44.963495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf7b33-6449-40dc-884d-d8292630aa2b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:44.963599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf7b33-6449-40dc-884d-d8292630aa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:45.029003 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-5adf7b33-6449-40dc-884d-d8292630aa2b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:28:45.030198 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5adf7b33-6449-40dc-884d-d8292630aa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:45.104058 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:45.125731 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 688/1336] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:28:45.413909 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14844e-7f94-4b6d-b3db-3c657a12dfcf None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:28:45.415483 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3d14844e-7f94-4b6d-b3db-3c657a12dfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:45.515377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14844e-7f94-4b6d-b3db-3c657a12dfcf None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:28:45.543223 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:45.588007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214823cb-08dc-4d27-b23f-ee9bd5f5fdae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:28:45.588632 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214823cb-08dc-4d27-b23f-ee9bd5f5fdae service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:45.588933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214823cb-08dc-4d27-b23f-ee9bd5f5fdae service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:45.589197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214823cb-08dc-4d27-b23f-ee9bd5f5fdae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:45.590779 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-214823cb-08dc-4d27-b23f-ee9bd5f5fdae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:45.698784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214823cb-08dc-4d27-b23f-ee9bd5f5fdae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:28:45.700127 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214823cb-08dc-4d27-b23f-ee9bd5f5fdae service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:28:45.717409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 649/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:28:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:28:48.536764 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774acd2b-9182-4e7e-84d0-4d520cb4ed55 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:48.537235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774acd2b-9182-4e7e-84d0-4d520cb4ed55 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:48.537332 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774acd2b-9182-4e7e-84d0-4d520cb4ed55 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:48.538730 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 689/1338] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:28:48.544076 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50131417-9793-4a02-bc02-a7f7122f2f23 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:48.544552 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50131417-9793-4a02-bc02-a7f7122f2f23 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:48.544741 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50131417-9793-4a02-bc02-a7f7122f2f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:48.611394 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-50131417-9793-4a02-bc02-a7f7122f2f23 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:28:48.612540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-50131417-9793-4a02-bc02-a7f7122f2f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:48.620660 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:48.707405 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 650/1339] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:28:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:28:48.988544 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774acd2b-9182-4e7e-84d0-4d520cb4ed55 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:28:48.990590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-774acd2b-9182-4e7e-84d0-4d520cb4ed55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:49.092209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774acd2b-9182-4e7e-84d0-4d520cb4ed55 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:28:49.164837 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e447019-a892-48d0-b6c2-e546899d7e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:28:49.165439 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e447019-a892-48d0-b6c2-e546899d7e81 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:49.165717 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e447019-a892-48d0-b6c2-e546899d7e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:49.165987 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e447019-a892-48d0-b6c2-e546899d7e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:49.167645 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7e447019-a892-48d0-b6c2-e546899d7e81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:49.203069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:49.274914 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e447019-a892-48d0-b6c2-e546899d7e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:28:49.276260 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e447019-a892-48d0-b6c2-e546899d7e81 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:28:49.294872 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 690/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:28:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:28:53.725629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9801666-1e31-4371-874b-3cfa6892eb82 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:53.726122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9801666-1e31-4371-874b-3cfa6892eb82 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:53.726239 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9801666-1e31-4371-874b-3cfa6892eb82 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:53.727917 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 651/1341] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:28:53.732908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf1219-92b5-490f-981d-3015fcd8333f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:53.733338 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf1219-92b5-490f-981d-3015fcd8333f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:53.733453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf1219-92b5-490f-981d-3015fcd8333f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:53.801713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3acf1219-92b5-490f-981d-3015fcd8333f None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:28:53.802968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3acf1219-92b5-490f-981d-3015fcd8333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:53.898110 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:53.909407 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 691/1342] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:28:54.195000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9801666-1e31-4371-874b-3cfa6892eb82 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:28:54.196606 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-e9801666-1e31-4371-874b-3cfa6892eb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:54.305710 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9801666-1e31-4371-874b-3cfa6892eb82 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:28:54.343678 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:54.381458 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb750d1-df9f-4da9-8690-6e4529d06495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:28:54.382067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb750d1-df9f-4da9-8690-6e4529d06495 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:54.382345 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb750d1-df9f-4da9-8690-6e4529d06495 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:54.382616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb750d1-df9f-4da9-8690-6e4529d06495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:54.384259 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-7eb750d1-df9f-4da9-8690-6e4529d06495 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:54.497537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb750d1-df9f-4da9-8690-6e4529d06495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:28:54.498983 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb750d1-df9f-4da9-8690-6e4529d06495 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:28:54.518021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 652/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:28:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:28:57.684115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc7d7d-e3ed-4ad4-bc73-63ebbdaa8df9 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:57.684716 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc7d7d-e3ed-4ad4-bc73-63ebbdaa8df9 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:57.684716 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc7d7d-e3ed-4ad4-bc73-63ebbdaa8df9 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:57.686076 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 692/1344] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:28:57.691409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f890d0-da5f-42ba-9cf9-ef626398c043 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:57.691849 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f890d0-da5f-42ba-9cf9-ef626398c043 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:57.691956 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f890d0-da5f-42ba-9cf9-ef626398c043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:57.760487 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-69f890d0-da5f-42ba-9cf9-ef626398c043 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:28:57.761792 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-69f890d0-da5f-42ba-9cf9-ef626398c043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:57.780880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:57.867899 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 653/1345] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:28:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:28:58.163201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc7d7d-e3ed-4ad4-bc73-63ebbdaa8df9 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:28:58.163201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-17dc7d7d-e3ed-4ad4-bc73-63ebbdaa8df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:58.275665 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc7d7d-e3ed-4ad4-bc73-63ebbdaa8df9 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:28:58.352422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cd6e4-33bb-42c6-9afd-cd0c19e5a288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:28:58.353180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cd6e4-33bb-42c6-9afd-cd0c19e5a288 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:28:58.353180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cd6e4-33bb-42c6-9afd-cd0c19e5a288 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:28:58.353511 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cd6e4-33bb-42c6-9afd-cd0c19e5a288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:28:58.354995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-640cd6e4-33bb-42c6-9afd-cd0c19e5a288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:28:58.399269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:58.464494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cd6e4-33bb-42c6-9afd-cd0c19e5a288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:28:58.465918 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cd6e4-33bb-42c6-9afd-cd0c19e5a288 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:28:58.485065 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 693/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:28:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:03.114452 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdb6f1-b4cb-451d-a6aa-5c186838f1fe None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:03.114924 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdb6f1-b4cb-451d-a6aa-5c186838f1fe None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:03.115019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdb6f1-b4cb-451d-a6aa-5c186838f1fe None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:03.116966 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 654/1347] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:29:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:03.122962 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045f0ab-3d4c-4c39-a5f6-d8786649cd2e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:03.123494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045f0ab-3d4c-4c39-a5f6-d8786649cd2e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:03.123494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045f0ab-3d4c-4c39-a5f6-d8786649cd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:03.192058 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9045f0ab-3d4c-4c39-a5f6-d8786649cd2e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:03.193348 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9045f0ab-3d4c-4c39-a5f6-d8786649cd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:03.293224 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:03.296459 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 694/1348] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:03.583207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdb6f1-b4cb-451d-a6aa-5c186838f1fe None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:29:03.585411 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4ffdb6f1-b4cb-451d-a6aa-5c186838f1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:03.693924 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdb6f1-b4cb-451d-a6aa-5c186838f1fe None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:29:03.741563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:03.766922 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684c0e7-a928-418f-a1fc-7eddfaf434d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:29:03.767531 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684c0e7-a928-418f-a1fc-7eddfaf434d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:03.767818 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684c0e7-a928-418f-a1fc-7eddfaf434d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:03.768088 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684c0e7-a928-418f-a1fc-7eddfaf434d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:03.769710 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-1684c0e7-a928-418f-a1fc-7eddfaf434d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:03.882387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684c0e7-a928-418f-a1fc-7eddfaf434d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:29:03.883730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684c0e7-a928-418f-a1fc-7eddfaf434d9 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:29:03.902216 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 655/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:08.952603 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e858533-7320-425c-9880-c9a4ce633f01 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:08.953123 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e858533-7320-425c-9880-c9a4ce633f01 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:08.953123 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e858533-7320-425c-9880-c9a4ce633f01 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:08.954743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 695/1350] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 27 16:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:08.959842 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea820133-510e-41a9-ab83-db0c967f673d None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:08.960215 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea820133-510e-41a9-ab83-db0c967f673d None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:08.960479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea820133-510e-41a9-ab83-db0c967f673d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:09.064541 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-ea820133-510e-41a9-ab83-db0c967f673d None None] MFA Rules not processed for user `5deb7370bc3045c5be2d391d3b1dbd82`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:09.066961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ea820133-510e-41a9-ab83-db0c967f673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:09.096586 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:09.228944 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 656/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 27 16:29:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:13.366285 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c711912-eaa3-462f-9a88-989b972ec54b None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:13.366907 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c711912-eaa3-462f-9a88-989b972ec54b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:13.366907 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c711912-eaa3-462f-9a88-989b972ec54b None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:13.368529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 696/1352] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 27 16:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:13.373703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e066c-9a46-4fa1-b53e-e5265365d44b None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:13.374576 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e066c-9a46-4fa1-b53e-e5265365d44b None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:13.375081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e066c-9a46-4fa1-b53e-e5265365d44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:13.466711 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-921e066c-9a46-4fa1-b53e-e5265365d44b None None] MFA Rules not processed for user `5deb7370bc3045c5be2d391d3b1dbd82`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:13.468442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-921e066c-9a46-4fa1-b53e-e5265365d44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:13.556756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:13.611483 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 657/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 27 16:29:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:15.073355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023aef8-66c6-407d-b1f3-2041076f8519 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:15.073892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023aef8-66c6-407d-b1f3-2041076f8519 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:15.073892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023aef8-66c6-407d-b1f3-2041076f8519 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:15.075139 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 697/1354] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 27 16:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:15.080061 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ef167-0f16-4d99-acb1-a53395f3fec5 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:15.080614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ef167-0f16-4d99-acb1-a53395f3fec5 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:15.080614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ef167-0f16-4d99-acb1-a53395f3fec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:15.158493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-668ef167-0f16-4d99-acb1-a53395f3fec5 None None] MFA Rules not processed for user `5deb7370bc3045c5be2d391d3b1dbd82`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:15.159683 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-668ef167-0f16-4d99-acb1-a53395f3fec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:15.274326 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 658/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 27 16:29:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:18.676423 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475d202-4f95-4186-939f-dd9a7bcded5b None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:18.677490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475d202-4f95-4186-939f-dd9a7bcded5b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:18.678733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475d202-4f95-4186-939f-dd9a7bcded5b None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:18.680540 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 698/1356] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:29:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:29:18.686449 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee307cf6-1ab0-4d61-a506-a5e168680dd0 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:18.686901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee307cf6-1ab0-4d61-a506-a5e168680dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:18.687070 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee307cf6-1ab0-4d61-a506-a5e168680dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:18.737190 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:18.771287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-ee307cf6-1ab0-4d61-a506-a5e168680dd0 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:18.772531 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ee307cf6-1ab0-4d61-a506-a5e168680dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:18.883557 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 659/1357] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:19.189722 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a65af-81d0-431e-8b58-70dd210ea151 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:19.190220 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a65af-81d0-431e-8b58-70dd210ea151 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:19.190879 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a65af-81d0-431e-8b58-70dd210ea151 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:19.193006 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 699/1358] 10.222.0.26 () {54 vars in 961 bytes} [Tue Sep 27 16:29:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:19.200977 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b0768-fe55-4824-abec-275736cfcab5 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:19.201339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b0768-fe55-4824-abec-275736cfcab5 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:19.201690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b0768-fe55-4824-abec-275736cfcab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:19.292061 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-5d1b0768-fe55-4824-abec-275736cfcab5 None None] MFA Rules not processed for user `e71fea96b2b949f9abca12172e69284b`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:19.293451 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-5d1b0768-fe55-4824-abec-275736cfcab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:19.356317 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:19.426406 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 660/1359] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Sep 27 16:29:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:19.434239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a65af-81d0-431e-8b58-70dd210ea151 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:29:19.436583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-877a65af-81d0-431e-8b58-70dd210ea151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:19.593125 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a65af-81d0-431e-8b58-70dd210ea151 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:29:19.669411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:19.709677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94500570-682b-4dd9-815a-d1c69af74dc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:29:19.710541 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94500570-682b-4dd9-815a-d1c69af74dc6 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:19.711368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94500570-682b-4dd9-815a-d1c69af74dc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:19.712104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94500570-682b-4dd9-815a-d1c69af74dc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:19.714345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-94500570-682b-4dd9-815a-d1c69af74dc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:19.820821 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94500570-682b-4dd9-815a-d1c69af74dc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:29:19.822416 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94500570-682b-4dd9-815a-d1c69af74dc6 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:29:19.841537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 700/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:22.257126 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46507d6b-4f80-4b43-8aeb-4c9188dbfa93 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:22.257747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46507d6b-4f80-4b43-8aeb-4c9188dbfa93 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:22.257747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46507d6b-4f80-4b43-8aeb-4c9188dbfa93 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:22.268555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30effc68-3d76-4128-aaf1-f79221edfbef None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:22.268555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30effc68-3d76-4128-aaf1-f79221edfbef None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:22.268555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30effc68-3d76-4128-aaf1-f79221edfbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:22.270284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 661/1361] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:29:22 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:22.341586 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-30effc68-3d76-4128-aaf1-f79221edfbef None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:22.342833 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-30effc68-3d76-4128-aaf1-f79221edfbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:22.385566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:22.448594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 701/1362] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:22.743946 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46507d6b-4f80-4b43-8aeb-4c9188dbfa93 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:29:22.745998 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-46507d6b-4f80-4b43-8aeb-4c9188dbfa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:22.937588 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46507d6b-4f80-4b43-8aeb-4c9188dbfa93 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:29:22.950412 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:23.063529 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d48f2-54c7-45a5-9dff-59e67fc3d946 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:29:23.064209 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d48f2-54c7-45a5-9dff-59e67fc3d946 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:23.064534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d48f2-54c7-45a5-9dff-59e67fc3d946 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:23.065196 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d48f2-54c7-45a5-9dff-59e67fc3d946 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:23.066569 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-571d48f2-54c7-45a5-9dff-59e67fc3d946 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:23.167274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d48f2-54c7-45a5-9dff-59e67fc3d946 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:29:23.168923 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d48f2-54c7-45a5-9dff-59e67fc3d946 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:29:23.189611 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 662/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:29:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:25.824680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d93d9-91d1-44a5-9732-28a4e874287b None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:25.825185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d93d9-91d1-44a5-9732-28a4e874287b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:25.825269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d93d9-91d1-44a5-9732-28a4e874287b None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:25.830510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 702/1364] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:25.832065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2eaa9d-5e18-426c-8c83-0c392aee156e None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:25.832493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2eaa9d-5e18-426c-8c83-0c392aee156e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:25.832662 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2eaa9d-5e18-426c-8c83-0c392aee156e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:25.849816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:25.903903 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-be2eaa9d-5e18-426c-8c83-0c392aee156e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:25.905130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-be2eaa9d-5e18-426c-8c83-0c392aee156e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:26.011986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 663/1365] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:26.310498 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fb407-8410-433f-bf18-431192e22de6 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:26.310794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fb407-8410-433f-bf18-431192e22de6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:26.311076 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fb407-8410-433f-bf18-431192e22de6 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:26.312661 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 703/1366] 10.222.0.26 () {54 vars in 961 bytes} [Tue Sep 27 16:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:26.318610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3fa34-bf03-42c1-8f48-6672d8abc056 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:26.323148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3fa34-bf03-42c1-8f48-6672d8abc056 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:26.323148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3fa34-bf03-42c1-8f48-6672d8abc056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:26.403069 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-f2f3fa34-bf03-42c1-8f48-6672d8abc056 None None] MFA Rules not processed for user `e71fea96b2b949f9abca12172e69284b`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:26.404275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f2f3fa34-bf03-42c1-8f48-6672d8abc056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:26.441240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:26.527074 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 664/1367] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Sep 27 16:29:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:26.535186 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fb407-8410-433f-bf18-431192e22de6 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:29:26.537295 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-066fb407-8410-433f-bf18-431192e22de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:26.692876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fb407-8410-433f-bf18-431192e22de6 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:29:26.714984 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:26.826023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0db36-fe0a-49af-bb52-720b9c21285c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:29:26.826719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0db36-fe0a-49af-bb52-720b9c21285c service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:26.826962 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0db36-fe0a-49af-bb52-720b9c21285c service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:26.827152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0db36-fe0a-49af-bb52-720b9c21285c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:26.828748 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6dc0db36-fe0a-49af-bb52-720b9c21285c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:26.838554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c2328-d330-4c3b-8818-be8a0ca9f0e6 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:26.839085 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c2328-d330-4c3b-8818-be8a0ca9f0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:26.839473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c2328-d330-4c3b-8818-be8a0ca9f0e6 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:26.841175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 665/1368] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:29:26.846577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11524d-ec1e-45c4-beaa-83ab072cefe5 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:26.847340 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11524d-ec1e-45c4-beaa-83ab072cefe5 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:26.847729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11524d-ec1e-45c4-beaa-83ab072cefe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:26.920997 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-6f11524d-ec1e-45c4-beaa-83ab072cefe5 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:26.922467 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6f11524d-ec1e-45c4-beaa-83ab072cefe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:26.924071 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc0db36-fe0a-49af-bb52-720b9c21285c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:29:26.925705 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc0db36-fe0a-49af-bb52-720b9c21285c service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:29:26.945180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 704/1369] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:27.024465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:27.036784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 666/1370] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:29:27.370542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dd671-6ac4-497f-83af-8b166aff8afe None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:27.370826 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dd671-6ac4-497f-83af-8b166aff8afe None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:27.371223 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dd671-6ac4-497f-83af-8b166aff8afe None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:27.372691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 705/1371] 10.222.0.26 () {54 vars in 963 bytes} [Tue Sep 27 16:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:27.377844 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9c604-dd52-4de5-96fd-174298a576c5 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:27.378178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9c604-dd52-4de5-96fd-174298a576c5 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:27.378388 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9c604-dd52-4de5-96fd-174298a576c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:27.459747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-afb9c604-dd52-4de5-96fd-174298a576c5 None None] MFA Rules not processed for user `edca8115256546ee8a209f1eca99d972`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:27.460981 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-afb9c604-dd52-4de5-96fd-174298a576c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:27.547078 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 667/1372] 10.222.0.26 () {58 vars in 1060 bytes} [Tue Sep 27 16:29:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:27.555322 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8dd671-6ac4-497f-83af-8b166aff8afe None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:29:27.556868 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2a8dd671-6ac4-497f-83af-8b166aff8afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:27.587141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:27.669885 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8dd671-6ac4-497f-83af-8b166aff8afe None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:29:27.753162 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366646b-e3c0-4904-97e8-1be2fcc58e29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:29:27.753815 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366646b-e3c0-4904-97e8-1be2fcc58e29 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:27.754056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366646b-e3c0-4904-97e8-1be2fcc58e29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:27.754436 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366646b-e3c0-4904-97e8-1be2fcc58e29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:27.756377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1366646b-e3c0-4904-97e8-1be2fcc58e29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:27.844388 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:27.877300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366646b-e3c0-4904-97e8-1be2fcc58e29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:29:27.878736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366646b-e3c0-4904-97e8-1be2fcc58e29 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:29:27.898782 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 706/1373] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:29.362508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc5a74-5c35-4534-9e97-c5b66cd510e0 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:29.363053 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc5a74-5c35-4534-9e97-c5b66cd510e0 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:29.363053 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc5a74-5c35-4534-9e97-c5b66cd510e0 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:29.364893 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 668/1374] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:29.370027 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805a76b-997b-4a27-ab48-56d467b72234 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:29.370447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805a76b-997b-4a27-ab48-56d467b72234 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:29.370576 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805a76b-997b-4a27-ab48-56d467b72234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:29.438260 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-7805a76b-997b-4a27-ab48-56d467b72234 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:29.439460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7805a76b-997b-4a27-ab48-56d467b72234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:29.539472 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 707/1375] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:29.859263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc5a74-5c35-4534-9e97-c5b66cd510e0 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:29:29.860909 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-8cbc5a74-5c35-4534-9e97-c5b66cd510e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:29.952889 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:30.016883 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc5a74-5c35-4534-9e97-c5b66cd510e0 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:29:30.133029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49000f-2a97-45ec-8dcc-f2d2a13b23a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:29:30.133635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49000f-2a97-45ec-8dcc-f2d2a13b23a4 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:30.133912 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49000f-2a97-45ec-8dcc-f2d2a13b23a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:30.134179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49000f-2a97-45ec-8dcc-f2d2a13b23a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:30.135759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-0b49000f-2a97-45ec-8dcc-f2d2a13b23a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:30.186409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:30.229448 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49000f-2a97-45ec-8dcc-f2d2a13b23a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:29:30.231530 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49000f-2a97-45ec-8dcc-f2d2a13b23a4 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:29:30.249833 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 669/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:32.605592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c4586-e5e2-4830-aab9-b0ac643fd46f None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:32.606195 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c4586-e5e2-4830-aab9-b0ac643fd46f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:32.606429 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c4586-e5e2-4830-aab9-b0ac643fd46f None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:32.608111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 708/1377] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:29:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:32.614100 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20aa2b-499b-49d7-b57b-ffbd44acf829 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:32.614589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20aa2b-499b-49d7-b57b-ffbd44acf829 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:32.614689 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20aa2b-499b-49d7-b57b-ffbd44acf829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:32.684432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-5e20aa2b-499b-49d7-b57b-ffbd44acf829 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:32.685552 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-5e20aa2b-499b-49d7-b57b-ffbd44acf829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:32.791983 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 670/1378] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:33.080279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c4586-e5e2-4830-aab9-b0ac643fd46f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:29:33.081824 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c44c4586-e5e2-4830-aab9-b0ac643fd46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:33.122478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:33.234714 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c4586-e5e2-4830-aab9-b0ac643fd46f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:29:33.348708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:33.353887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aab335-9a15-468a-ad51-8a3ea0e6234b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:29:33.354505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aab335-9a15-468a-ad51-8a3ea0e6234b service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:33.354787 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aab335-9a15-468a-ad51-8a3ea0e6234b service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:33.355058 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aab335-9a15-468a-ad51-8a3ea0e6234b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:33.356742 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-63aab335-9a15-468a-ad51-8a3ea0e6234b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:33.453025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aab335-9a15-468a-ad51-8a3ea0e6234b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:29:33.454631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aab335-9a15-468a-ad51-8a3ea0e6234b service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:29:33.474430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 709/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:35.841755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e001268-2bce-425f-8df7-a7ab7101cd3a None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:35.842173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e001268-2bce-425f-8df7-a7ab7101cd3a None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:35.842339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e001268-2bce-425f-8df7-a7ab7101cd3a None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:35.843552 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 671/1380] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:35.849608 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d599a9-1b20-4fd9-92f0-594c087a6af6 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:35.850185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d599a9-1b20-4fd9-92f0-594c087a6af6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:35.850185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d599a9-1b20-4fd9-92f0-594c087a6af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:35.944872 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-74d599a9-1b20-4fd9-92f0-594c087a6af6 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:35.945448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-74d599a9-1b20-4fd9-92f0-594c087a6af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:36.025555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:36.058836 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 710/1381] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:36.351353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e001268-2bce-425f-8df7-a7ab7101cd3a None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:29:36.353684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3e001268-2bce-425f-8df7-a7ab7101cd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:36.391941 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:36.539337 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e001268-2bce-425f-8df7-a7ab7101cd3a None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:29:36.644017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:36.659674 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b02ed-6df4-4b4d-a7f9-b0cb83b5a94c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:29:36.660280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b02ed-6df4-4b4d-a7f9-b0cb83b5a94c service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:36.661336 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b02ed-6df4-4b4d-a7f9-b0cb83b5a94c service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:36.661336 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b02ed-6df4-4b4d-a7f9-b0cb83b5a94c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:36.662929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-d98b02ed-6df4-4b4d-a7f9-b0cb83b5a94c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:36.755242 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b02ed-6df4-4b4d-a7f9-b0cb83b5a94c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:29:36.756920 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b02ed-6df4-4b4d-a7f9-b0cb83b5a94c service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:29:36.775697 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 672/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:39.127839 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf5b49-1e26-43fe-a0c1-54bf24069b08 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:39.128552 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf5b49-1e26-43fe-a0c1-54bf24069b08 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:39.128552 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf5b49-1e26-43fe-a0c1-54bf24069b08 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:39.130411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 711/1383] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:29:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:39.136107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee9039-d9ea-4a73-8663-35015f08c482 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:39.136693 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee9039-d9ea-4a73-8663-35015f08c482 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:39.136693 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee9039-d9ea-4a73-8663-35015f08c482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:39.218869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-3bee9039-d9ea-4a73-8663-35015f08c482 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:39.220739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3bee9039-d9ea-4a73-8663-35015f08c482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:39.292659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:39.334424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 673/1384] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:39.629672 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf5b49-1e26-43fe-a0c1-54bf24069b08 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:29:39.631344 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-20bf5b49-1e26-43fe-a0c1-54bf24069b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:39.800689 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf5b49-1e26-43fe-a0c1-54bf24069b08 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:29:39.857016 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:39.919680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c729af1-db8f-4c4a-a3ff-bef47bbda676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:29:39.920304 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c729af1-db8f-4c4a-a3ff-bef47bbda676 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:39.920626 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c729af1-db8f-4c4a-a3ff-bef47bbda676 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:39.920910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c729af1-db8f-4c4a-a3ff-bef47bbda676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:39.922559 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7c729af1-db8f-4c4a-a3ff-bef47bbda676 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:40.021184 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c729af1-db8f-4c4a-a3ff-bef47bbda676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:29:40.022789 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c729af1-db8f-4c4a-a3ff-bef47bbda676 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:29:40.041620 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 712/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:42.215240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd86cbc-47ce-4074-9851-ddda8e61e721 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:42.215774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd86cbc-47ce-4074-9851-ddda8e61e721 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:42.215774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd86cbc-47ce-4074-9851-ddda8e61e721 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:42.217172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 674/1386] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:42.222654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb91336-654e-4d47-b685-735fb8914a55 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:42.223076 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb91336-654e-4d47-b685-735fb8914a55 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:42.223248 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb91336-654e-4d47-b685-735fb8914a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:42.288882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-0bb91336-654e-4d47-b685-735fb8914a55 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:42.290069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0bb91336-654e-4d47-b685-735fb8914a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:42.298227 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:42.387955 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 713/1387] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:42.679820 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd86cbc-47ce-4074-9851-ddda8e61e721 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:29:42.681353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-abd86cbc-47ce-4074-9851-ddda8e61e721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:42.831920 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd86cbc-47ce-4074-9851-ddda8e61e721 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:29:42.876216 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:42.941314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89596f57-2cb0-4a51-9e6a-281e3d529758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:29:42.942460 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89596f57-2cb0-4a51-9e6a-281e3d529758 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:42.942740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89596f57-2cb0-4a51-9e6a-281e3d529758 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:42.943013 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89596f57-2cb0-4a51-9e6a-281e3d529758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:42.944613 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-89596f57-2cb0-4a51-9e6a-281e3d529758 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:43.034116 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89596f57-2cb0-4a51-9e6a-281e3d529758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:29:43.036399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89596f57-2cb0-4a51-9e6a-281e3d529758 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:29:43.054866 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 675/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:43.721169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7b72e-5472-43db-9c92-86688925a6a4 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:43.721748 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7b72e-5472-43db-9c92-86688925a6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:43.721748 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7b72e-5472-43db-9c92-86688925a6a4 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:43.723108 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 714/1389] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:43.728633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1884ea-b8ea-476b-9f65-0f3eece611a5 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:43.729090 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1884ea-b8ea-476b-9f65-0f3eece611a5 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:43.729305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1884ea-b8ea-476b-9f65-0f3eece611a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:43.794745 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:43.799409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-6a1884ea-b8ea-476b-9f65-0f3eece611a5 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:43.800660 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6a1884ea-b8ea-476b-9f65-0f3eece611a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:43.898897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 676/1390] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:44.202043 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c9cca-202f-48d4-ac1a-19f572ec6eda None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:44.202332 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c9cca-202f-48d4-ac1a-19f572ec6eda None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:44.202610 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c9cca-202f-48d4-ac1a-19f572ec6eda None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:44.204131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 715/1391] 10.222.0.26 () {54 vars in 962 bytes} [Tue Sep 27 16:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:44.209651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf865df-d849-4af3-9ca2-30c135573225 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:44.209940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf865df-d849-4af3-9ca2-30c135573225 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:44.210236 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf865df-d849-4af3-9ca2-30c135573225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:44.289319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-dcf865df-d849-4af3-9ca2-30c135573225 None None] MFA Rules not processed for user `e15cb1d012934ebeac53af885ca65f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:44.290530 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-dcf865df-d849-4af3-9ca2-30c135573225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:44.361096 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:44.366984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 677/1392] 10.222.0.26 () {58 vars in 1059 bytes} [Tue Sep 27 16:29:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:44.376202 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c9cca-202f-48d4-ac1a-19f572ec6eda None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:29:44.379222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-599c9cca-202f-48d4-ac1a-19f572ec6eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:44.483638 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c9cca-202f-48d4-ac1a-19f572ec6eda None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:29:44.524846 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:44.560803 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafc141-e784-4030-b8d0-da3e793431e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e15cb1d012934ebeac53af885ca65f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:29:44.561408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafc141-e784-4030-b8d0-da3e793431e3 service glance] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:44.561698 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafc141-e784-4030-b8d0-da3e793431e3 service glance] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:44.562082 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafc141-e784-4030-b8d0-da3e793431e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:44.563675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1dafc141-e784-4030-b8d0-da3e793431e3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:44.675800 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafc141-e784-4030-b8d0-da3e793431e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:29:44.677889 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafc141-e784-4030-b8d0-da3e793431e3 service glance] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:29:44.696307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 716/1393] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:45.565487 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d2a2a-49b0-489a-8bd8-9879b4f08ab5 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:45.566130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d2a2a-49b0-489a-8bd8-9879b4f08ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:45.566130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d2a2a-49b0-489a-8bd8-9879b4f08ab5 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:45.567898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 678/1394] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:29:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:45.573124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b55f4-4339-450a-ab04-a67f519fee51 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:45.573550 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b55f4-4339-450a-ab04-a67f519fee51 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:45.573684 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b55f4-4339-450a-ab04-a67f519fee51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:45.622748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb0720-fc49-474e-873f-b0ce7fd151d9 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:45.623031 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb0720-fc49-474e-873f-b0ce7fd151d9 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:45.623306 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb0720-fc49-474e-873f-b0ce7fd151d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:45.644052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9b9b55f4-4339-450a-ab04-a67f519fee51 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:45.645934 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9b9b55f4-4339-450a-ab04-a67f519fee51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:45.663743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:45.691437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-97fb0720-fc49-474e-873f-b0ce7fd151d9 None None] MFA Rules not processed for user `0c8d0a718e8347b5af397f866056266e`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:45.693396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-97fb0720-fc49-474e-873f-b0ce7fd151d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:45.744264 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 717/1395] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:45.787792 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 679/1396] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 27 16:29:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:29:45.836563 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded5997-0760-4f35-b5bc-94a65bf88b41 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:45.836861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded5997-0760-4f35-b5bc-94a65bf88b41 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:45.837143 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded5997-0760-4f35-b5bc-94a65bf88b41 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:45.838664 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 718/1397] 10.222.0.26 () {54 vars in 943 bytes} [Tue Sep 27 16:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:45.845026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9f88-187b-463b-893f-beccadd05cee None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:45.845365 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9f88-187b-463b-893f-beccadd05cee None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:45.845667 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9f88-187b-463b-893f-beccadd05cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:45.924806 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-a8dc9f88-187b-463b-893f-beccadd05cee None None] MFA Rules not processed for user `e70b85e430004a8b865622354c1d1ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:45.926196 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a8dc9f88-187b-463b-893f-beccadd05cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:45.953205 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:46.031906 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 680/1398] 10.222.0.26 () {58 vars in 1040 bytes} [Tue Sep 27 16:29:45 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:46.036744 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded5997-0760-4f35-b5bc-94a65bf88b41 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:29:46.038325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2ded5997-0760-4f35-b5bc-94a65bf88b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:46.042141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc9f88-187b-463b-893f-beccadd05cee None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:29:46.052711 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc9f88-187b-463b-893f-beccadd05cee None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:29:46.157625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e0002-bcfa-4edc-aa8d-3793289ebe60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b85e430004a8b865622354c1d1ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:29:46.158146 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e0002-bcfa-4edc-aa8d-3793289ebe60 service swift] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:46.158427 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e0002-bcfa-4edc-aa8d-3793289ebe60 service swift] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:46.158700 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e0002-bcfa-4edc-aa8d-3793289ebe60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:46.160353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-0a7e0002-bcfa-4edc-aa8d-3793289ebe60 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:46.184282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded5997-0760-4f35-b5bc-94a65bf88b41 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:29:46.187116 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:46.194382 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:46.244048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e0002-bcfa-4edc-aa8d-3793289ebe60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:29:46.245721 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e0002-bcfa-4edc-aa8d-3793289ebe60 service swift] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:29:46.253820 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 681/1399] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 27 16:29:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 27 16:29:46.306036 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45a760-574f-4707-9372-20711add4ba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:29:46.306633 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45a760-574f-4707-9372-20711add4ba6 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:46.306908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45a760-574f-4707-9372-20711add4ba6 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:46.307175 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45a760-574f-4707-9372-20711add4ba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:46.308763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7d45a760-574f-4707-9372-20711add4ba6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:46.397835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45a760-574f-4707-9372-20711add4ba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:29:46.399408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45a760-574f-4707-9372-20711add4ba6 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:29:46.417361 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 719/1400] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:48.852359 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4743d8-b33e-46f0-a937-fd2b06670a9c None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:48.852359 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4743d8-b33e-46f0-a937-fd2b06670a9c None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:48.852359 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4743d8-b33e-46f0-a937-fd2b06670a9c None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:48.852359 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 682/1401] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:48.853127 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5c7b5-2461-4766-a75d-769dee94534e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:48.853127 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5c7b5-2461-4766-a75d-769dee94534e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:48.853127 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5c7b5-2461-4766-a75d-769dee94534e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:48.861326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:48.921708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-14a5c7b5-2461-4766-a75d-769dee94534e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:48.922988 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-14a5c7b5-2461-4766-a75d-769dee94534e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:49.034033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 720/1402] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:49.321659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4743d8-b33e-46f0-a937-fd2b06670a9c None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:29:49.323185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6f4743d8-b33e-46f0-a937-fd2b06670a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:49.492618 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4743d8-b33e-46f0-a937-fd2b06670a9c None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:29:49.522929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:49.618313 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bfadf-c141-4163-b1f5-210189ce5b11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:29:49.618846 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bfadf-c141-4163-b1f5-210189ce5b11 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:49.619124 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bfadf-c141-4163-b1f5-210189ce5b11 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:49.619396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bfadf-c141-4163-b1f5-210189ce5b11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:49.621062 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-589bfadf-c141-4163-b1f5-210189ce5b11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:49.723115 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bfadf-c141-4163-b1f5-210189ce5b11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:29:49.725154 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bfadf-c141-4163-b1f5-210189ce5b11 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:29:49.745410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 683/1403] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:52.113792 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63ed4c-e727-4e65-b3b3-38b0ca09b463 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:52.114311 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63ed4c-e727-4e65-b3b3-38b0ca09b463 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:52.114311 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63ed4c-e727-4e65-b3b3-38b0ca09b463 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:52.115800 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 721/1404] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:29:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:52.120936 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa2a8f-3024-4cd8-945c-bf1210d4d307 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:52.122309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa2a8f-3024-4cd8-945c-bf1210d4d307 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:52.123095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa2a8f-3024-4cd8-945c-bf1210d4d307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:52.171167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:52.200091 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-e9aa2a8f-3024-4cd8-945c-bf1210d4d307 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:52.201415 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-e9aa2a8f-3024-4cd8-945c-bf1210d4d307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:52.309698 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 684/1405] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:52.599800 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63ed4c-e727-4e65-b3b3-38b0ca09b463 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:29:52.601372 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2d63ed4c-e727-4e65-b3b3-38b0ca09b463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:52.739119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:52.823087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63ed4c-e727-4e65-b3b3-38b0ca09b463 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:29:52.978631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32aa2b-b767-4ae7-8a5b-23cdd1066cf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:29:52.979275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32aa2b-b767-4ae7-8a5b-23cdd1066cf3 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:52.979555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32aa2b-b767-4ae7-8a5b-23cdd1066cf3 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:52.979831 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32aa2b-b767-4ae7-8a5b-23cdd1066cf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:52.981476 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ac32aa2b-b767-4ae7-8a5b-23cdd1066cf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:53.039883 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:53.088110 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32aa2b-b767-4ae7-8a5b-23cdd1066cf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:29:53.090289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32aa2b-b767-4ae7-8a5b-23cdd1066cf3 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:29:53.111958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 722/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:56.318202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc6bc1-1c0f-4a1d-b03d-6d11a410b2a5 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:56.318793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc6bc1-1c0f-4a1d-b03d-6d11a410b2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:56.318793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc6bc1-1c0f-4a1d-b03d-6d11a410b2a5 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:56.321251 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 685/1407] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:29:56.325469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b50a3-1d65-424a-b0ff-9c7c7c77ecfb None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:56.326334 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b50a3-1d65-424a-b0ff-9c7c7c77ecfb None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:56.326798 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b50a3-1d65-424a-b0ff-9c7c7c77ecfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:56.397632 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-165b50a3-1d65-424a-b0ff-9c7c7c77ecfb None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:29:56.402249 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-165b50a3-1d65-424a-b0ff-9c7c7c77ecfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:56.507014 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 723/1408] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:29:56.793377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc6bc1-1c0f-4a1d-b03d-6d11a410b2a5 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:29:56.794956 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4efc6bc1-1c0f-4a1d-b03d-6d11a410b2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:56.914994 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:56.961240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc6bc1-1c0f-4a1d-b03d-6d11a410b2a5 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:29:57.089481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b814a2-8a5a-40d6-a2c1-032342b2bca3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:29:57.089996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b814a2-8a5a-40d6-a2c1-032342b2bca3 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:29:57.090273 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b814a2-8a5a-40d6-a2c1-032342b2bca3 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:29:57.090548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b814a2-8a5a-40d6-a2c1-032342b2bca3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:29:57.092170 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-03b814a2-8a5a-40d6-a2c1-032342b2bca3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:29:57.173126 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:57.190491 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b814a2-8a5a-40d6-a2c1-032342b2bca3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:29:57.192869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b814a2-8a5a-40d6-a2c1-032342b2bca3 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:29:57.211719 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 686/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:29:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:30:06.505893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:07.218974 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=13 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:10.568492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0120cb-2ce4-4f38-a168-5376f84476ce None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:10.569079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0120cb-2ce4-4f38-a168-5376f84476ce None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:10.569079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0120cb-2ce4-4f38-a168-5376f84476ce None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:10.570401 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 724/1410] 10.222.0.26 () {54 vars in 918 bytes} [Tue Sep 27 16:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:30:10.575600 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17208a78-b4f1-4b2e-9915-7c009882ec09 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:10.576043 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17208a78-b4f1-4b2e-9915-7c009882ec09 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:10.576149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17208a78-b4f1-4b2e-9915-7c009882ec09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:10.650666 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-17208a78-b4f1-4b2e-9915-7c009882ec09 None None] MFA Rules not processed for user `5deb7370bc3045c5be2d391d3b1dbd82`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:10.651892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-17208a78-b4f1-4b2e-9915-7c009882ec09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:10.757758 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 687/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Tue Sep 27 16:30:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:10.772203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605118ad-a5ff-439c-92f1-db6c2a308a13 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:10.773295 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605118ad-a5ff-439c-92f1-db6c2a308a13 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:10.773295 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605118ad-a5ff-439c-92f1-db6c2a308a13 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:10.774357 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 725/1412] 10.222.0.26 () {54 vars in 918 bytes} [Tue Sep 27 16:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:30:10.779424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c649f-3498-49a0-86e3-385f525e8c2c None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:10.779740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c649f-3498-49a0-86e3-385f525e8c2c None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:10.780039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c649f-3498-49a0-86e3-385f525e8c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:10.857344 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:10.860503 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-224c649f-3498-49a0-86e3-385f525e8c2c None None] MFA Rules not processed for user `e71fea96b2b949f9abca12172e69284b`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:10.861782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-224c649f-3498-49a0-86e3-385f525e8c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:10.986109 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 688/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Tue Sep 27 16:30:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:13.575644 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa70b3f-25a5-46ed-9dfa-f3b3c62ed4a2 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:13.576204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa70b3f-25a5-46ed-9dfa-f3b3c62ed4a2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:13.576204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa70b3f-25a5-46ed-9dfa-f3b3c62ed4a2 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:13.577539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 726/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 16:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:30:13.584188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e9c76-a7cb-4459-a835-431e8aaf12e8 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:13.584697 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e9c76-a7cb-4459-a835-431e8aaf12e8 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:13.584798 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e9c76-a7cb-4459-a835-431e8aaf12e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:13.652738 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-3c8e9c76-a7cb-4459-a835-431e8aaf12e8 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:13.653943 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3c8e9c76-a7cb-4459-a835-431e8aaf12e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:13.710690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:13.752541 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 689/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 16:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:30:14.041181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa70b3f-25a5-46ed-9dfa-f3b3c62ed4a2 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:30:14.042695 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-caa70b3f-25a5-46ed-9dfa-f3b3c62ed4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:14.186506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa70b3f-25a5-46ed-9dfa-f3b3c62ed4a2 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:30:14.259079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:14.297493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc207b2-a48a-431e-ad8c-08fa05dda779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:30:14.298137 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc207b2-a48a-431e-ad8c-08fa05dda779 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:14.298416 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc207b2-a48a-431e-ad8c-08fa05dda779 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:14.298957 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc207b2-a48a-431e-ad8c-08fa05dda779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:14.301057 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ddc207b2-a48a-431e-ad8c-08fa05dda779 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:14.389222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc207b2-a48a-431e-ad8c-08fa05dda779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:30:14.390801 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc207b2-a48a-431e-ad8c-08fa05dda779 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:30:14.408306 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 727/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:30:15.555279 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d16253-a93b-4e96-bb70-eb7479c9887b None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:15.555830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d16253-a93b-4e96-bb70-eb7479c9887b None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:15.555830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d16253-a93b-4e96-bb70-eb7479c9887b None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:15.557242 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 690/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 16:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:30:15.563535 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ae070-2baf-4f84-982b-71fd509a9fc0 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:15.563979 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ae070-2baf-4f84-982b-71fd509a9fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:15.564085 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ae070-2baf-4f84-982b-71fd509a9fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:15.638945 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1f9ae070-2baf-4f84-982b-71fd509a9fc0 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:15.640147 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1f9ae070-2baf-4f84-982b-71fd509a9fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:15.666636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:15.735181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 728/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 16:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:15.890622 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d16253-a93b-4e96-bb70-eb7479c9887b None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:30:15.892149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b0d16253-a93b-4e96-bb70-eb7479c9887b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:16.061527 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d16253-a93b-4e96-bb70-eb7479c9887b None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:30:16.103804 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:16.178471 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1cd8c-0329-45d3-bea4-d4f721c34578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:30:16.179071 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1cd8c-0329-45d3-bea4-d4f721c34578 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:16.179345 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1cd8c-0329-45d3-bea4-d4f721c34578 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:16.179612 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1cd8c-0329-45d3-bea4-d4f721c34578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:16.181221 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-39c1cd8c-0329-45d3-bea4-d4f721c34578 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:16.271916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1cd8c-0329-45d3-bea4-d4f721c34578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:30:16.273556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1cd8c-0329-45d3-bea4-d4f721c34578 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:30:16.291684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 691/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:30:17.446187 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09555158-66a7-4672-afd6-be0a7f0b4de6 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:17.446701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09555158-66a7-4672-afd6-be0a7f0b4de6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:17.446701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09555158-66a7-4672-afd6-be0a7f0b4de6 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:17.448063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 729/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 16:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:30:17.454451 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bdb53-341e-4b92-97a0-bf44a2345b73 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:17.454925 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bdb53-341e-4b92-97a0-bf44a2345b73 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:17.455029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bdb53-341e-4b92-97a0-bf44a2345b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:17.510672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:17.532320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-9d5bdb53-341e-4b92-97a0-bf44a2345b73 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:17.533556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-9d5bdb53-341e-4b92-97a0-bf44a2345b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:17.629614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 692/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 16:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:17.781779 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09555158-66a7-4672-afd6-be0a7f0b4de6 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:30:17.783301 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-09555158-66a7-4672-afd6-be0a7f0b4de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:17.927564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09555158-66a7-4672-afd6-be0a7f0b4de6 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:30:17.939744 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:18.040260 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f1680-eb9c-42fe-b152-57754fead5fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:30:18.040817 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f1680-eb9c-42fe-b152-57754fead5fb service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:18.041234 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f1680-eb9c-42fe-b152-57754fead5fb service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:18.041510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f1680-eb9c-42fe-b152-57754fead5fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:18.043094 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f01f1680-eb9c-42fe-b152-57754fead5fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:18.132139 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f1680-eb9c-42fe-b152-57754fead5fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:30:18.133751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f1680-eb9c-42fe-b152-57754fead5fb service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:30:18.151778 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 730/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:30:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:30:19.274431 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07536600-7040-4c4f-b381-82aed83ab26f None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:19.274986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07536600-7040-4c4f-b381-82aed83ab26f None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:19.274986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07536600-7040-4c4f-b381-82aed83ab26f None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:19.276361 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 693/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 16:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:30:19.282829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c68bef-bb2c-4324-9dda-3877dab4e86e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:19.283263 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c68bef-bb2c-4324-9dda-3877dab4e86e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:19.283426 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c68bef-bb2c-4324-9dda-3877dab4e86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:19.304124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:19.361549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-e6c68bef-bb2c-4324-9dda-3877dab4e86e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:19.362770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e6c68bef-bb2c-4324-9dda-3877dab4e86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:19.459430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 731/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 16:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:19.609680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07536600-7040-4c4f-b381-82aed83ab26f None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:30:19.611117 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-07536600-7040-4c4f-b381-82aed83ab26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:19.719059 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:19.753770 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07536600-7040-4c4f-b381-82aed83ab26f None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:30:19.866326 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4a16c-f877-49c8-8f67-576ed69872a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:30:19.866861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4a16c-f877-49c8-8f67-576ed69872a3 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:19.867140 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4a16c-f877-49c8-8f67-576ed69872a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:19.867413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4a16c-f877-49c8-8f67-576ed69872a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:19.869037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c3f4a16c-f877-49c8-8f67-576ed69872a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:19.947024 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:19.960008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4a16c-f877-49c8-8f67-576ed69872a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:30:19.961805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4a16c-f877-49c8-8f67-576ed69872a3 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:30:19.979628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 694/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:30:21.102066 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e3546-1538-4003-8a9c-abbf5753e026 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:21.102606 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e3546-1538-4003-8a9c-abbf5753e026 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:21.102606 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e3546-1538-4003-8a9c-abbf5753e026 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:21.103881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 732/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 16:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:30:21.110152 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a86ef-0824-441c-b971-37ab5c8ff353 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:21.110581 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a86ef-0824-441c-b971-37ab5c8ff353 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:21.110682 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a86ef-0824-441c-b971-37ab5c8ff353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:21.185984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-f59a86ef-0824-441c-b971-37ab5c8ff353 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:21.187188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f59a86ef-0824-441c-b971-37ab5c8ff353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:21.281307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 695/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 16:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:21.433570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e3546-1538-4003-8a9c-abbf5753e026 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:30:21.435058 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9e3e3546-1538-4003-8a9c-abbf5753e026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:21.518239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:21.581272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e3546-1538-4003-8a9c-abbf5753e026 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:30:21.693220 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22f12d-a36a-4984-a283-9634bc9ab0e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:30:21.693753 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22f12d-a36a-4984-a283-9634bc9ab0e5 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:21.694029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22f12d-a36a-4984-a283-9634bc9ab0e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:21.694300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22f12d-a36a-4984-a283-9634bc9ab0e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:21.695876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-fe22f12d-a36a-4984-a283-9634bc9ab0e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:21.743907 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:21.784215 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22f12d-a36a-4984-a283-9634bc9ab0e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:30:21.786440 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22f12d-a36a-4984-a283-9634bc9ab0e5 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:30:21.805136 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 733/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:30:22.928974 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76572121-1fb9-40fa-bbc0-dd7c0bcbf1aa None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:22.929589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76572121-1fb9-40fa-bbc0-dd7c0bcbf1aa None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:22.929589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76572121-1fb9-40fa-bbc0-dd7c0bcbf1aa None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:22.930838 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 696/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 16:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:30:22.937373 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7873b95-47ae-4552-8a18-420140eb6252 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:22.937825 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7873b95-47ae-4552-8a18-420140eb6252 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:22.937962 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7873b95-47ae-4552-8a18-420140eb6252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:23.014661 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a7873b95-47ae-4552-8a18-420140eb6252 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:23.015868 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a7873b95-47ae-4552-8a18-420140eb6252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:23.113026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 734/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:23.268269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76572121-1fb9-40fa-bbc0-dd7c0bcbf1aa None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:30:23.270364 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-76572121-1fb9-40fa-bbc0-dd7c0bcbf1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:23.320184 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:23.417506 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76572121-1fb9-40fa-bbc0-dd7c0bcbf1aa None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:30:23.530003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effb8f1-54c1-45d9-a348-fdc8669b636a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:30:23.530605 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effb8f1-54c1-45d9-a348-fdc8669b636a service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:23.530881 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effb8f1-54c1-45d9-a348-fdc8669b636a service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:23.531153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effb8f1-54c1-45d9-a348-fdc8669b636a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:23.532798 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-1effb8f1-54c1-45d9-a348-fdc8669b636a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:23.539664 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:23.621843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effb8f1-54c1-45d9-a348-fdc8669b636a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:30:23.623650 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effb8f1-54c1-45d9-a348-fdc8669b636a service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:30:23.642266 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 697/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:30:24.786442 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77641204-6f2c-4368-ab11-687846402c24 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:24.786989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77641204-6f2c-4368-ab11-687846402c24 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:24.786989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77641204-6f2c-4368-ab11-687846402c24 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:24.788323 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 735/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 16:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:30:24.794926 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b6638-f6e7-4c93-94b2-e4b6a341ee52 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:24.795345 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b6638-f6e7-4c93-94b2-e4b6a341ee52 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:24.795487 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b6638-f6e7-4c93-94b2-e4b6a341ee52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:24.871094 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-6b9b6638-f6e7-4c93-94b2-e4b6a341ee52 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:24.872322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6b9b6638-f6e7-4c93-94b2-e4b6a341ee52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:24.938620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:24.966933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 698/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 16:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:25.117297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77641204-6f2c-4368-ab11-687846402c24 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:30:25.118874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-77641204-6f2c-4368-ab11-687846402c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:25.136741 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:25.263887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77641204-6f2c-4368-ab11-687846402c24 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:30:25.356872 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:25.382461 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e28ab-342e-439c-a70a-568156d0382c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:30:25.383067 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e28ab-342e-439c-a70a-568156d0382c service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:25.383342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e28ab-342e-439c-a70a-568156d0382c service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:25.383609 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e28ab-342e-439c-a70a-568156d0382c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:25.385235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7f7e28ab-342e-439c-a70a-568156d0382c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:25.474907 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e28ab-342e-439c-a70a-568156d0382c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:30:25.476534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e28ab-342e-439c-a70a-568156d0382c service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:30:25.494569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 736/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:30:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:30:26.698915 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0fdff-abf9-4db1-ae89-e5c3f163326c None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:26.699427 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0fdff-abf9-4db1-ae89-e5c3f163326c None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:26.699427 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0fdff-abf9-4db1-ae89-e5c3f163326c None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:26.700782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 699/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 16:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:30:26.707079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf80da4-d8c5-4fe9-8d58-4f6500dbb0cd None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:26.707533 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf80da4-d8c5-4fe9-8d58-4f6500dbb0cd None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:26.707642 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf80da4-d8c5-4fe9-8d58-4f6500dbb0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:26.784877 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3bf80da4-d8c5-4fe9-8d58-4f6500dbb0cd None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:26.786248 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3bf80da4-d8c5-4fe9-8d58-4f6500dbb0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:26.828538 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:26.884494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 737/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 16:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:27.038593 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0fdff-abf9-4db1-ae89-e5c3f163326c None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:30:27.040208 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3db0fdff-abf9-4db1-ae89-e5c3f163326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:27.183347 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0fdff-abf9-4db1-ae89-e5c3f163326c None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:30:27.237674 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:27.294424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adb2fa-a48f-46fb-a722-1e1b0259677e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:30:27.294978 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adb2fa-a48f-46fb-a722-1e1b0259677e service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:27.295251 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adb2fa-a48f-46fb-a722-1e1b0259677e service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:27.295515 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adb2fa-a48f-46fb-a722-1e1b0259677e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:27.297144 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b5adb2fa-a48f-46fb-a722-1e1b0259677e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:27.387347 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5adb2fa-a48f-46fb-a722-1e1b0259677e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:30:27.389056 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5adb2fa-a48f-46fb-a722-1e1b0259677e service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:30:27.406904 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 700/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:30:28.534221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df13136-71b3-4d7f-8112-f73a2b15fb61 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:28.534805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df13136-71b3-4d7f-8112-f73a2b15fb61 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:28.534805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df13136-71b3-4d7f-8112-f73a2b15fb61 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:28.536214 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 738/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 16:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:30:28.542665 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f854fe5-e367-4ce1-ae80-bf43b0d11aff None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:28.543092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f854fe5-e367-4ce1-ae80-bf43b0d11aff None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:28.543207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f854fe5-e367-4ce1-ae80-bf43b0d11aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:28.619773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-9f854fe5-e367-4ce1-ae80-bf43b0d11aff None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:28.620992 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-9f854fe5-e367-4ce1-ae80-bf43b0d11aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:28.622971 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:28.719352 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 701/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 16:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:28.869204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df13136-71b3-4d7f-8112-f73a2b15fb61 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:30:28.870718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1df13136-71b3-4d7f-8112-f73a2b15fb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:29.014880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df13136-71b3-4d7f-8112-f73a2b15fb61 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:30:29.043239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:29.244395 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51754c16-9667-482f-9e5b-75d9d7f976de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:30:29.245040 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51754c16-9667-482f-9e5b-75d9d7f976de service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:29.245319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51754c16-9667-482f-9e5b-75d9d7f976de service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:29.245593 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51754c16-9667-482f-9e5b-75d9d7f976de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:29.247328 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-51754c16-9667-482f-9e5b-75d9d7f976de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:29.339344 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51754c16-9667-482f-9e5b-75d9d7f976de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:30:29.345592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51754c16-9667-482f-9e5b-75d9d7f976de service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:30:29.358836 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 739/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:30:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:30:31.453497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafc228-ad62-44b6-af2c-9cf9a7f6b137 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:31.454124 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafc228-ad62-44b6-af2c-9cf9a7f6b137 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:31.454124 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafc228-ad62-44b6-af2c-9cf9a7f6b137 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:31.455377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 702/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 16:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:30:31.461430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e0bb5-2342-4096-bd5b-fb09f8100060 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:31.461852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e0bb5-2342-4096-bd5b-fb09f8100060 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:31.461983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e0bb5-2342-4096-bd5b-fb09f8100060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:31.502423 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:31.527298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-2c7e0bb5-2342-4096-bd5b-fb09f8100060 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:31.528543 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2c7e0bb5-2342-4096-bd5b-fb09f8100060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:31.623909 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 740/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 16:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:31.910223 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafc228-ad62-44b6-af2c-9cf9a7f6b137 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:30:31.911761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-0bafc228-ad62-44b6-af2c-9cf9a7f6b137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:32.017853 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafc228-ad62-44b6-af2c-9cf9a7f6b137 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:30:32.053575 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:32.095310 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea28ee-7072-4acc-be88-b3f50bf9a3e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:30:32.095915 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea28ee-7072-4acc-be88-b3f50bf9a3e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:32.096198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea28ee-7072-4acc-be88-b3f50bf9a3e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:32.096569 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea28ee-7072-4acc-be88-b3f50bf9a3e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:32.098205 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-79ea28ee-7072-4acc-be88-b3f50bf9a3e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:32.222005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea28ee-7072-4acc-be88-b3f50bf9a3e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:30:32.223739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea28ee-7072-4acc-be88-b3f50bf9a3e3 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:30:32.243042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 703/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:30:34.615387 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85413d97-16ea-4fad-b04b-1d62cf4cd557 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:34.615933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85413d97-16ea-4fad-b04b-1d62cf4cd557 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:34.615933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85413d97-16ea-4fad-b04b-1d62cf4cd557 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:34.617318 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 741/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 16:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:30:34.623019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833501b3-51f0-4e13-a1f6-31e034835867 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:34.623462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833501b3-51f0-4e13-a1f6-31e034835867 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:34.623604 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833501b3-51f0-4e13-a1f6-31e034835867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:34.693870 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-833501b3-51f0-4e13-a1f6-31e034835867 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:34.694994 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-833501b3-51f0-4e13-a1f6-31e034835867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:34.709075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:34.797494 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 704/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 16:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:35.087769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85413d97-16ea-4fad-b04b-1d62cf4cd557 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:30:35.089380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-85413d97-16ea-4fad-b04b-1d62cf4cd557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:35.195692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85413d97-16ea-4fad-b04b-1d62cf4cd557 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:30:35.209991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:35.277557 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c94ee-e78d-4f08-93b1-edbbca8e1294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:30:35.278095 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c94ee-e78d-4f08-93b1-edbbca8e1294 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:35.278365 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c94ee-e78d-4f08-93b1-edbbca8e1294 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:35.278637 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c94ee-e78d-4f08-93b1-edbbca8e1294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:35.280237 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-594c94ee-e78d-4f08-93b1-edbbca8e1294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:35.392764 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c94ee-e78d-4f08-93b1-edbbca8e1294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:30:35.394810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c94ee-e78d-4f08-93b1-edbbca8e1294 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:30:35.413393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 742/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:30:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:30:38.029250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ec4d6-c655-44e4-90b4-b4061296bfe7 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:38.029805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ec4d6-c655-44e4-90b4-b4061296bfe7 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:38.029805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ec4d6-c655-44e4-90b4-b4061296bfe7 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:38.031340 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 705/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 16:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:30:38.037184 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301aef35-7f40-4b81-8ad2-3b97fdc0a7ff None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:38.037649 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301aef35-7f40-4b81-8ad2-3b97fdc0a7ff None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:38.037758 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301aef35-7f40-4b81-8ad2-3b97fdc0a7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:38.087465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:38.106423 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-301aef35-7f40-4b81-8ad2-3b97fdc0a7ff None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:38.107619 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-301aef35-7f40-4b81-8ad2-3b97fdc0a7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:38.210114 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 743/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 16:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:38.500651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ec4d6-c655-44e4-90b4-b4061296bfe7 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:30:38.502224 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-183ec4d6-c655-44e4-90b4-b4061296bfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:38.618008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ec4d6-c655-44e4-90b4-b4061296bfe7 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:30:38.659271 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:38.695208 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042fef0-5f89-4a5c-a8d9-529f2e023807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:30:38.696275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042fef0-5f89-4a5c-a8d9-529f2e023807 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:38.696580 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042fef0-5f89-4a5c-a8d9-529f2e023807 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:38.696921 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042fef0-5f89-4a5c-a8d9-529f2e023807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:38.698494 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-5042fef0-5f89-4a5c-a8d9-529f2e023807 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:38.815668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042fef0-5f89-4a5c-a8d9-529f2e023807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:30:38.817138 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042fef0-5f89-4a5c-a8d9-529f2e023807 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:30:38.835554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 706/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:30:41.154672 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3f0c-8a01-4785-adeb-4597ef433ae1 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:41.155236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3f0c-8a01-4785-adeb-4597ef433ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:41.155236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3f0c-8a01-4785-adeb-4597ef433ae1 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:41.156600 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 744/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 16:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:30:41.161950 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde51eeb-7ba6-4c03-bc64-4546e557b41d None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:41.162408 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde51eeb-7ba6-4c03-bc64-4546e557b41d None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:41.162517 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde51eeb-7ba6-4c03-bc64-4546e557b41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:41.227631 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-fde51eeb-7ba6-4c03-bc64-4546e557b41d None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:41.228866 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-fde51eeb-7ba6-4c03-bc64-4546e557b41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:41.249336 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:41.324895 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 707/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 16:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:41.621856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e3f0c-8a01-4785-adeb-4597ef433ae1 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:30:41.623532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-cb7e3f0c-8a01-4785-adeb-4597ef433ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:41.726464 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e3f0c-8a01-4785-adeb-4597ef433ae1 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:30:41.746967 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:41.799439 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b809b5-0728-42eb-a7e3-443cdbf02721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:30:41.800603 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b809b5-0728-42eb-a7e3-443cdbf02721 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:41.800887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b809b5-0728-42eb-a7e3-443cdbf02721 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:41.801161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b809b5-0728-42eb-a7e3-443cdbf02721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:41.802756 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d9b809b5-0728-42eb-a7e3-443cdbf02721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:41.911080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b809b5-0728-42eb-a7e3-443cdbf02721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:30:41.912452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b809b5-0728-42eb-a7e3-443cdbf02721 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:30:41.930769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 745/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:30:44.150918 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2774f-e52a-4b05-b033-efafc95b4f8b None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:44.151498 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2774f-e52a-4b05-b033-efafc95b4f8b None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:44.151498 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2774f-e52a-4b05-b033-efafc95b4f8b None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:44.152846 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 708/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 16:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:30:44.158163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca3ad3-8398-4ad3-b29c-2fcfa45db604 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:44.158555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca3ad3-8398-4ad3-b29c-2fcfa45db604 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:44.158746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca3ad3-8398-4ad3-b29c-2fcfa45db604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:44.222697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:44.225298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-29ca3ad3-8398-4ad3-b29c-2fcfa45db604 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:44.226504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-29ca3ad3-8398-4ad3-b29c-2fcfa45db604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:44.323631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 746/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 16:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:44.616122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2774f-e52a-4b05-b033-efafc95b4f8b None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:30:44.617691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-88a2774f-e52a-4b05-b033-efafc95b4f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:44.719785 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2774f-e52a-4b05-b033-efafc95b4f8b None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:30:44.767818 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:44.792801 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003491b-9b1a-4314-ae48-2279853f4112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:30:44.793415 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003491b-9b1a-4314-ae48-2279853f4112 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:44.793699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003491b-9b1a-4314-ae48-2279853f4112 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:44.793974 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003491b-9b1a-4314-ae48-2279853f4112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:44.795576 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-7003491b-9b1a-4314-ae48-2279853f4112 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:44.904137 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003491b-9b1a-4314-ae48-2279853f4112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:30:44.905598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003491b-9b1a-4314-ae48-2279853f4112 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:30:44.923563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 709/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:30:47.210189 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8aee3-481f-47a2-b74e-bf9784f483fe None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:47.210719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8aee3-481f-47a2-b74e-bf9784f483fe None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:47.210719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8aee3-481f-47a2-b74e-bf9784f483fe None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:47.212080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 747/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 16:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:30:47.217636 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ad7bc-72d5-421d-ac94-3937189ce81e None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:47.218063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ad7bc-72d5-421d-ac94-3937189ce81e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:47.218173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ad7bc-72d5-421d-ac94-3937189ce81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:47.287845 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-262ad7bc-72d5-421d-ac94-3937189ce81e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:47.289102 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-262ad7bc-72d5-421d-ac94-3937189ce81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:47.317363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:47.382871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 710/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 16:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:47.666775 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8aee3-481f-47a2-b74e-bf9784f483fe None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:30:47.668312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-baa8aee3-481f-47a2-b74e-bf9784f483fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:47.770325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8aee3-481f-47a2-b74e-bf9784f483fe None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:30:47.799848 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:47.843822 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8b9b6-678f-4f8e-a8a9-01011ca0dd0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:30:47.844455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8b9b6-678f-4f8e-a8a9-01011ca0dd0a service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:47.844737 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8b9b6-678f-4f8e-a8a9-01011ca0dd0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:47.845006 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8b9b6-678f-4f8e-a8a9-01011ca0dd0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:47.847147 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f1c8b9b6-678f-4f8e-a8a9-01011ca0dd0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:47.954615 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8b9b6-678f-4f8e-a8a9-01011ca0dd0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:30:47.956585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8b9b6-678f-4f8e-a8a9-01011ca0dd0a service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:30:47.974466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 748/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:30:50.178591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ac54f-ec61-457b-b23e-38c5999167de None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:50.179115 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ac54f-ec61-457b-b23e-38c5999167de None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:50.179115 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ac54f-ec61-457b-b23e-38c5999167de None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:50.180394 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 711/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 16:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:30:50.185826 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c62979-a59e-48e8-9710-f50c5c5de5a7 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:50.186259 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c62979-a59e-48e8-9710-f50c5c5de5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:50.186359 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c62979-a59e-48e8-9710-f50c5c5de5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:50.250687 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-18c62979-a59e-48e8-9710-f50c5c5de5a7 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:50.251878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-18c62979-a59e-48e8-9710-f50c5c5de5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:50.260089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:50.348667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 749/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 16:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:50.638931 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ac54f-ec61-457b-b23e-38c5999167de None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:30:50.640501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-906ac54f-ec61-457b-b23e-38c5999167de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:50.742875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ac54f-ec61-457b-b23e-38c5999167de None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:30:50.799947 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:50.819030 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450ff46-af48-432f-8d8d-fb1008a95546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:30:50.819637 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450ff46-af48-432f-8d8d-fb1008a95546 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:50.819917 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450ff46-af48-432f-8d8d-fb1008a95546 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:50.820188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450ff46-af48-432f-8d8d-fb1008a95546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:50.821880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b450ff46-af48-432f-8d8d-fb1008a95546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:51.049635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450ff46-af48-432f-8d8d-fb1008a95546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:30:51.050989 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450ff46-af48-432f-8d8d-fb1008a95546 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:30:51.069608 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 712/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:30:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:30:53.271885 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9213dba-c408-474e-86a5-49ba35c8b703 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:53.272477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9213dba-c408-474e-86a5-49ba35c8b703 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:53.272477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9213dba-c408-474e-86a5-49ba35c8b703 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:53.273818 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 750/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 16:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:30:53.279244 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0611e7-858a-4ea4-ae88-d2f5374458e6 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:53.279678 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0611e7-858a-4ea4-ae88-d2f5374458e6 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:53.279793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0611e7-858a-4ea4-ae88-d2f5374458e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:53.344702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-cc0611e7-858a-4ea4-ae88-d2f5374458e6 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:53.346512 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-cc0611e7-858a-4ea4-ae88-d2f5374458e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:53.383446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:53.440888 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 713/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 16:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:53.734717 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9213dba-c408-474e-86a5-49ba35c8b703 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:30:53.736255 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a9213dba-c408-474e-86a5-49ba35c8b703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:53.838040 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9213dba-c408-474e-86a5-49ba35c8b703 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:30:53.875872 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:53.911446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee8ba8-8a8a-4b0a-a5f9-9ff1082924b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:30:53.912049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee8ba8-8a8a-4b0a-a5f9-9ff1082924b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:53.912327 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee8ba8-8a8a-4b0a-a5f9-9ff1082924b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:53.912632 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee8ba8-8a8a-4b0a-a5f9-9ff1082924b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:53.914239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-66ee8ba8-8a8a-4b0a-a5f9-9ff1082924b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:54.021146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee8ba8-8a8a-4b0a-a5f9-9ff1082924b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:30:54.022497 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee8ba8-8a8a-4b0a-a5f9-9ff1082924b4 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:30:54.042377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 751/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:30:56.321145 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c9786-706b-4d3a-afb4-f250de8466d4 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:56.321729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c9786-706b-4d3a-afb4-f250de8466d4 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:56.321729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c9786-706b-4d3a-afb4-f250de8466d4 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:56.323148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 714/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 16:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:30:56.328770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6adfba-48bb-400f-a142-5a74603af48d None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:56.329193 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6adfba-48bb-400f-a142-5a74603af48d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:56.329310 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6adfba-48bb-400f-a142-5a74603af48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:56.397352 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-5a6adfba-48bb-400f-a142-5a74603af48d None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:56.398553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5a6adfba-48bb-400f-a142-5a74603af48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:56.416271 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:56.501473 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 752/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 16:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:56.826695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c9786-706b-4d3a-afb4-f250de8466d4 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:30:56.828471 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ba4c9786-706b-4d3a-afb4-f250de8466d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:56.932852 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c9786-706b-4d3a-afb4-f250de8466d4 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:30:57.006563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:57.017010 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d970a70-e4ac-4e79-8dfe-80cfc98f4df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:30:57.017632 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d970a70-e4ac-4e79-8dfe-80cfc98f4df7 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:57.017920 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d970a70-e4ac-4e79-8dfe-80cfc98f4df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:57.018187 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d970a70-e4ac-4e79-8dfe-80cfc98f4df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:57.019810 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-5d970a70-e4ac-4e79-8dfe-80cfc98f4df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:57.128744 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d970a70-e4ac-4e79-8dfe-80cfc98f4df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:30:57.130362 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d970a70-e4ac-4e79-8dfe-80cfc98f4df7 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:30:57.150198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 715/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:30:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:30:59.333301 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b0060-f31a-4288-88a3-7e373532b5e6 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:59.333836 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b0060-f31a-4288-88a3-7e373532b5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:59.333836 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b0060-f31a-4288-88a3-7e373532b5e6 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:59.335182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 753/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 16:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:30:59.340687 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e6086-ed7b-4351-a556-5b0162126302 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:59.341089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e6086-ed7b-4351-a556-5b0162126302 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:59.341238 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e6086-ed7b-4351-a556-5b0162126302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:59.405110 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-378e6086-ed7b-4351-a556-5b0162126302 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:30:59.406306 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-378e6086-ed7b-4351-a556-5b0162126302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:59.455593 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:59.503804 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 716/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 16:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:30:59.794992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b0060-f31a-4288-88a3-7e373532b5e6 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:30:59.796572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-883b0060-f31a-4288-88a3-7e373532b5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:30:59.899625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b0060-f31a-4288-88a3-7e373532b5e6 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:30:59.952154 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:59.981897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f73f05-0f95-440b-9382-c6206fc37be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:30:59.982503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f73f05-0f95-440b-9382-c6206fc37be3 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:30:59.982779 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f73f05-0f95-440b-9382-c6206fc37be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:30:59.983052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f73f05-0f95-440b-9382-c6206fc37be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:30:59.984657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-94f73f05-0f95-440b-9382-c6206fc37be3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:00.093604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f73f05-0f95-440b-9382-c6206fc37be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:31:00.094978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f73f05-0f95-440b-9382-c6206fc37be3 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:31:00.114554 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 754/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:30:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:31:09.501638 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=22 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:31:10.275942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=66 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:31:20.289738 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceede0b-a766-4c9d-9563-00f90c67cdf0 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:20.290286 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceede0b-a766-4c9d-9563-00f90c67cdf0 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:20.290286 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceede0b-a766-4c9d-9563-00f90c67cdf0 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:20.291621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 717/1471] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:31:20.296901 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e99fb-31b4-4416-a353-25e1bb0a8fda None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:20.297313 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e99fb-31b4-4416-a353-25e1bb0a8fda None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:20.297439 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e99fb-31b4-4416-a353-25e1bb0a8fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:20.363154 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d10e99fb-31b4-4416-a353-25e1bb0a8fda None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:31:20.364393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d10e99fb-31b4-4416-a353-25e1bb0a8fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:20.459900 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 755/1472] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:31:20.756748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c0807-0ff7-4858-91f6-0e904124acd9 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:20.757031 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c0807-0ff7-4858-91f6-0e904124acd9 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:20.757308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c0807-0ff7-4858-91f6-0e904124acd9 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:20.758624 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 718/1473] 10.222.0.26 () {54 vars in 962 bytes} [Tue Sep 27 16:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:31:20.763674 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55811b-44d1-4e1d-a20b-fc8262cfae49 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:20.765801 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55811b-44d1-4e1d-a20b-fc8262cfae49 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:20.765801 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55811b-44d1-4e1d-a20b-fc8262cfae49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:20.842096 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ae55811b-44d1-4e1d-a20b-fc8262cfae49 None None] MFA Rules not processed for user `e15cb1d012934ebeac53af885ca65f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:31:20.843420 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ae55811b-44d1-4e1d-a20b-fc8262cfae49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:20.863698 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:31:20.919053 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 756/1474] 10.222.0.26 () {58 vars in 1059 bytes} [Tue Sep 27 16:31:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:31:20.927059 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c0807-0ff7-4858-91f6-0e904124acd9 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:31:20.928601 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6b6c0807-0ff7-4858-91f6-0e904124acd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:21.030626 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c0807-0ff7-4858-91f6-0e904124acd9 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:31:21.102206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d755c-3953-4a50-9cd6-0e9c864afd29 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e15cb1d012934ebeac53af885ca65f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:31:21.102804 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d755c-3953-4a50-9cd6-0e9c864afd29 service glance] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:21.103080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d755c-3953-4a50-9cd6-0e9c864afd29 service glance] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:21.103348 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d755c-3953-4a50-9cd6-0e9c864afd29 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:21.104949 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-9a4d755c-3953-4a50-9cd6-0e9c864afd29 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:21.158754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:31:21.212819 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d755c-3953-4a50-9cd6-0e9c864afd29 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:31:21.214255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d755c-3953-4a50-9cd6-0e9c864afd29 service glance] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:31:21.231972 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 719/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:31:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:31:23.462286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf4659-c54a-4419-b35c-0bdd632701fa None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:23.462860 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf4659-c54a-4419-b35c-0bdd632701fa None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:23.462860 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf4659-c54a-4419-b35c-0bdd632701fa None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:23.464180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 757/1476] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:31:23.469456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd9e0d-d3d6-4082-aaa6-479a3aee47d5 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:23.469922 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd9e0d-d3d6-4082-aaa6-479a3aee47d5 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:23.470114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd9e0d-d3d6-4082-aaa6-479a3aee47d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:23.535519 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-2fcd9e0d-d3d6-4082-aaa6-479a3aee47d5 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:31:23.536787 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-2fcd9e0d-d3d6-4082-aaa6-479a3aee47d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:23.631670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 720/1477] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:31:23.908995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf4659-c54a-4419-b35c-0bdd632701fa None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:31:23.915706 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1cbf4659-c54a-4419-b35c-0bdd632701fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:24.034956 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf4659-c54a-4419-b35c-0bdd632701fa None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:31:24.084999 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:31:24.127989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad84e93-fc0d-4058-bbee-9d1e7618b557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:31:24.128620 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad84e93-fc0d-4058-bbee-9d1e7618b557 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:24.128896 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad84e93-fc0d-4058-bbee-9d1e7618b557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:24.129166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad84e93-fc0d-4058-bbee-9d1e7618b557 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:24.129788 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad84e93-fc0d-4058-bbee-9d1e7618b557 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:31:24.131511 dv-cinder-855060-2-smb devstack@keystone.service[81631]: WARNING py.warnings [None req-aad84e93-fc0d-4058-bbee-9d1e7618b557 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 16:31:24.131511 dv-cinder-855060-2-smb devstack@keystone.service[81631]: warnings.warn(msg) Sep 27 16:31:24.131511 dv-cinder-855060-2-smb devstack@keystone.service[81631]: Sep 27 16:31:24.132725 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad84e93-fc0d-4058-bbee-9d1e7618b557 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:31:24.151900 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 758/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 27 16:31:23 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:31:26.295195 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbffff-c0a7-4cac-bb56-6749a9f61cd7 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:26.295728 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbffff-c0a7-4cac-bb56-6749a9f61cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:26.295728 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbffff-c0a7-4cac-bb56-6749a9f61cd7 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:26.297150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 721/1479] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:31:26.303076 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d43c7-7556-4aa8-a782-96453eb2b32b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:26.303516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d43c7-7556-4aa8-a782-96453eb2b32b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:26.303615 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d43c7-7556-4aa8-a782-96453eb2b32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:26.369610 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-005d43c7-7556-4aa8-a782-96453eb2b32b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:31:26.370838 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-005d43c7-7556-4aa8-a782-96453eb2b32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:26.466419 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 759/1480] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:31:26.758620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbffff-c0a7-4cac-bb56-6749a9f61cd7 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:31:26.760173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-cddbffff-c0a7-4cac-bb56-6749a9f61cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:26.770110 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:31:26.903914 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbffff-c0a7-4cac-bb56-6749a9f61cd7 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:31:26.983127 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:31:27.015188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56af3d6-237a-42b2-8cfa-949f07cb42f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:31:27.015735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af3d6-237a-42b2-8cfa-949f07cb42f9 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:27.016018 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af3d6-237a-42b2-8cfa-949f07cb42f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:27.016294 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af3d6-237a-42b2-8cfa-949f07cb42f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:27.019106 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b56af3d6-237a-42b2-8cfa-949f07cb42f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:27.108314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56af3d6-237a-42b2-8cfa-949f07cb42f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:31:27.109974 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56af3d6-237a-42b2-8cfa-949f07cb42f9 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:31:27.127507 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 722/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:31:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:31:29.460837 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43877d-84d6-4ece-8e0d-db3696e054d8 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:29.461427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43877d-84d6-4ece-8e0d-db3696e054d8 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:29.461427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43877d-84d6-4ece-8e0d-db3696e054d8 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:29.462724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 760/1482] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:31:29.467999 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac31924-02d3-42ec-a2d0-2bf9d9117ac0 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:29.468455 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac31924-02d3-42ec-a2d0-2bf9d9117ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:29.468561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac31924-02d3-42ec-a2d0-2bf9d9117ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:29.533542 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-7ac31924-02d3-42ec-a2d0-2bf9d9117ac0 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:31:29.534775 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-7ac31924-02d3-42ec-a2d0-2bf9d9117ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:29.580786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:31:29.630757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 723/1483] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:31:29.916627 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43877d-84d6-4ece-8e0d-db3696e054d8 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:31:29.918155 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3e43877d-84d6-4ece-8e0d-db3696e054d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:29.941957 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:31:30.021705 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43877d-84d6-4ece-8e0d-db3696e054d8 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:31:30.095704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985091a-9691-449a-b42b-a3167016658d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:31:30.096250 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985091a-9691-449a-b42b-a3167016658d service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:30.096566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985091a-9691-449a-b42b-a3167016658d service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:30.096842 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985091a-9691-449a-b42b-a3167016658d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:30.098435 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3985091a-9691-449a-b42b-a3167016658d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:30.172419 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:31:30.206881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985091a-9691-449a-b42b-a3167016658d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:31:30.208356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985091a-9691-449a-b42b-a3167016658d service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:31:30.226570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 761/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:31:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:31:32.401593 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e828797-e6d2-4357-99fb-9fd45ad31bcc None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:32.402214 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e828797-e6d2-4357-99fb-9fd45ad31bcc None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:32.402214 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e828797-e6d2-4357-99fb-9fd45ad31bcc None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:32.403455 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 724/1485] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:31:32.408718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec46070-daa9-4359-8bd0-fbc87e955726 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:32.409176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec46070-daa9-4359-8bd0-fbc87e955726 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:32.409297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec46070-daa9-4359-8bd0-fbc87e955726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:32.474733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-2ec46070-daa9-4359-8bd0-fbc87e955726 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:31:32.475937 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2ec46070-daa9-4359-8bd0-fbc87e955726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:32.571430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 762/1486] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:31:32.858608 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e828797-e6d2-4357-99fb-9fd45ad31bcc None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:31:32.860145 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-2e828797-e6d2-4357-99fb-9fd45ad31bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:32.961753 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e828797-e6d2-4357-99fb-9fd45ad31bcc None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:31:33.031682 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:31:33.033177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe9dd9-64da-491d-922e-55be023df301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:31:33.033880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe9dd9-64da-491d-922e-55be023df301 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:33.034166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe9dd9-64da-491d-922e-55be023df301 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:33.034439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe9dd9-64da-491d-922e-55be023df301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:33.036026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-efbe9dd9-64da-491d-922e-55be023df301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:33.143614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe9dd9-64da-491d-922e-55be023df301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:31:33.144971 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe9dd9-64da-491d-922e-55be023df301 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:31:33.162125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 725/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:31:35.444744 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560147c4-83c2-4571-bdd4-ed99842b9291 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:35.445306 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560147c4-83c2-4571-bdd4-ed99842b9291 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:35.445306 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560147c4-83c2-4571-bdd4-ed99842b9291 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:35.446808 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 763/1488] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:31:35.451866 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef5054-3f29-4619-bf99-bcc3aa4f648e None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:35.452312 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef5054-3f29-4619-bf99-bcc3aa4f648e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:35.452462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef5054-3f29-4619-bf99-bcc3aa4f648e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:35.516825 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-b3ef5054-3f29-4619-bf99-bcc3aa4f648e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:31:35.521296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b3ef5054-3f29-4619-bf99-bcc3aa4f648e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:35.571117 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:31:35.614554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 726/1489] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:31:35.906064 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560147c4-83c2-4571-bdd4-ed99842b9291 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:31:35.907588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-560147c4-83c2-4571-bdd4-ed99842b9291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:35.944467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:31:36.012559 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560147c4-83c2-4571-bdd4-ed99842b9291 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:31:36.085605 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a1cd0-4f79-4fd8-9e5e-9fa88d5d499c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:31:36.086295 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a1cd0-4f79-4fd8-9e5e-9fa88d5d499c service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:36.086575 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a1cd0-4f79-4fd8-9e5e-9fa88d5d499c service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:36.086848 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a1cd0-4f79-4fd8-9e5e-9fa88d5d499c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:36.088469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-069a1cd0-4f79-4fd8-9e5e-9fa88d5d499c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:36.168663 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:31:36.198000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a1cd0-4f79-4fd8-9e5e-9fa88d5d499c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:31:36.199414 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a1cd0-4f79-4fd8-9e5e-9fa88d5d499c service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:31:36.217515 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 764/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:31:38.729252 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3a114-5095-4122-b893-a2c4ce54c7f4 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:38.729776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3a114-5095-4122-b893-a2c4ce54c7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:38.729895 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3a114-5095-4122-b893-a2c4ce54c7f4 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:38.731143 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 727/1491] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 27 16:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:31:38.736370 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc597cac-ec7a-4bea-8e6a-05f42241880b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:38.736836 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc597cac-ec7a-4bea-8e6a-05f42241880b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:38.736978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc597cac-ec7a-4bea-8e6a-05f42241880b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:38.803100 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-dc597cac-ec7a-4bea-8e6a-05f42241880b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:31:38.804315 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-dc597cac-ec7a-4bea-8e6a-05f42241880b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:38.899699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 765/1492] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 27 16:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:31:39.191292 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3a114-5095-4122-b893-a2c4ce54c7f4 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:31:39.192921 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-edb3a114-5095-4122-b893-a2c4ce54c7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:39.295269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3a114-5095-4122-b893-a2c4ce54c7f4 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:31:39.370115 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e5e3c-a0c4-4dbb-8c2f-541465f08246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:31:39.370715 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e5e3c-a0c4-4dbb-8c2f-541465f08246 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:31:39.370991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e5e3c-a0c4-4dbb-8c2f-541465f08246 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:31:39.371256 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e5e3c-a0c4-4dbb-8c2f-541465f08246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:31:39.372865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-754e5e3c-a0c4-4dbb-8c2f-541465f08246 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:31:39.381363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:31:39.484510 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e5e3c-a0c4-4dbb-8c2f-541465f08246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:31:39.485948 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e5e3c-a0c4-4dbb-8c2f-541465f08246 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:31:39.504406 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 728/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:31:48.898172 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=82 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:31:49.502089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=50 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:33:00.675073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788e07c-e572-4cef-a126-647f5e16252b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:33:00.675636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788e07c-e572-4cef-a126-647f5e16252b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:33:00.675636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788e07c-e572-4cef-a126-647f5e16252b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:33:00.752637 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9788e07c-e572-4cef-a126-647f5e16252b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:33:00.759886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9788e07c-e572-4cef-a126-647f5e16252b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:33:00.850892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 766/1494] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:33:00.858975 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3d906-11d2-4116-a44a-3e06087dd34e None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:33:00.859451 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3d906-11d2-4116-a44a-3e06087dd34e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:33:00.859549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3d906-11d2-4116-a44a-3e06087dd34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:33:00.934416 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-44a3d906-11d2-4116-a44a-3e06087dd34e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:33:00.935622 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-44a3d906-11d2-4116-a44a-3e06087dd34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:33:01.032552 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 729/1495] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:33:01.037151 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788e07c-e572-4cef-a126-647f5e16252b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:33:01.038871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9788e07c-e572-4cef-a126-647f5e16252b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:33:01.050491 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788e07c-e572-4cef-a126-647f5e16252b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:33:01.111401 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:33:01.145670 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682222d-b44e-46d9-b860-1bb9a9222518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:33:01.146267 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682222d-b44e-46d9-b860-1bb9a9222518 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:33:01.146542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682222d-b44e-46d9-b860-1bb9a9222518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:33:01.146813 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682222d-b44e-46d9-b860-1bb9a9222518 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:33:01.147550 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682222d-b44e-46d9-b860-1bb9a9222518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:33:01.147852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682222d-b44e-46d9-b860-1bb9a9222518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:33:01.148891 dv-cinder-855060-2-smb devstack@keystone.service[81631]: WARNING py.warnings [None req-1682222d-b44e-46d9-b860-1bb9a9222518 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 16:33:01.148891 dv-cinder-855060-2-smb devstack@keystone.service[81631]: warnings.warn(msg) Sep 27 16:33:01.148891 dv-cinder-855060-2-smb devstack@keystone.service[81631]: Sep 27 16:33:01.149762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682222d-b44e-46d9-b860-1bb9a9222518 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:33:01.160985 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 767/1496] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:33:01.169774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3d906-11d2-4116-a44a-3e06087dd34e None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:33:01.179900 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3d906-11d2-4116-a44a-3e06087dd34e None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:33:01.239876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:33:01.273317 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd4174-5654-4819-977f-3f1fa551dffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:33:01.273949 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4174-5654-4819-977f-3f1fa551dffc admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:33:01.274250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4174-5654-4819-977f-3f1fa551dffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:33:01.274524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4174-5654-4819-977f-3f1fa551dffc admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:33:01.275163 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd4174-5654-4819-977f-3f1fa551dffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:33:01.276943 dv-cinder-855060-2-smb devstack@keystone.service[81630]: WARNING py.warnings [None req-87dd4174-5654-4819-977f-3f1fa551dffc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 16:33:01.276943 dv-cinder-855060-2-smb devstack@keystone.service[81630]: warnings.warn(msg) Sep 27 16:33:01.276943 dv-cinder-855060-2-smb devstack@keystone.service[81630]: Sep 27 16:33:01.278141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd4174-5654-4819-977f-3f1fa551dffc admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:33:01.429575 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 730/1497] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:33:01 2022] POST /identity/v3/projects => generated 379 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:33:01.433875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682222d-b44e-46d9-b860-1bb9a9222518 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:33:01.435368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1682222d-b44e-46d9-b860-1bb9a9222518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:33:01.469123 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682222d-b44e-46d9-b860-1bb9a9222518 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:33:01.560987 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae82f8e-68b2-4af1-8772-f5630c3affc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:33:01.561585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae82f8e-68b2-4af1-8772-f5630c3affc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:33:01.561862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae82f8e-68b2-4af1-8772-f5630c3affc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:33:01.562135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae82f8e-68b2-4af1-8772-f5630c3affc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:33:01.562763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae82f8e-68b2-4af1-8772-f5630c3affc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:33:01.563768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: WARNING py.warnings [None req-7ae82f8e-68b2-4af1-8772-f5630c3affc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 16:33:01.563768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: warnings.warn(msg) Sep 27 16:33:01.563768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: Sep 27 16:33:01.564990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae82f8e-68b2-4af1-8772-f5630c3affc0 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:33:01.682220 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 768/1498] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:33:01 2022] POST /identity/v3/users => generated 290 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:33:01.686373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd4174-5654-4819-977f-3f1fa551dffc admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:33:01.687880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-87dd4174-5654-4819-977f-3f1fa551dffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:33:01.751814 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd4174-5654-4819-977f-3f1fa551dffc admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:33:01.839207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:33:01.848959 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375af07-8ba1-4ec3-b3ff-f431a3573fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:33:01.851381 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375af07-8ba1-4ec3-b3ff-f431a3573fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:33:01.851381 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375af07-8ba1-4ec3-b3ff-f431a3573fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:33:01.851381 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375af07-8ba1-4ec3-b3ff-f431a3573fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:33:01.851381 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375af07-8ba1-4ec3-b3ff-f431a3573fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:33:01.851949 dv-cinder-855060-2-smb devstack@keystone.service[81630]: WARNING py.warnings [None req-f375af07-8ba1-4ec3-b3ff-f431a3573fa9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 16:33:01.851949 dv-cinder-855060-2-smb devstack@keystone.service[81630]: warnings.warn(msg) Sep 27 16:33:01.851949 dv-cinder-855060-2-smb devstack@keystone.service[81630]: Sep 27 16:33:01.852607 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375af07-8ba1-4ec3-b3ff-f431a3573fa9 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:33:01.865210 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 731/1499] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:33:01.869258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae82f8e-68b2-4af1-8772-f5630c3affc0 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:33:01.870799 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7ae82f8e-68b2-4af1-8772-f5630c3affc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:33:01.882574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae82f8e-68b2-4af1-8772-f5630c3affc0 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:33:01.907514 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:33:01.975677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f584c-b13d-45cc-be81-a1d72e51bc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:33:01.976282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f584c-b13d-45cc-be81-a1d72e51bc5c admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:33:01.976589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f584c-b13d-45cc-be81-a1d72e51bc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:33:01.976865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f584c-b13d-45cc-be81-a1d72e51bc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:33:01.977588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f584c-b13d-45cc-be81-a1d72e51bc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:33:01.978907 dv-cinder-855060-2-smb devstack@keystone.service[81631]: WARNING py.warnings [None req-393f584c-b13d-45cc-be81-a1d72e51bc5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 16:33:01.978907 dv-cinder-855060-2-smb devstack@keystone.service[81631]: warnings.warn(msg) Sep 27 16:33:01.978907 dv-cinder-855060-2-smb devstack@keystone.service[81631]: Sep 27 16:33:01.979794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f584c-b13d-45cc-be81-a1d72e51bc5c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:33:01.993075 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 769/1500] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:33:01.997216 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375af07-8ba1-4ec3-b3ff-f431a3573fa9 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:33:01.998793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f375af07-8ba1-4ec3-b3ff-f431a3573fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:33:02.032053 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375af07-8ba1-4ec3-b3ff-f431a3573fa9 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:33:02.129007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d47d57-73ee-43fb-b1e0-0551028a968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:33:02.129671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d47d57-73ee-43fb-b1e0-0551028a968f admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:33:02.129950 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d47d57-73ee-43fb-b1e0-0551028a968f admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:33:02.130224 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d47d57-73ee-43fb-b1e0-0551028a968f admin admin] PATH_INFO: `/v3/projects/903a65c4443c48b1893e5ff010f84d9a/users/8d26e620278d476d91ca42f35d82a509/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:33:02.152861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d47d57-73ee-43fb-b1e0-0551028a968f admin admin] RBAC: Authorizing `identity:create_grant(project_id=903a65c4443c48b1893e5ff010f84d9a, user_id=8d26e620278d476d91ca42f35d82a509, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:33:02.153905 dv-cinder-855060-2-smb devstack@keystone.service[81630]: WARNING py.warnings [None req-e2d47d57-73ee-43fb-b1e0-0551028a968f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 16:33:02.153905 dv-cinder-855060-2-smb devstack@keystone.service[81630]: warnings.warn(msg) Sep 27 16:33:02.153905 dv-cinder-855060-2-smb devstack@keystone.service[81630]: Sep 27 16:33:02.155845 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d47d57-73ee-43fb-b1e0-0551028a968f admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:33:02.261479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 732/1501] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:33:01 2022] PUT /identity/v3/projects/903a65c4443c48b1893e5ff010f84d9a/users/8d26e620278d476d91ca42f35d82a509/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:33:02.280321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15591909-e94a-4184-9a85-7fd3c32f3e6d None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:33:02.280674 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15591909-e94a-4184-9a85-7fd3c32f3e6d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:33:02.280950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15591909-e94a-4184-9a85-7fd3c32f3e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:33:02.337630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-15591909-e94a-4184-9a85-7fd3c32f3e6d None None] MFA Rules not processed for user `8d26e620278d476d91ca42f35d82a509`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:33:02.338845 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-15591909-e94a-4184-9a85-7fd3c32f3e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:33:02.418993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 770/1502] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:33:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:33:02.432441 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a78dfe-cebd-4d7f-9554-1e5df22776fb None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:33:02.432729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a78dfe-cebd-4d7f-9554-1e5df22776fb None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:33:02.433003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a78dfe-cebd-4d7f-9554-1e5df22776fb None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:33:02.434315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 733/1503] 10.222.0.26 () {54 vars in 963 bytes} [Tue Sep 27 16:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:33:02.439139 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577aa60-1ae3-490d-b4a9-3e6a0f346e4d None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:33:02.439425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577aa60-1ae3-490d-b4a9-3e6a0f346e4d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:33:02.439702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577aa60-1ae3-490d-b4a9-3e6a0f346e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:33:02.471448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:33:02.517340 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-8577aa60-1ae3-490d-b4a9-3e6a0f346e4d None None] MFA Rules not processed for user `edca8115256546ee8a209f1eca99d972`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:33:02.518512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8577aa60-1ae3-490d-b4a9-3e6a0f346e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:33:02.594244 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 771/1504] 10.222.0.26 () {58 vars in 1060 bytes} [Tue Sep 27 16:33:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:33:02.601925 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a78dfe-cebd-4d7f-9554-1e5df22776fb None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:33:02.603513 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-64a78dfe-cebd-4d7f-9554-1e5df22776fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:33:02.652292 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:33:02.705108 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a78dfe-cebd-4d7f-9554-1e5df22776fb None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:33:02.778023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203a3a5-082b-44cf-9d88-5584d35efe6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:33:02.778550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203a3a5-082b-44cf-9d88-5584d35efe6c service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:33:02.778834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203a3a5-082b-44cf-9d88-5584d35efe6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:33:02.779104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203a3a5-082b-44cf-9d88-5584d35efe6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:33:02.780721 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-2203a3a5-082b-44cf-9d88-5584d35efe6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:33:02.878746 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203a3a5-082b-44cf-9d88-5584d35efe6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:33:02.880181 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203a3a5-082b-44cf-9d88-5584d35efe6c service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:33:02.884264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:33:02.898114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 734/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:33:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:33:02.943389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f72654-b427-4aab-9b1f-b7581d40741b None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:33:02.944399 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f72654-b427-4aab-9b1f-b7581d40741b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:33:02.944523 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f72654-b427-4aab-9b1f-b7581d40741b None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:33:02.945762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 772/1506] 10.222.0.26 () {52 vars in 830 bytes} [Tue Sep 27 16:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:33:02.949383 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203a3a5-082b-44cf-9d88-5584d35efe6c service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:33:02.950578 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-2203a3a5-082b-44cf-9d88-5584d35efe6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:33:03.047865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203a3a5-082b-44cf-9d88-5584d35efe6c service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:33:03.140762 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270b211-bdae-4202-b9a8-704190ec0056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:33:03.141401 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270b211-bdae-4202-b9a8-704190ec0056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:33:03.141682 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270b211-bdae-4202-b9a8-704190ec0056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:33:03.141957 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270b211-bdae-4202-b9a8-704190ec0056 admin admin] PATH_INFO: `/v3/users/8d26e620278d476d91ca42f35d82a509` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:33:03.155862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270b211-bdae-4202-b9a8-704190ec0056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d26e620278d476d91ca42f35d82a509)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:33:03.156943 dv-cinder-855060-2-smb devstack@keystone.service[81630]: WARNING py.warnings [None req-2270b211-bdae-4202-b9a8-704190ec0056 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 16:33:03.156943 dv-cinder-855060-2-smb devstack@keystone.service[81630]: warnings.warn(msg) Sep 27 16:33:03.156943 dv-cinder-855060-2-smb devstack@keystone.service[81630]: Sep 27 16:33:03.158156 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270b211-bdae-4202-b9a8-704190ec0056 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:33:03.167714 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:33:03.396683 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2270b211-bdae-4202-b9a8-704190ec0056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d26e620278d476d91ca42f35d82a509'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:33:03.397079 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2270b211-bdae-4202-b9a8-704190ec0056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d26e620278d476d91ca42f35d82a509'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:33:03.419661 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2270b211-bdae-4202-b9a8-704190ec0056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d26e620278d476d91ca42f35d82a509'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:33:03.509612 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2270b211-bdae-4202-b9a8-704190ec0056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d26e620278d476d91ca42f35d82a509'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:33:03.510141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2270b211-bdae-4202-b9a8-704190ec0056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d26e620278d476d91ca42f35d82a509'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:33:03.530279 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 735/1507] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:33:02 2022] DELETE /identity/v3/users/8d26e620278d476d91ca42f35d82a509 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:33:03.534844 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6aee1-0efb-447b-89a7-5b5eab334978 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:33:03.535161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6aee1-0efb-447b-89a7-5b5eab334978 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:33:03.535439 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6aee1-0efb-447b-89a7-5b5eab334978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:33:03.591983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-fdc6aee1-0efb-447b-89a7-5b5eab334978 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:33:03.593204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-fdc6aee1-0efb-447b-89a7-5b5eab334978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:33:03.667292 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:33:03.679747 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 773/1508] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:33:03.689515 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270b211-bdae-4202-b9a8-704190ec0056 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:33:03.690707 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-2270b211-bdae-4202-b9a8-704190ec0056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:33:03.796193 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270b211-bdae-4202-b9a8-704190ec0056 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:33:03.850665 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:33:03.869956 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42319556-3ac6-495b-8257-e5c8411d5406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:33:03.870560 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42319556-3ac6-495b-8257-e5c8411d5406 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:33:03.870832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42319556-3ac6-495b-8257-e5c8411d5406 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:33:03.871094 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42319556-3ac6-495b-8257-e5c8411d5406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:33:03.872693 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-42319556-3ac6-495b-8257-e5c8411d5406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:33:03.980861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42319556-3ac6-495b-8257-e5c8411d5406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:33:03.982284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42319556-3ac6-495b-8257-e5c8411d5406 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:33:04.000702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 736/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:33:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:33:04.525187 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6aee1-0efb-447b-89a7-5b5eab334978 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:33:04.526432 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-fdc6aee1-0efb-447b-89a7-5b5eab334978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:33:04.540328 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6aee1-0efb-447b-89a7-5b5eab334978 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:33:04.635587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18f8cc-5b62-48f2-b91a-0e5c2399a637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:33:04.636309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f8cc-5b62-48f2-b91a-0e5c2399a637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:33:04.636615 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f8cc-5b62-48f2-b91a-0e5c2399a637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:33:04.636886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f8cc-5b62-48f2-b91a-0e5c2399a637 admin admin] PATH_INFO: `/v3/projects/903a65c4443c48b1893e5ff010f84d9a` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:33:04.646508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18f8cc-5b62-48f2-b91a-0e5c2399a637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=903a65c4443c48b1893e5ff010f84d9a)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:33:04.648047 dv-cinder-855060-2-smb devstack@keystone.service[81631]: WARNING py.warnings [None req-3e18f8cc-5b62-48f2-b91a-0e5c2399a637 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 16:33:04.648047 dv-cinder-855060-2-smb devstack@keystone.service[81631]: warnings.warn(msg) Sep 27 16:33:04.648047 dv-cinder-855060-2-smb devstack@keystone.service[81631]: Sep 27 16:33:04.649256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18f8cc-5b62-48f2-b91a-0e5c2399a637 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:33:04.772631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3e18f8cc-5b62-48f2-b91a-0e5c2399a637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903a65c4443c48b1893e5ff010f84d9a', 'request_id': 'req-3e18f8cc-5b62-48f2-b91a-0e5c2399a637'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:33:04.788453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3e18f8cc-5b62-48f2-b91a-0e5c2399a637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903a65c4443c48b1893e5ff010f84d9a', 'request_id': 'req-3e18f8cc-5b62-48f2-b91a-0e5c2399a637'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:33:04.889926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3e18f8cc-5b62-48f2-b91a-0e5c2399a637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903a65c4443c48b1893e5ff010f84d9a', 'request_id': 'req-3e18f8cc-5b62-48f2-b91a-0e5c2399a637'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:33:04.913629 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3e18f8cc-5b62-48f2-b91a-0e5c2399a637 admin admin] The token cache is being invalidate because project 903a65c4443c48b1893e5ff010f84d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:33:04.913919 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3e18f8cc-5b62-48f2-b91a-0e5c2399a637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:33:04.914343 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3e18f8cc-5b62-48f2-b91a-0e5c2399a637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:33:04.915737 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 774/1510] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:33:04 2022] DELETE /identity/v3/projects/903a65c4443c48b1893e5ff010f84d9a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:33:13.998516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=62 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:33:14.910905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:34:40.330951 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbfc73-d4e2-456f-bcb1-e0550944028d None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:40.331537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbfc73-d4e2-456f-bcb1-e0550944028d None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:40.331537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbfc73-d4e2-456f-bcb1-e0550944028d None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:40.332946 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 737/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 16:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:34:40.337804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4e424-0dea-4639-9f8f-bedde48f4ce3 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:40.338259 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4e424-0dea-4639-9f8f-bedde48f4ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:40.338367 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4e424-0dea-4639-9f8f-bedde48f4ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:40.417877 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-69f4e424-0dea-4639-9f8f-bedde48f4ce3 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:34:40.419083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-69f4e424-0dea-4639-9f8f-bedde48f4ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:34:40.521104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 775/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 16:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:34:40.672292 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbfc73-d4e2-456f-bcb1-e0550944028d None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:34:40.674407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-69cbfc73-d4e2-456f-bcb1-e0550944028d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:34:40.792987 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbfc73-d4e2-456f-bcb1-e0550944028d None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:34:40.798753 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26c387-4be5-45ee-a169-0dd3909faf27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:34:40.799357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26c387-4be5-45ee-a169-0dd3909faf27 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:40.799696 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26c387-4be5-45ee-a169-0dd3909faf27 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:40.800223 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26c387-4be5-45ee-a169-0dd3909faf27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:40.809486 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26c387-4be5-45ee-a169-0dd3909faf27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:34:40.811101 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26c387-4be5-45ee-a169-0dd3909faf27 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:34:40.820491 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 738/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:34:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:34:41.893755 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab6e10-d3c7-4b24-b052-94c7da6edb90 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:41.894311 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab6e10-d3c7-4b24-b052-94c7da6edb90 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:41.894311 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab6e10-d3c7-4b24-b052-94c7da6edb90 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:41.895646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 776/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 16:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:34:41.902339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eac872-5f83-4945-ad51-93aa887e2e2b None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:41.902775 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eac872-5f83-4945-ad51-93aa887e2e2b None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:41.902885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eac872-5f83-4945-ad51-93aa887e2e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:41.922805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-67eac872-5f83-4945-ad51-93aa887e2e2b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:34:41.924019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-67eac872-5f83-4945-ad51-93aa887e2e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:34:41.932242 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 739/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 16:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:34:42.086307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab6e10-d3c7-4b24-b052-94c7da6edb90 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:34:42.100551 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab6e10-d3c7-4b24-b052-94c7da6edb90 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:34:42.106464 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a7018-0287-4b41-807e-4465c1429e97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:34:42.107051 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a7018-0287-4b41-807e-4465c1429e97 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:42.107328 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a7018-0287-4b41-807e-4465c1429e97 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:42.107599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a7018-0287-4b41-807e-4465c1429e97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:42.115514 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a7018-0287-4b41-807e-4465c1429e97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:34:42.117216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a7018-0287-4b41-807e-4465c1429e97 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:34:42.126530 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 777/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:34:42.260231 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ff279-8b19-4ad9-8230-a82d50ad0d6b None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:42.260589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ff279-8b19-4ad9-8230-a82d50ad0d6b None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:42.260862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ff279-8b19-4ad9-8230-a82d50ad0d6b None None] PATH_INFO: `/v3` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:42.262349 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 740/1517] 10.222.0.52 () {54 vars in 925 bytes} [Tue Sep 27 16:34:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:34:42.269278 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd4bed-4bbd-41cd-8a07-de192a265521 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:42.269560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd4bed-4bbd-41cd-8a07-de192a265521 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:42.269829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd4bed-4bbd-41cd-8a07-de192a265521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:42.329676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d0dd4bed-4bbd-41cd-8a07-de192a265521 None None] MFA Rules not processed for user `5deb7370bc3045c5be2d391d3b1dbd82`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:34:42.330879 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d0dd4bed-4bbd-41cd-8a07-de192a265521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:34:42.347822 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:34:42.401460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 778/1518] 10.222.0.52 () {58 vars in 1015 bytes} [Tue Sep 27 16:34:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:34:51.725906 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb8035-18bf-4f7f-82d7-d5fb9e801c3a None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:51.726410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb8035-18bf-4f7f-82d7-d5fb9e801c3a None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:51.726520 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb8035-18bf-4f7f-82d7-d5fb9e801c3a None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:51.728456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 741/1519] 10.222.0.26 () {54 vars in 961 bytes} [Tue Sep 27 16:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:34:51.733622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097a96a-7e8a-4d38-9219-7104664c73b7 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:51.734056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097a96a-7e8a-4d38-9219-7104664c73b7 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:51.734170 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097a96a-7e8a-4d38-9219-7104664c73b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:51.754279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c097a96a-7e8a-4d38-9219-7104664c73b7 None None] MFA Rules not processed for user `5deb7370bc3045c5be2d391d3b1dbd82`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:34:51.755009 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c097a96a-7e8a-4d38-9219-7104664c73b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:34:51.763656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 779/1520] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Sep 27 16:34:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:34:51.771356 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb8035-18bf-4f7f-82d7-d5fb9e801c3a None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:34:51.785379 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb8035-18bf-4f7f-82d7-d5fb9e801c3a None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:34:51.790963 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b5532-316b-43af-afdb-2888f3d3a02c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5deb7370bc3045c5be2d391d3b1dbd82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:34:51.791560 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b5532-316b-43af-afdb-2888f3d3a02c service placement] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:51.791833 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b5532-316b-43af-afdb-2888f3d3a02c service placement] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:51.792100 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b5532-316b-43af-afdb-2888f3d3a02c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:51.800885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b5532-316b-43af-afdb-2888f3d3a02c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:34:51.804027 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b5532-316b-43af-afdb-2888f3d3a02c service placement] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:34:51.812820 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 742/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:34:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:34:53.605768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e727c9-a386-4474-b536-caf201827f64 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:53.606335 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e727c9-a386-4474-b536-caf201827f64 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:53.606335 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e727c9-a386-4474-b536-caf201827f64 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:53.607646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 780/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 16:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:34:53.613775 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170acc74-8126-43d9-bb75-19a22a7028d7 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:53.614206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170acc74-8126-43d9-bb75-19a22a7028d7 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:53.614331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170acc74-8126-43d9-bb75-19a22a7028d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:53.634132 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-170acc74-8126-43d9-bb75-19a22a7028d7 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:34:53.635333 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-170acc74-8126-43d9-bb75-19a22a7028d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:34:53.643115 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 743/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:34:53.796696 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e727c9-a386-4474-b536-caf201827f64 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:34:53.811384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e727c9-a386-4474-b536-caf201827f64 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:34:53.816944 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fec068-d728-4f6f-bb0d-06b87cdc6cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:34:53.817546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fec068-d728-4f6f-bb0d-06b87cdc6cc6 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:53.817827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fec068-d728-4f6f-bb0d-06b87cdc6cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:53.818101 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fec068-d728-4f6f-bb0d-06b87cdc6cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:53.826561 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fec068-d728-4f6f-bb0d-06b87cdc6cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:34:53.828130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fec068-d728-4f6f-bb0d-06b87cdc6cc6 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:34:53.838132 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 781/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:34:54.903719 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb6e82-fec4-4397-94a0-c5c6b1715b1e None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:54.904246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb6e82-fec4-4397-94a0-c5c6b1715b1e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:54.904246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb6e82-fec4-4397-94a0-c5c6b1715b1e None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:54.905587 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 744/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 16:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:34:54.911596 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896d406-f35f-468a-bfa2-ddf2a1866e09 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:54.912042 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896d406-f35f-468a-bfa2-ddf2a1866e09 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:54.912142 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896d406-f35f-468a-bfa2-ddf2a1866e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:54.933620 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b896d406-f35f-468a-bfa2-ddf2a1866e09 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:34:54.934826 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b896d406-f35f-468a-bfa2-ddf2a1866e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:34:54.943031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 782/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 16:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:34:55.096221 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb6e82-fec4-4397-94a0-c5c6b1715b1e None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:34:55.111085 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb6e82-fec4-4397-94a0-c5c6b1715b1e None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:34:55.116486 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe748b1c-d082-4ce3-a48f-1b77e2f412c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:34:55.117096 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe748b1c-d082-4ce3-a48f-1b77e2f412c8 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:55.117394 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe748b1c-d082-4ce3-a48f-1b77e2f412c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:55.118277 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe748b1c-d082-4ce3-a48f-1b77e2f412c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:55.126232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe748b1c-d082-4ce3-a48f-1b77e2f412c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:34:55.127796 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe748b1c-d082-4ce3-a48f-1b77e2f412c8 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:34:55.137384 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 745/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:34:59.035983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c2437-eb30-4f0c-8a69-a84709a6be82 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:59.036577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c2437-eb30-4f0c-8a69-a84709a6be82 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:59.036577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c2437-eb30-4f0c-8a69-a84709a6be82 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:59.037912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 783/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 16:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:34:59.043089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bfcb9-5178-4aab-9036-3717e9bd1148 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:59.046175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bfcb9-5178-4aab-9036-3717e9bd1148 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:59.046175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bfcb9-5178-4aab-9036-3717e9bd1148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:59.063679 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-a55bfcb9-5178-4aab-9036-3717e9bd1148 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:34:59.065008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a55bfcb9-5178-4aab-9036-3717e9bd1148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:34:59.073484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 746/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 16:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:34:59.362307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c2437-eb30-4f0c-8a69-a84709a6be82 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:34:59.364033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c91c2437-eb30-4f0c-8a69-a84709a6be82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:34:59.442640 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c2437-eb30-4f0c-8a69-a84709a6be82 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:34:59.446310 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78806986-02e3-4f55-b00b-8db775ac4ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:34:59.446908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78806986-02e3-4f55-b00b-8db775ac4ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:34:59.447190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78806986-02e3-4f55-b00b-8db775ac4ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:34:59.447468 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78806986-02e3-4f55-b00b-8db775ac4ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:34:59.456507 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78806986-02e3-4f55-b00b-8db775ac4ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:34:59.457948 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78806986-02e3-4f55-b00b-8db775ac4ad7 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:34:59.467852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 784/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:35:01.603918 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18c15d-6f19-42cc-a938-a2cdd70c3350 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:35:01.604544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18c15d-6f19-42cc-a938-a2cdd70c3350 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:35:01.604544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18c15d-6f19-42cc-a938-a2cdd70c3350 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:35:01.605844 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 747/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 16:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:35:01.611190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ef68c-11b2-4561-89f9-ad0728cb5cf6 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:35:01.611636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ef68c-11b2-4561-89f9-ad0728cb5cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:35:01.611761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ef68c-11b2-4561-89f9-ad0728cb5cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:35:01.631465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-5e6ef68c-11b2-4561-89f9-ad0728cb5cf6 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:35:01.632679 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5e6ef68c-11b2-4561-89f9-ad0728cb5cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:35:01.640453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 785/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 16:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:35:01.928244 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18c15d-6f19-42cc-a938-a2cdd70c3350 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:35:01.939469 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18c15d-6f19-42cc-a938-a2cdd70c3350 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:35:01.942871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eff933-1c37-47e0-a315-b16dde69f249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:35:01.943456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eff933-1c37-47e0-a315-b16dde69f249 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:35:01.943729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eff933-1c37-47e0-a315-b16dde69f249 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:35:01.943998 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eff933-1c37-47e0-a315-b16dde69f249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:35:01.952605 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eff933-1c37-47e0-a315-b16dde69f249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:35:01.954014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eff933-1c37-47e0-a315-b16dde69f249 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:35:01.963659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 748/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:35:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:35:05.569349 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88d7f-b59f-4548-9d1d-aba05f82d553 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:35:05.569922 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88d7f-b59f-4548-9d1d-aba05f82d553 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:35:05.569922 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88d7f-b59f-4548-9d1d-aba05f82d553 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:35:05.571258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 786/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 16:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:35:05.576515 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f805924-da86-4eb6-9acd-6a35631556fd None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:35:05.576945 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f805924-da86-4eb6-9acd-6a35631556fd None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:35:05.577062 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f805924-da86-4eb6-9acd-6a35631556fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:35:05.584716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=81 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:35:05.597541 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-1f805924-da86-4eb6-9acd-6a35631556fd None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:35:05.598765 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-1f805924-da86-4eb6-9acd-6a35631556fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:35:05.607252 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 749/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 16:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:35:05.914745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d88d7f-b59f-4548-9d1d-aba05f82d553 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:35:05.916418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f9d88d7f-b59f-4548-9d1d-aba05f82d553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:35:05.981948 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:35:05.995495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d88d7f-b59f-4548-9d1d-aba05f82d553 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:35:05.999074 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb331f64-12bd-4004-acb9-84a376383600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:35:05.999677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb331f64-12bd-4004-acb9-84a376383600 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:35:05.999953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb331f64-12bd-4004-acb9-84a376383600 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:35:06.000222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb331f64-12bd-4004-acb9-84a376383600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:35:06.009655 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb331f64-12bd-4004-acb9-84a376383600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:35:06.011203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb331f64-12bd-4004-acb9-84a376383600 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:35:06.020717 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 787/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:35:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:35:08.155057 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f89535-3df3-4486-910d-f28b7d2332c8 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:35:08.155614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f89535-3df3-4486-910d-f28b7d2332c8 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:35:08.155614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f89535-3df3-4486-910d-f28b7d2332c8 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:35:08.156967 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 750/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 16:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:35:08.162232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3df1b-1963-496d-89ab-e7ed7c37327b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:35:08.162670 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3df1b-1963-496d-89ab-e7ed7c37327b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:35:08.162817 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3df1b-1963-496d-89ab-e7ed7c37327b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:35:08.182978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-acc3df1b-1963-496d-89ab-e7ed7c37327b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:35:08.184169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-acc3df1b-1963-496d-89ab-e7ed7c37327b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:35:08.192077 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 788/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 16:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:35:08.492427 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f89535-3df3-4486-910d-f28b7d2332c8 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:35:08.494148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-01f89535-3df3-4486-910d-f28b7d2332c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:35:08.507369 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f89535-3df3-4486-910d-f28b7d2332c8 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:35:08.511449 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd33c1-46cd-4fe1-a8d0-3531077af9ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:35:08.512041 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd33c1-46cd-4fe1-a8d0-3531077af9ee service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:35:08.512324 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd33c1-46cd-4fe1-a8d0-3531077af9ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:35:08.512618 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd33c1-46cd-4fe1-a8d0-3531077af9ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:35:08.521265 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd33c1-46cd-4fe1-a8d0-3531077af9ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:35:08.522671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd33c1-46cd-4fe1-a8d0-3531077af9ee service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:35:08.532739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 751/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:35:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:35:18.178249 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=11 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:35:18.528421 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=8 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:36.122394 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f623c-69b2-439f-9441-cb88d7276102 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.123043 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f623c-69b2-439f-9441-cb88d7276102 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.123149 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f623c-69b2-439f-9441-cb88d7276102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.149519 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-800f623c-69b2-439f-9441-cb88d7276102 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:36.150738 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-800f623c-69b2-439f-9441-cb88d7276102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:36.163510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 789/1540] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:36.172527 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bf00f-c34f-49e6-8c65-bcde718590e7 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.173107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bf00f-c34f-49e6-8c65-bcde718590e7 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.173107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bf00f-c34f-49e6-8c65-bcde718590e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.199497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-c66bf00f-c34f-49e6-8c65-bcde718590e7 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:36.200986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c66bf00f-c34f-49e6-8c65-bcde718590e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:36.214190 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 752/1541] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:36.220418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f623c-69b2-439f-9441-cb88d7276102 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:36.231442 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f623c-69b2-439f-9441-cb88d7276102 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:36.240233 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a8efa-78cb-40ca-bb7a-c5fba05f9ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:36.241216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a8efa-78cb-40ca-bb7a-c5fba05f9ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.241665 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a8efa-78cb-40ca-bb7a-c5fba05f9ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.242104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a8efa-78cb-40ca-bb7a-c5fba05f9ff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.243383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a8efa-78cb-40ca-bb7a-c5fba05f9ff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:36:36.243893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a8efa-78cb-40ca-bb7a-c5fba05f9ff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:36.245939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a8efa-78cb-40ca-bb7a-c5fba05f9ff8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:36.265752 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 790/1542] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:36:36.274333 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bf00f-c34f-49e6-8c65-bcde718590e7 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:36.288729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bf00f-c34f-49e6-8c65-bcde718590e7 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:36.302368 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46435511-f634-4829-a514-30e6e271583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:36.303016 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46435511-f634-4829-a514-30e6e271583c admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.303294 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46435511-f634-4829-a514-30e6e271583c admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.303565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46435511-f634-4829-a514-30e6e271583c admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.304219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46435511-f634-4829-a514-30e6e271583c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:36.306305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46435511-f634-4829-a514-30e6e271583c admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:36.476899 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 753/1543] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:36:36 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:36.481366 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a8efa-78cb-40ca-bb7a-c5fba05f9ff8 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:36.494621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab610e36-61df-4dd5-9953-f9b201f11393 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.494962 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab610e36-61df-4dd5-9953-f9b201f11393 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.495176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab610e36-61df-4dd5-9953-f9b201f11393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.496251 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a8efa-78cb-40ca-bb7a-c5fba05f9ff8 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:36.528179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-ab610e36-61df-4dd5-9953-f9b201f11393 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:36.529446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ab610e36-61df-4dd5-9953-f9b201f11393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:36.595926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ec6c2-f730-4a81-9e4e-041ca293f83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:36.596574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ec6c2-f730-4a81-9e4e-041ca293f83f admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.596937 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ec6c2-f730-4a81-9e4e-041ca293f83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.597262 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ec6c2-f730-4a81-9e4e-041ca293f83f admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.597904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ec6c2-f730-4a81-9e4e-041ca293f83f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:36.600197 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ec6c2-f730-4a81-9e4e-041ca293f83f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:36.642923 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 754/1544] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:36:36.651750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7d223-2251-488f-a11e-fdbaefea882d None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.652053 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7d223-2251-488f-a11e-fdbaefea882d None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.652305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7d223-2251-488f-a11e-fdbaefea882d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.682275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-f4a7d223-2251-488f-a11e-fdbaefea882d None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:36.683487 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f4a7d223-2251-488f-a11e-fdbaefea882d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:36.694396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 755/1545] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:36:36.695633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f721735-5467-4344-b12d-4b8420c3adf3 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.695917 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f721735-5467-4344-b12d-4b8420c3adf3 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.696189 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f721735-5467-4344-b12d-4b8420c3adf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.713254 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 791/1546] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:36:36 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:36.715121 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfb865-1101-474c-87cf-890f3e1d86c1 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.715408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfb865-1101-474c-87cf-890f3e1d86c1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.715687 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfb865-1101-474c-87cf-890f3e1d86c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.734118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-6f721735-5467-4344-b12d-4b8420c3adf3 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:36.735358 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6f721735-5467-4344-b12d-4b8420c3adf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:36.757835 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 756/1547] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:36.758881 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f721735-5467-4344-b12d-4b8420c3adf3 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:36.760385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-13cfb865-1101-474c-87cf-890f3e1d86c1 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:36.761827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-13cfb865-1101-474c-87cf-890f3e1d86c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:36.775200 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f721735-5467-4344-b12d-4b8420c3adf3 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:36.780714 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 792/1548] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:36.788387 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfb865-1101-474c-87cf-890f3e1d86c1 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:36.788578 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae126e91-a779-4c70-a9f3-7919d27488aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:36.789042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae126e91-a779-4c70-a9f3-7919d27488aa admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.789322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae126e91-a779-4c70-a9f3-7919d27488aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.789595 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae126e91-a779-4c70-a9f3-7919d27488aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.790253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae126e91-a779-4c70-a9f3-7919d27488aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:36:36.790555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae126e91-a779-4c70-a9f3-7919d27488aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:36.791590 dv-cinder-855060-2-smb devstack@keystone.service[81630]: WARNING py.warnings [None req-ae126e91-a779-4c70-a9f3-7919d27488aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 16:36:36.791590 dv-cinder-855060-2-smb devstack@keystone.service[81630]: warnings.warn(msg) Sep 27 16:36:36.791590 dv-cinder-855060-2-smb devstack@keystone.service[81630]: Sep 27 16:36:36.792985 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae126e91-a779-4c70-a9f3-7919d27488aa admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:36.793411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfb865-1101-474c-87cf-890f3e1d86c1 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:36.801996 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f3895-42d6-43d8-a83e-ea61b70ecc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:36.801996 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f3895-42d6-43d8-a83e-ea61b70ecc7f admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.802280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f3895-42d6-43d8-a83e-ea61b70ecc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.802643 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f3895-42d6-43d8-a83e-ea61b70ecc7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.803291 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f3895-42d6-43d8-a83e-ea61b70ecc7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:36.805521 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f3895-42d6-43d8-a83e-ea61b70ecc7f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:36.813076 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 757/1549] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:36:36.813076 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27086a91-3f95-41dc-81bd-71265ffa7073 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.813076 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27086a91-3f95-41dc-81bd-71265ffa7073 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.813076 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27086a91-3f95-41dc-81bd-71265ffa7073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.819925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 793/1550] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:36.821279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d2e60-6c55-433a-9707-11a51525a34f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.821571 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d2e60-6c55-433a-9707-11a51525a34f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.821845 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d2e60-6c55-433a-9707-11a51525a34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.832179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-27086a91-3f95-41dc-81bd-71265ffa7073 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:36.833424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-27086a91-3f95-41dc-81bd-71265ffa7073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:36.841403 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 758/1551] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:36.843107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e3503-3a75-4435-bda2-b1667936cd7c None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.843335 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a78d2e60-6c55-433a-9707-11a51525a34f None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:36.843456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e3503-3a75-4435-bda2-b1667936cd7c None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.843628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e3503-3a75-4435-bda2-b1667936cd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.844519 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a78d2e60-6c55-433a-9707-11a51525a34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:36.855379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 794/1552] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:36.856779 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50ed14-8d2a-4cc6-b756-39352b1d1aaa None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.857063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50ed14-8d2a-4cc6-b756-39352b1d1aaa None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.857335 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50ed14-8d2a-4cc6-b756-39352b1d1aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.865450 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-e93e3503-3a75-4435-bda2-b1667936cd7c None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:36.866637 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-e93e3503-3a75-4435-bda2-b1667936cd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:36.874425 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 759/1553] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:36.875581 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3adda-ae0a-4ce0-b579-1b1465e495bf None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.875861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3adda-ae0a-4ce0-b579-1b1465e495bf None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.876129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3adda-ae0a-4ce0-b579-1b1465e495bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.877771 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-5f50ed14-8d2a-4cc6-b756-39352b1d1aaa None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:36.878988 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5f50ed14-8d2a-4cc6-b756-39352b1d1aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:36.887089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 795/1554] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:36.887846 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50ed14-8d2a-4cc6-b756-39352b1d1aaa None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:36.895462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-2cb3adda-ae0a-4ce0-b579-1b1465e495bf None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:36.896761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-2cb3adda-ae0a-4ce0-b579-1b1465e495bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:36.897243 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50ed14-8d2a-4cc6-b756-39352b1d1aaa None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:36.901769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3a447-b40e-4f20-9b01-91fe5d04f36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:36.902346 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3a447-b40e-4f20-9b01-91fe5d04f36a admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.902624 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3a447-b40e-4f20-9b01-91fe5d04f36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.902897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3a447-b40e-4f20-9b01-91fe5d04f36a admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.903529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3a447-b40e-4f20-9b01-91fe5d04f36a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:36.905298 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 760/1555] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:36.905424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: WARNING py.warnings [None req-c4e3a447-b40e-4f20-9b01-91fe5d04f36a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 16:36:36.905424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: warnings.warn(msg) Sep 27 16:36:36.905424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: Sep 27 16:36:36.906301 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3a447-b40e-4f20-9b01-91fe5d04f36a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:36.912720 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3adda-ae0a-4ce0-b579-1b1465e495bf None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:36.922680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3adda-ae0a-4ce0-b579-1b1465e495bf None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:36.927630 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea652cd-d58d-48f3-93f2-af0c539df439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:36.928225 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea652cd-d58d-48f3-93f2-af0c539df439 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.928621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea652cd-d58d-48f3-93f2-af0c539df439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.928894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea652cd-d58d-48f3-93f2-af0c539df439 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.929525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea652cd-d58d-48f3-93f2-af0c539df439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:36.931166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea652cd-d58d-48f3-93f2-af0c539df439 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:36.941064 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 761/1556] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:36.942191 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5857175-6d84-45a3-9b8b-ae60e6679059 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.942473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5857175-6d84-45a3-9b8b-ae60e6679059 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.942746 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5857175-6d84-45a3-9b8b-ae60e6679059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.961211 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-f5857175-6d84-45a3-9b8b-ae60e6679059 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:36.962392 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f5857175-6d84-45a3-9b8b-ae60e6679059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:36.970997 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 762/1557] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:36.971957 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf9cd7-fa9c-4795-8156-a1f2b3aad219 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:36.972293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf9cd7-fa9c-4795-8156-a1f2b3aad219 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:36.972552 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf9cd7-fa9c-4795-8156-a1f2b3aad219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:36.991619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-5ecf9cd7-fa9c-4795-8156-a1f2b3aad219 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:36.992742 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-5ecf9cd7-fa9c-4795-8156-a1f2b3aad219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:37.000436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 763/1558] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:37.004362 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf9cd7-fa9c-4795-8156-a1f2b3aad219 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:37.011924 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 796/1559] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:36:36 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:37.011924 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4b1c7-0c5f-4546-8687-b8ee330b5749 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.011924 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4b1c7-0c5f-4546-8687-b8ee330b5749 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.011924 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4b1c7-0c5f-4546-8687-b8ee330b5749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.015916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf9cd7-fa9c-4795-8156-a1f2b3aad219 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:37.029747 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-32b4b1c7-0c5f-4546-8687-b8ee330b5749 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:37.034481 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-32b4b1c7-0c5f-4546-8687-b8ee330b5749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:37.064265 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:37.072906 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4f919-07ce-4a0e-81a1-9d871da300a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:37.077799 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4f919-07ce-4a0e-81a1-9d871da300a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.077799 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4f919-07ce-4a0e-81a1-9d871da300a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.077799 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4f919-07ce-4a0e-81a1-9d871da300a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.077799 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4f919-07ce-4a0e-81a1-9d871da300a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:36:37.077799 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4f919-07ce-4a0e-81a1-9d871da300a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:37.077799 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4f919-07ce-4a0e-81a1-9d871da300a1 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:37.089071 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 764/1560] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:36:37.089546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 797/1561] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:37.089882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4f919-07ce-4a0e-81a1-9d871da300a1 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:37.090483 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c5d6b-9277-4c20-9b9a-b1b5a34fef70 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.090776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c5d6b-9277-4c20-9b9a-b1b5a34fef70 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.091038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c5d6b-9277-4c20-9b9a-b1b5a34fef70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.106335 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4f919-07ce-4a0e-81a1-9d871da300a1 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:37.111421 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab75af-432f-461c-8344-4c5d502f891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:37.112025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab75af-432f-461c-8344-4c5d502f891c admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.112304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab75af-432f-461c-8344-4c5d502f891c admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.112611 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab75af-432f-461c-8344-4c5d502f891c admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.112826 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-629c5d6b-9277-4c20-9b9a-b1b5a34fef70 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:37.113388 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab75af-432f-461c-8344-4c5d502f891c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:36:37.113727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab75af-432f-461c-8344-4c5d502f891c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:37.114018 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-629c5d6b-9277-4c20-9b9a-b1b5a34fef70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:37.115329 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab75af-432f-461c-8344-4c5d502f891c admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:37.121789 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 798/1562] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:37.122528 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c5d6b-9277-4c20-9b9a-b1b5a34fef70 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:37.131390 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 765/1563] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:36:37.131589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c5d6b-9277-4c20-9b9a-b1b5a34fef70 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:37.133356 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4c1d0-abd7-4437-a0be-8198995c0aa5 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.134324 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4c1d0-abd7-4437-a0be-8198995c0aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.134878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4c1d0-abd7-4437-a0be-8198995c0aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.136679 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923503d-c1f1-4849-b674-a43c21fe93b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:37.137335 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923503d-c1f1-4849-b674-a43c21fe93b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.137619 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923503d-c1f1-4849-b674-a43c21fe93b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.137893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923503d-c1f1-4849-b674-a43c21fe93b4 admin admin] PATH_INFO: `/v3/projects/f4b659f693a44a93a9cdc4815bf72a67/users/603658cfa91440faa2584d8647aebd77/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.146538 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:37.153729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923503d-c1f1-4849-b674-a43c21fe93b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b659f693a44a93a9cdc4815bf72a67, user_id=603658cfa91440faa2584d8647aebd77, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:37.159368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: WARNING py.warnings [None req-7923503d-c1f1-4849-b674-a43c21fe93b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 16:36:37.159368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: warnings.warn(msg) Sep 27 16:36:37.159368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: Sep 27 16:36:37.159640 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-b5c4c1d0-abd7-4437-a0be-8198995c0aa5 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:37.159640 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b5c4c1d0-abd7-4437-a0be-8198995c0aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:37.159829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923503d-c1f1-4849-b674-a43c21fe93b4 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:37.165930 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 766/1564] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:37.166705 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4c1d0-abd7-4437-a0be-8198995c0aa5 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:37.176489 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4c1d0-abd7-4437-a0be-8198995c0aa5 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:37.181140 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4733d0-08b0-4d28-a793-fe3a180fa995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:37.182343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4733d0-08b0-4d28-a793-fe3a180fa995 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.182343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4733d0-08b0-4d28-a793-fe3a180fa995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.182343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4733d0-08b0-4d28-a793-fe3a180fa995 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.182930 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4733d0-08b0-4d28-a793-fe3a180fa995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:36:37.183227 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4733d0-08b0-4d28-a793-fe3a180fa995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:37.184864 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4733d0-08b0-4d28-a793-fe3a180fa995 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:37.197265 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 767/1565] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:36:37.198179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4733d0-08b0-4d28-a793-fe3a180fa995 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:37.208001 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4733d0-08b0-4d28-a793-fe3a180fa995 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:37.212561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6483c9-b3f2-47ba-b462-fc3fc69edcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:37.213130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6483c9-b3f2-47ba-b462-fc3fc69edcdd admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.213408 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6483c9-b3f2-47ba-b462-fc3fc69edcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.213693 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6483c9-b3f2-47ba-b462-fc3fc69edcdd admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.214287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6483c9-b3f2-47ba-b462-fc3fc69edcdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:37.215299 dv-cinder-855060-2-smb devstack@keystone.service[81630]: WARNING py.warnings [None req-2b6483c9-b3f2-47ba-b462-fc3fc69edcdd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 16:36:37.215299 dv-cinder-855060-2-smb devstack@keystone.service[81630]: warnings.warn(msg) Sep 27 16:36:37.215299 dv-cinder-855060-2-smb devstack@keystone.service[81630]: Sep 27 16:36:37.216502 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6483c9-b3f2-47ba-b462-fc3fc69edcdd admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:37.237500 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 799/1566] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:36:37 2022] PUT /identity/v3/projects/f4b659f693a44a93a9cdc4815bf72a67/users/603658cfa91440faa2584d8647aebd77/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:37.239030 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923503d-c1f1-4849-b674-a43c21fe93b4 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:37.299678 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923503d-c1f1-4849-b674-a43c21fe93b4 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:37.304513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672e38b-b995-4ebc-bcee-0d9d34a8aba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:37.305279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672e38b-b995-4ebc-bcee-0d9d34a8aba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.305423 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672e38b-b995-4ebc-bcee-0d9d34a8aba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.305634 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672e38b-b995-4ebc-bcee-0d9d34a8aba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.306259 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672e38b-b995-4ebc-bcee-0d9d34a8aba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:36:37.306568 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672e38b-b995-4ebc-bcee-0d9d34a8aba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:37.308144 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672e38b-b995-4ebc-bcee-0d9d34a8aba1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:37.310439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 768/1567] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:36:37 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:37.311257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6483c9-b3f2-47ba-b462-fc3fc69edcdd admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:37.321321 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6483c9-b3f2-47ba-b462-fc3fc69edcdd admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:37.322576 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 800/1568] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:36:37.323281 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672e38b-b995-4ebc-bcee-0d9d34a8aba1 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:37.327154 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4bf62-f327-4c7d-9968-fe77b8b29f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:37.327967 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4bf62-f327-4c7d-9968-fe77b8b29f25 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.328244 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4bf62-f327-4c7d-9968-fe77b8b29f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.328623 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4bf62-f327-4c7d-9968-fe77b8b29f25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.329250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4bf62-f327-4c7d-9968-fe77b8b29f25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:37.331994 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4bf62-f327-4c7d-9968-fe77b8b29f25 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:37.336543 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672e38b-b995-4ebc-bcee-0d9d34a8aba1 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:37.341218 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7182b0-7fb6-4e9b-b571-22694ddbae0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:37.342140 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7182b0-7fb6-4e9b-b571-22694ddbae0c admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.342140 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7182b0-7fb6-4e9b-b571-22694ddbae0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.343022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7182b0-7fb6-4e9b-b571-22694ddbae0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.343675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7182b0-7fb6-4e9b-b571-22694ddbae0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:36:37.343974 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7182b0-7fb6-4e9b-b571-22694ddbae0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:37.345611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7182b0-7fb6-4e9b-b571-22694ddbae0c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:37.357875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 801/1569] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:36:37.358752 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7182b0-7fb6-4e9b-b571-22694ddbae0c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:37.367949 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7182b0-7fb6-4e9b-b571-22694ddbae0c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:37.372762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0f161-7c1f-4762-9d71-6229b0d1358a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:37.373347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0f161-7c1f-4762-9d71-6229b0d1358a admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.373626 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0f161-7c1f-4762-9d71-6229b0d1358a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.373899 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0f161-7c1f-4762-9d71-6229b0d1358a admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.374542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0f161-7c1f-4762-9d71-6229b0d1358a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:37.376467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0f161-7c1f-4762-9d71-6229b0d1358a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:37.429208 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 769/1570] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:36:37 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:37.429208 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4bf62-f327-4c7d-9968-fe77b8b29f25 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:37.487354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4bf62-f327-4c7d-9968-fe77b8b29f25 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:37.492021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099eaee9-4f2a-4a62-b925-923fd1214a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:37.492653 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099eaee9-4f2a-4a62-b925-923fd1214a83 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.492934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099eaee9-4f2a-4a62-b925-923fd1214a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.493213 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099eaee9-4f2a-4a62-b925-923fd1214a83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.493849 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099eaee9-4f2a-4a62-b925-923fd1214a83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:36:37.494155 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099eaee9-4f2a-4a62-b925-923fd1214a83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:37.494273 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 802/1571] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:36:37 2022] POST /identity/v3/projects => generated 391 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:37.495004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0f161-7c1f-4762-9d71-6229b0d1358a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:37.495803 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099eaee9-4f2a-4a62-b925-923fd1214a83 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:37.509014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 770/1572] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:36:37.510476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c98c4-7b63-4167-a65c-ff52b69d82ee None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.510764 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c98c4-7b63-4167-a65c-ff52b69d82ee None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.511039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c98c4-7b63-4167-a65c-ff52b69d82ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.529932 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-9e1c98c4-7b63-4167-a65c-ff52b69d82ee None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:37.531153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-9e1c98c4-7b63-4167-a65c-ff52b69d82ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:37.565228 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0f161-7c1f-4762-9d71-6229b0d1358a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:37.569876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126eacd-f4b2-4692-89a6-fd6a12ae4147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:37.570481 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126eacd-f4b2-4692-89a6-fd6a12ae4147 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.570761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126eacd-f4b2-4692-89a6-fd6a12ae4147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.571041 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126eacd-f4b2-4692-89a6-fd6a12ae4147 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.571662 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126eacd-f4b2-4692-89a6-fd6a12ae4147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:37.573593 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126eacd-f4b2-4692-89a6-fd6a12ae4147 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:37.590802 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 771/1573] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:37.591904 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c98c4-7b63-4167-a65c-ff52b69d82ee None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:37.601416 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c98c4-7b63-4167-a65c-ff52b69d82ee None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:37.606176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be94e4-17f0-45d2-bb2c-985f7d4163ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:37.606767 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be94e4-17f0-45d2-bb2c-985f7d4163ce admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.607042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be94e4-17f0-45d2-bb2c-985f7d4163ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.607310 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be94e4-17f0-45d2-bb2c-985f7d4163ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.607936 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be94e4-17f0-45d2-bb2c-985f7d4163ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:37.609586 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be94e4-17f0-45d2-bb2c-985f7d4163ce admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:37.611729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:37.619513 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 772/1574] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:37.621125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be94e4-17f0-45d2-bb2c-985f7d4163ce admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:37.631184 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be94e4-17f0-45d2-bb2c-985f7d4163ce admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:37.636513 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61ca24-6565-4fa5-be54-9f138930a1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:37.636513 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61ca24-6565-4fa5-be54-9f138930a1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.636781 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61ca24-6565-4fa5-be54-9f138930a1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.637061 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61ca24-6565-4fa5-be54-9f138930a1b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.637676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61ca24-6565-4fa5-be54-9f138930a1b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:37.640211 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61ca24-6565-4fa5-be54-9f138930a1b4 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:37.668583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 803/1575] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:36:37 2022] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:37.668583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126eacd-f4b2-4692-89a6-fd6a12ae4147 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:37.700057 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:37.727470 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126eacd-f4b2-4692-89a6-fd6a12ae4147 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:37.732308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f336811-97a9-4143-a92c-076929d89d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:37.732936 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f336811-97a9-4143-a92c-076929d89d99 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.733216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f336811-97a9-4143-a92c-076929d89d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.733491 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f336811-97a9-4143-a92c-076929d89d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.734115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f336811-97a9-4143-a92c-076929d89d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:37.736010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f336811-97a9-4143-a92c-076929d89d99 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:37.769018 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 773/1576] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:36:37 2022] POST /identity/v3/projects => generated 389 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:37.769828 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61ca24-6565-4fa5-be54-9f138930a1b4 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:37.832697 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61ca24-6565-4fa5-be54-9f138930a1b4 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:37.837382 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73155eac-6fb1-4466-82c3-0ad36fc8bc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:37.837988 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73155eac-6fb1-4466-82c3-0ad36fc8bc81 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.838272 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73155eac-6fb1-4466-82c3-0ad36fc8bc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.838550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73155eac-6fb1-4466-82c3-0ad36fc8bc81 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.839178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73155eac-6fb1-4466-82c3-0ad36fc8bc81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:37.841198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73155eac-6fb1-4466-82c3-0ad36fc8bc81 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:37.848450 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 804/1577] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:36:37 2022] POST /identity/v3/projects => generated 357 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:37.848450 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f336811-97a9-4143-a92c-076929d89d99 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:37.912724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 774/1578] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:36:37 2022] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:37.912724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73155eac-6fb1-4466-82c3-0ad36fc8bc81 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:37.913013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f336811-97a9-4143-a92c-076929d89d99 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:37.917436 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb2b23-01dd-4fdb-8473-ee1023ea2b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:37.918023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb2b23-01dd-4fdb-8473-ee1023ea2b2c admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.918301 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb2b23-01dd-4fdb-8473-ee1023ea2b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.918576 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb2b23-01dd-4fdb-8473-ee1023ea2b2c admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.919211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb2b23-01dd-4fdb-8473-ee1023ea2b2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:37.922144 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb2b23-01dd-4fdb-8473-ee1023ea2b2c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:37.922772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73155eac-6fb1-4466-82c3-0ad36fc8bc81 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:37.928190 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3e41c-295d-465d-91fb-c3ad70251ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:37.928966 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3e41c-295d-465d-91fb-c3ad70251ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:37.929250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3e41c-295d-465d-91fb-c3ad70251ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:37.929573 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3e41c-295d-465d-91fb-c3ad70251ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:37.930185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3e41c-295d-465d-91fb-c3ad70251ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:37.932149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3e41c-295d-465d-91fb-c3ad70251ab9 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:37.995630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 805/1579] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:36:37 2022] POST /identity/v3/users => generated 296 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:37.998166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb2b23-01dd-4fdb-8473-ee1023ea2b2c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.037152 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 775/1580] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:36:37 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:38.041168 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3e41c-295d-465d-91fb-c3ad70251ab9 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.054365 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb2b23-01dd-4fdb-8473-ee1023ea2b2c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.104243 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3e41c-295d-465d-91fb-c3ad70251ab9 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.104892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354ad8c-4280-4a5f-bfda-84b8f2cd061e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.105498 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354ad8c-4280-4a5f-bfda-84b8f2cd061e service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.105774 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354ad8c-4280-4a5f-bfda-84b8f2cd061e service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.106116 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354ad8c-4280-4a5f-bfda-84b8f2cd061e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.109557 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058bc76-aa98-4600-b02b-ac008268716d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.110165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058bc76-aa98-4600-b02b-ac008268716d admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.110442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058bc76-aa98-4600-b02b-ac008268716d admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.110709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058bc76-aa98-4600-b02b-ac008268716d admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.111346 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058bc76-aa98-4600-b02b-ac008268716d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.113057 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058bc76-aa98-4600-b02b-ac008268716d admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.115441 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354ad8c-4280-4a5f-bfda-84b8f2cd061e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.116902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354ad8c-4280-4a5f-bfda-84b8f2cd061e service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.122711 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 776/1581] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:38.123478 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058bc76-aa98-4600-b02b-ac008268716d admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.130503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 806/1582] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:38.131286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354ad8c-4280-4a5f-bfda-84b8f2cd061e service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.133376 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058bc76-aa98-4600-b02b-ac008268716d admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.137620 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:38.139441 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62df87d-7185-4b55-b854-7689608cf228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.139976 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62df87d-7185-4b55-b854-7689608cf228 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.140252 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62df87d-7185-4b55-b854-7689608cf228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.141160 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62df87d-7185-4b55-b854-7689608cf228 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.141160 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62df87d-7185-4b55-b854-7689608cf228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.141519 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354ad8c-4280-4a5f-bfda-84b8f2cd061e service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.143075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62df87d-7185-4b55-b854-7689608cf228 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.146676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f35ea3-b770-495e-94cd-b984aea8d612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.147455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f35ea3-b770-495e-94cd-b984aea8d612 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.147625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f35ea3-b770-495e-94cd-b984aea8d612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.147890 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f35ea3-b770-495e-94cd-b984aea8d612 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.148538 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f35ea3-b770-495e-94cd-b984aea8d612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.150426 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f35ea3-b770-495e-94cd-b984aea8d612 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.258415 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 777/1583] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:36:38 2022] POST /identity/v3/users => generated 285 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:38.259220 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62df87d-7185-4b55-b854-7689608cf228 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.269941 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62df87d-7185-4b55-b854-7689608cf228 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.273581 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 807/1584] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:36:38 2022] POST /identity/v3/users => generated 295 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:38.273581 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f35ea3-b770-495e-94cd-b984aea8d612 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.275432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034865fd-f3b9-4e24-adf9-58b21aad63d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.276112 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034865fd-f3b9-4e24-adf9-58b21aad63d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.276490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034865fd-f3b9-4e24-adf9-58b21aad63d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.276846 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034865fd-f3b9-4e24-adf9-58b21aad63d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.277537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034865fd-f3b9-4e24-adf9-58b21aad63d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.279588 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034865fd-f3b9-4e24-adf9-58b21aad63d0 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.282162 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f35ea3-b770-495e-94cd-b984aea8d612 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.286940 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86f7f5-edb8-4173-82d1-cd24bdfb09a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.287624 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86f7f5-edb8-4173-82d1-cd24bdfb09a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.287970 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86f7f5-edb8-4173-82d1-cd24bdfb09a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.288312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86f7f5-edb8-4173-82d1-cd24bdfb09a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.289044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86f7f5-edb8-4173-82d1-cd24bdfb09a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.290700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86f7f5-edb8-4173-82d1-cd24bdfb09a6 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.302703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 808/1585] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:38.306225 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86f7f5-edb8-4173-82d1-cd24bdfb09a6 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.315775 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86f7f5-edb8-4173-82d1-cd24bdfb09a6 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.320419 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4059c-c10b-4f93-a659-e4a9d2ee9632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.321007 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4059c-c10b-4f93-a659-e4a9d2ee9632 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.321283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4059c-c10b-4f93-a659-e4a9d2ee9632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.321555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4059c-c10b-4f93-a659-e4a9d2ee9632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.322175 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4059c-c10b-4f93-a659-e4a9d2ee9632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.323735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4059c-c10b-4f93-a659-e4a9d2ee9632 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.334753 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 809/1586] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:38.335893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4059c-c10b-4f93-a659-e4a9d2ee9632 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.346460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4059c-c10b-4f93-a659-e4a9d2ee9632 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.351586 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf36a3-21bc-4a9d-846b-c8062b17c70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.355882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf36a3-21bc-4a9d-846b-c8062b17c70d admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.355882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf36a3-21bc-4a9d-846b-c8062b17c70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.355882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf36a3-21bc-4a9d-846b-c8062b17c70d admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.355882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf36a3-21bc-4a9d-846b-c8062b17c70d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.355882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf36a3-21bc-4a9d-846b-c8062b17c70d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.379080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 778/1587] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:36:38 2022] POST /identity/v3/users => generated 279 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:38.379904 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034865fd-f3b9-4e24-adf9-58b21aad63d0 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.386126 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:38.389870 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034865fd-f3b9-4e24-adf9-58b21aad63d0 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.394501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d547b-7fbf-4e2f-a5d6-d32be738a15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.395127 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d547b-7fbf-4e2f-a5d6-d32be738a15f admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.395410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d547b-7fbf-4e2f-a5d6-d32be738a15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.395687 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d547b-7fbf-4e2f-a5d6-d32be738a15f admin admin] PATH_INFO: `/v3/projects/d886724ab9c7423b846cbd173d7ad21f/users/aa0f2a16dd6548648477f4b441f58e9f/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.411437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d547b-7fbf-4e2f-a5d6-d32be738a15f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d886724ab9c7423b846cbd173d7ad21f, user_id=aa0f2a16dd6548648477f4b441f58e9f, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.414243 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d547b-7fbf-4e2f-a5d6-d32be738a15f admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.458566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 810/1588] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:36:38 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:38.459598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf36a3-21bc-4a9d-846b-c8062b17c70d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.471006 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf36a3-21bc-4a9d-846b-c8062b17c70d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.475759 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce00cb-f437-4c22-82ee-bc855588a179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.476375 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce00cb-f437-4c22-82ee-bc855588a179 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.476656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce00cb-f437-4c22-82ee-bc855588a179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.476928 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce00cb-f437-4c22-82ee-bc855588a179 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.477565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce00cb-f437-4c22-82ee-bc855588a179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.479309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce00cb-f437-4c22-82ee-bc855588a179 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.490283 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 779/1589] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:36:38 2022] PUT /identity/v3/projects/d886724ab9c7423b846cbd173d7ad21f/users/aa0f2a16dd6548648477f4b441f58e9f/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:38.490739 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 811/1590] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:38.491573 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce00cb-f437-4c22-82ee-bc855588a179 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.502662 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d547b-7fbf-4e2f-a5d6-d32be738a15f admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.507162 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce00cb-f437-4c22-82ee-bc855588a179 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.581870 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc28e9f-0080-4815-9782-37776f366ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.582139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d547b-7fbf-4e2f-a5d6-d32be738a15f admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.582487 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc28e9f-0080-4815-9782-37776f366ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.582760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc28e9f-0080-4815-9782-37776f366ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.583046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc28e9f-0080-4815-9782-37776f366ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.583687 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc28e9f-0080-4815-9782-37776f366ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.585428 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc28e9f-0080-4815-9782-37776f366ea9 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.587227 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3c1d9-7328-4d49-bf5b-4f07c5e29b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.587865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3c1d9-7328-4d49-bf5b-4f07c5e29b94 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.588149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3c1d9-7328-4d49-bf5b-4f07c5e29b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.588512 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3c1d9-7328-4d49-bf5b-4f07c5e29b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.589156 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3c1d9-7328-4d49-bf5b-4f07c5e29b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.590788 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3c1d9-7328-4d49-bf5b-4f07c5e29b94 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.597353 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 812/1591] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:38.598297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc28e9f-0080-4815-9782-37776f366ea9 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.605502 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 780/1592] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:38.606470 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3c1d9-7328-4d49-bf5b-4f07c5e29b94 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.611267 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc28e9f-0080-4815-9782-37776f366ea9 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.616516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b6b79-ac73-4dca-a77e-14f280a99cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.617321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b6b79-ac73-4dca-a77e-14f280a99cff admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.617606 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b6b79-ac73-4dca-a77e-14f280a99cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.617880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b6b79-ac73-4dca-a77e-14f280a99cff admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.618008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3c1d9-7328-4d49-bf5b-4f07c5e29b94 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.618651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b6b79-ac73-4dca-a77e-14f280a99cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.620240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b6b79-ac73-4dca-a77e-14f280a99cff admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.623377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fd422-fc1e-4e9e-befb-f04d3470b925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.624004 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fd422-fc1e-4e9e-befb-f04d3470b925 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.624286 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fd422-fc1e-4e9e-befb-f04d3470b925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.629723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fd422-fc1e-4e9e-befb-f04d3470b925 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.629723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fd422-fc1e-4e9e-befb-f04d3470b925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.629723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fd422-fc1e-4e9e-befb-f04d3470b925 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.631108 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 813/1593] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:38.631921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b6b79-ac73-4dca-a77e-14f280a99cff admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.640462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 781/1594] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:38.640462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fd422-fc1e-4e9e-befb-f04d3470b925 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.644511 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b6b79-ac73-4dca-a77e-14f280a99cff admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.648477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fd422-fc1e-4e9e-befb-f04d3470b925 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.649288 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a6529-d4c2-467e-9ffc-16292b4bed43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.654305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a6529-d4c2-467e-9ffc-16292b4bed43 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.654305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a6529-d4c2-467e-9ffc-16292b4bed43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.654305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a6529-d4c2-467e-9ffc-16292b4bed43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.654305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a6529-d4c2-467e-9ffc-16292b4bed43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.654305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a6529-d4c2-467e-9ffc-16292b4bed43 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.655400 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd6347-4685-422e-8f05-29edda0bbfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.655400 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd6347-4685-422e-8f05-29edda0bbfed admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.655400 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd6347-4685-422e-8f05-29edda0bbfed admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.655400 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd6347-4685-422e-8f05-29edda0bbfed admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.655773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd6347-4685-422e-8f05-29edda0bbfed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.656836 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd6347-4685-422e-8f05-29edda0bbfed admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.663821 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 814/1595] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:38.665089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6ddcd-5c66-43d4-b73b-9f9b0f4f6f89 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.665369 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6ddcd-5c66-43d4-b73b-9f9b0f4f6f89 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.665647 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6ddcd-5c66-43d4-b73b-9f9b0f4f6f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.670923 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 782/1596] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:38.671873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd6347-4685-422e-8f05-29edda0bbfed admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.683194 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd6347-4685-422e-8f05-29edda0bbfed admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.688228 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a4b6f-874b-4892-bc72-61f122c14d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.688922 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a4b6f-874b-4892-bc72-61f122c14d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.689203 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a4b6f-874b-4892-bc72-61f122c14d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.689479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a4b6f-874b-4892-bc72-61f122c14d42 admin admin] PATH_INFO: `/v3/projects/8767923077094a6e801bc81bd0a4c2bf/users/8a80c818011b4fa1bc4b4244cb3cbe78/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.700231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-e4f6ddcd-5c66-43d4-b73b-9f9b0f4f6f89 None None] MFA Rules not processed for user `aa0f2a16dd6548648477f4b441f58e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:38.702670 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e4f6ddcd-5c66-43d4-b73b-9f9b0f4f6f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:38.704997 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a4b6f-874b-4892-bc72-61f122c14d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8767923077094a6e801bc81bd0a4c2bf, user_id=8a80c818011b4fa1bc4b4244cb3cbe78, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.707870 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a4b6f-874b-4892-bc72-61f122c14d42 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.762533 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:38.766791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 815/1597] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:38.767654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6ddcd-5c66-43d4-b73b-9f9b0f4f6f89 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.778472 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6ddcd-5c66-43d4-b73b-9f9b0f4f6f89 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.788695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 783/1598] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:36:38 2022] PUT /identity/v3/projects/8767923077094a6e801bc81bd0a4c2bf/users/8a80c818011b4fa1bc4b4244cb3cbe78/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:38.792949 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a4b6f-874b-4892-bc72-61f122c14d42 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.874202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a4b6f-874b-4892-bc72-61f122c14d42 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.874775 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8dc18-2e9d-46bc-97fd-1f6389a9cfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.875813 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8dc18-2e9d-46bc-97fd-1f6389a9cfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.876295 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8dc18-2e9d-46bc-97fd-1f6389a9cfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.876806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8dc18-2e9d-46bc-97fd-1f6389a9cfb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.877707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8dc18-2e9d-46bc-97fd-1f6389a9cfb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.879065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bea157-86cf-45a4-8cbb-4c6584c105d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.879883 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8dc18-2e9d-46bc-97fd-1f6389a9cfb5 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.880010 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bea157-86cf-45a4-8cbb-4c6584c105d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.880240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bea157-86cf-45a4-8cbb-4c6584c105d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.880544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bea157-86cf-45a4-8cbb-4c6584c105d2 admin admin] PATH_INFO: `/v3/projects/0ceffd50ede14cd5a2daaed46f3c1ff2/users/a84e162448a64727acdb841c839a384d/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.895800 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 816/1599] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:38.896817 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8dc18-2e9d-46bc-97fd-1f6389a9cfb5 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.901019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bea157-86cf-45a4-8cbb-4c6584c105d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ceffd50ede14cd5a2daaed46f3c1ff2, user_id=a84e162448a64727acdb841c839a384d, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.903858 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bea157-86cf-45a4-8cbb-4c6584c105d2 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.907852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8dc18-2e9d-46bc-97fd-1f6389a9cfb5 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.912884 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001312b1-a5a2-4f12-977a-eab389d40574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.913501 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001312b1-a5a2-4f12-977a-eab389d40574 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.913786 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001312b1-a5a2-4f12-977a-eab389d40574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.914221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001312b1-a5a2-4f12-977a-eab389d40574 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.914858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001312b1-a5a2-4f12-977a-eab389d40574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.916555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001312b1-a5a2-4f12-977a-eab389d40574 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.931038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 817/1600] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:38.931038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001312b1-a5a2-4f12-977a-eab389d40574 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.940957 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001312b1-a5a2-4f12-977a-eab389d40574 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.946595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311cc2a-8edf-4e4e-b4f7-4c8b94a198c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.947431 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311cc2a-8edf-4e4e-b4f7-4c8b94a198c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.947913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311cc2a-8edf-4e4e-b4f7-4c8b94a198c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.948429 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311cc2a-8edf-4e4e-b4f7-4c8b94a198c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:38.949475 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311cc2a-8edf-4e4e-b4f7-4c8b94a198c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:38.951368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311cc2a-8edf-4e4e-b4f7-4c8b94a198c8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:38.964907 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 818/1601] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:38.965825 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311cc2a-8edf-4e4e-b4f7-4c8b94a198c8 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:38.978820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311cc2a-8edf-4e4e-b4f7-4c8b94a198c8 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:38.992185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee75dec-d23d-4f29-80d3-e7117d0c98b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:38.992185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee75dec-d23d-4f29-80d3-e7117d0c98b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:38.992185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee75dec-d23d-4f29-80d3-e7117d0c98b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:38.992185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee75dec-d23d-4f29-80d3-e7117d0c98b3 admin admin] PATH_INFO: `/v3/projects/10d72d74b5d840128f378a6ad861a52a/users/3d0fffe647c348b69f51a9464b595500/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:39.001364 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 784/1602] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:36:38 2022] PUT /identity/v3/projects/0ceffd50ede14cd5a2daaed46f3c1ff2/users/a84e162448a64727acdb841c839a384d/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:39.007700 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef315404-f640-4161-9e69-36be631139dc None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:39.008171 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef315404-f640-4161-9e69-36be631139dc None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:39.008647 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef315404-f640-4161-9e69-36be631139dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:39.009315 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee75dec-d23d-4f29-80d3-e7117d0c98b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d72d74b5d840128f378a6ad861a52a, user_id=3d0fffe647c348b69f51a9464b595500, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:39.013057 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee75dec-d23d-4f29-80d3-e7117d0c98b3 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:39.036313 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:39.039523 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-ef315404-f640-4161-9e69-36be631139dc None None] MFA Rules not processed for user `8a80c818011b4fa1bc4b4244cb3cbe78`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:39.040883 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ef315404-f640-4161-9e69-36be631139dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:39.104222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 819/1603] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:36:38 2022] PUT /identity/v3/projects/10d72d74b5d840128f378a6ad861a52a/users/3d0fffe647c348b69f51a9464b595500/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:39.105535 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447269b9-a207-461e-a514-7b7b455976b7 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:39.105830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447269b9-a207-461e-a514-7b7b455976b7 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:39.106183 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447269b9-a207-461e-a514-7b7b455976b7 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:39.107566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 820/1604] 10.222.0.26 () {54 vars in 961 bytes} [Tue Sep 27 16:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:36:39.108152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447269b9-a207-461e-a514-7b7b455976b7 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:39.110382 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 785/1605] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:39.111280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef315404-f640-4161-9e69-36be631139dc None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:39.181008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef315404-f640-4161-9e69-36be631139dc None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:39.186618 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03b286-bb8e-4d9e-b985-94ae9e013abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:39.187401 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03b286-bb8e-4d9e-b985-94ae9e013abd admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:39.187772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03b286-bb8e-4d9e-b985-94ae9e013abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:39.188148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03b286-bb8e-4d9e-b985-94ae9e013abd admin admin] PATH_INFO: `/v3/projects/0eb94f88f2474ae68abaa777336a0323/users/ef1699338c6146e9a713f746ca946e0e/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:39.189793 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447269b9-a207-461e-a514-7b7b455976b7 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:39.195038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df09358-4096-45ba-aca8-2034a234567d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:39.195795 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df09358-4096-45ba-aca8-2034a234567d admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:39.196080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df09358-4096-45ba-aca8-2034a234567d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:39.196461 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df09358-4096-45ba-aca8-2034a234567d admin admin] PATH_INFO: `/v3/projects/0fa3ce34554c4a44bc9e3cdc0cc4a2d1/users/55a1961b3af6490d9a615e2d907365e9/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:39.210719 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03b286-bb8e-4d9e-b985-94ae9e013abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eb94f88f2474ae68abaa777336a0323, user_id=ef1699338c6146e9a713f746ca946e0e, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:39.214824 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03b286-bb8e-4d9e-b985-94ae9e013abd admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:39.218865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df09358-4096-45ba-aca8-2034a234567d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa3ce34554c4a44bc9e3cdc0cc4a2d1, user_id=55a1961b3af6490d9a615e2d907365e9, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:39.220960 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df09358-4096-45ba-aca8-2034a234567d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:39.287870 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 821/1606] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:36:39 2022] PUT /identity/v3/projects/0fa3ce34554c4a44bc9e3cdc0cc4a2d1/users/55a1961b3af6490d9a615e2d907365e9/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:39.288751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df09358-4096-45ba-aca8-2034a234567d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:39.299286 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 786/1607] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:36:39 2022] PUT /identity/v3/projects/0eb94f88f2474ae68abaa777336a0323/users/ef1699338c6146e9a713f746ca946e0e/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:39.301296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339296d-2d3c-45f2-9c00-a94a9529ac6f None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:39.301580 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339296d-2d3c-45f2-9c00-a94a9529ac6f None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:39.301855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339296d-2d3c-45f2-9c00-a94a9529ac6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:39.322016 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-f339296d-2d3c-45f2-9c00-a94a9529ac6f None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:39.323236 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f339296d-2d3c-45f2-9c00-a94a9529ac6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:39.329989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:39.362234 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df09358-4096-45ba-aca8-2034a234567d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:39.366868 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f81b35-d66d-4195-94bd-ad87e267b68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:39.367652 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f81b35-d66d-4195-94bd-ad87e267b68a admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:39.367934 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f81b35-d66d-4195-94bd-ad87e267b68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:39.368207 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f81b35-d66d-4195-94bd-ad87e267b68a admin admin] PATH_INFO: `/v3/projects/c57d03b9536e4d969de4427689f62b9f/users/6d32130690454568b620faa8957ce111/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:39.383569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f81b35-d66d-4195-94bd-ad87e267b68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57d03b9536e4d969de4427689f62b9f, user_id=6d32130690454568b620faa8957ce111, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:39.386280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f81b35-d66d-4195-94bd-ad87e267b68a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:39.391916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 787/1608] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:39.393009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339296d-2d3c-45f2-9c00-a94a9529ac6f None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:39.412634 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339296d-2d3c-45f2-9c00-a94a9529ac6f None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:39.417527 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd44f09-a61e-48e7-bf3d-817f7ae90708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:39.418139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd44f09-a61e-48e7-bf3d-817f7ae90708 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:39.418421 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd44f09-a61e-48e7-bf3d-817f7ae90708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:39.418700 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd44f09-a61e-48e7-bf3d-817f7ae90708 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:39.419341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd44f09-a61e-48e7-bf3d-817f7ae90708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:39.421795 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd44f09-a61e-48e7-bf3d-817f7ae90708 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:39.470941 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 822/1609] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:36:39 2022] PUT /identity/v3/projects/c57d03b9536e4d969de4427689f62b9f/users/6d32130690454568b620faa8957ce111/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:39.472497 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb418a25-ed19-4a63-8a8a-2338996b6d2c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:39.472791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb418a25-ed19-4a63-8a8a-2338996b6d2c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:39.473069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb418a25-ed19-4a63-8a8a-2338996b6d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:39.488391 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 788/1610] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:36:39 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:39.489205 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0a9d7-ed1f-42f5-9493-e9320d6055c6 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:39.489490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0a9d7-ed1f-42f5-9493-e9320d6055c6 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:39.489834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0a9d7-ed1f-42f5-9493-e9320d6055c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:39.501593 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:39.523870 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-5fe0a9d7-ed1f-42f5-9493-e9320d6055c6 None None] MFA Rules not processed for user `3d0fffe647c348b69f51a9464b595500`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:39.525126 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-5fe0a9d7-ed1f-42f5-9493-e9320d6055c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:39.530915 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-bb418a25-ed19-4a63-8a8a-2338996b6d2c None None] MFA Rules not processed for user `e71fea96b2b949f9abca12172e69284b`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:39.532247 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-bb418a25-ed19-4a63-8a8a-2338996b6d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:39.601223 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 789/1611] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:39.602672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea9b83-9d46-449b-b457-f36a5aa06c52 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:39.603042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea9b83-9d46-449b-b457-f36a5aa06c52 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:39.603432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea9b83-9d46-449b-b457-f36a5aa06c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:39.619617 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 823/1612] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Sep 27 16:36:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:39.621076 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f04fe-3801-4d02-874c-e270e84cc1f6 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:39.621377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f04fe-3801-4d02-874c-e270e84cc1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:39.621687 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f04fe-3801-4d02-874c-e270e84cc1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:39.628508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-6cea9b83-9d46-449b-b457-f36a5aa06c52 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:39.630286 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6cea9b83-9d46-449b-b457-f36a5aa06c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:39.652496 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-456f04fe-3801-4d02-874c-e270e84cc1f6 None None] MFA Rules not processed for user `ef1699338c6146e9a713f746ca946e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:39.653630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-456f04fe-3801-4d02-874c-e270e84cc1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:39.708919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 790/1613] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:39.710231 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea9b83-9d46-449b-b457-f36a5aa06c52 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:39.740028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 824/1614] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:39.741636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e914e4f-f177-4ca9-aef1-69e3e7f558bd None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:39.742098 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e914e4f-f177-4ca9-aef1-69e3e7f558bd None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:39.742381 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e914e4f-f177-4ca9-aef1-69e3e7f558bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:39.769540 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4e914e4f-f177-4ca9-aef1-69e3e7f558bd None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:39.772820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4e914e4f-f177-4ca9-aef1-69e3e7f558bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:39.778514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea9b83-9d46-449b-b457-f36a5aa06c52 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:39.780716 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 825/1615] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:39.781704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e914e4f-f177-4ca9-aef1-69e3e7f558bd None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:39.796929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265bf55-a83f-4672-9821-3b6de6c0b2a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:39.796929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265bf55-a83f-4672-9821-3b6de6c0b2a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:39.796929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265bf55-a83f-4672-9821-3b6de6c0b2a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:39.796929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265bf55-a83f-4672-9821-3b6de6c0b2a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:39.799261 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e914e4f-f177-4ca9-aef1-69e3e7f558bd None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:39.812870 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997b409-6e07-468e-ac4b-800b54a2e532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:39.813863 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997b409-6e07-468e-ac4b-800b54a2e532 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:39.813863 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997b409-6e07-468e-ac4b-800b54a2e532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:39.814145 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997b409-6e07-468e-ac4b-800b54a2e532 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:39.814825 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997b409-6e07-468e-ac4b-800b54a2e532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:39.817072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997b409-6e07-468e-ac4b-800b54a2e532 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:39.819497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265bf55-a83f-4672-9821-3b6de6c0b2a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:39.821336 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265bf55-a83f-4672-9821-3b6de6c0b2a2 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:39.834608 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 791/1616] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:39.835089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265bf55-a83f-4672-9821-3b6de6c0b2a2 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:39.844780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265bf55-a83f-4672-9821-3b6de6c0b2a2 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:39.849746 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e746d40-441f-433c-b968-a2dc1af3902f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:39.850340 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e746d40-441f-433c-b968-a2dc1af3902f admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:39.850619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e746d40-441f-433c-b968-a2dc1af3902f admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:39.850891 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e746d40-441f-433c-b968-a2dc1af3902f admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:39.851520 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e746d40-441f-433c-b968-a2dc1af3902f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:39.853462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e746d40-441f-433c-b968-a2dc1af3902f admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:39.930268 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:39.937118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 792/1617] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:36:39 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:39.938259 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e746d40-441f-433c-b968-a2dc1af3902f admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:39.941350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 826/1618] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:36:39 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:39.942892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997b409-6e07-468e-ac4b-800b54a2e532 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:39.948083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4997b409-6e07-468e-ac4b-800b54a2e532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:39.966790 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:39.968663 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997b409-6e07-468e-ac4b-800b54a2e532 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:40.057321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7fbbd-4998-4aa4-9faf-66960529f369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:40.057565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e746d40-441f-433c-b968-a2dc1af3902f admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:40.058484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7fbbd-4998-4aa4-9faf-66960529f369 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:40.059429 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7fbbd-4998-4aa4-9faf-66960529f369 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:40.059884 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7fbbd-4998-4aa4-9faf-66960529f369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:40.064422 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9b2f5-8120-4524-ad6f-dd49e51401ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:40.065049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b2f5-8120-4524-ad6f-dd49e51401ef service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:40.065330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b2f5-8120-4524-ad6f-dd49e51401ef service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:40.065607 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b2f5-8120-4524-ad6f-dd49e51401ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:40.132096 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9b2f5-8120-4524-ad6f-dd49e51401ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:40.133961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9b2f5-8120-4524-ad6f-dd49e51401ef service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:40.137861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7fbbd-4998-4aa4-9faf-66960529f369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:40.141006 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7fbbd-4998-4aa4-9faf-66960529f369 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:40.145394 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 793/1619] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:40.150958 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9b2f5-8120-4524-ad6f-dd49e51401ef service nova] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:40.156546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 827/1620] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:40.158872 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9b2f5-8120-4524-ad6f-dd49e51401ef service nova] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:40.163861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e282cfd-cc70-44c8-9d5c-445dc16db418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:40.164517 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e282cfd-cc70-44c8-9d5c-445dc16db418 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:40.164803 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e282cfd-cc70-44c8-9d5c-445dc16db418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:40.165096 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e282cfd-cc70-44c8-9d5c-445dc16db418 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:40.167459 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e282cfd-cc70-44c8-9d5c-445dc16db418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:40.169595 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e282cfd-cc70-44c8-9d5c-445dc16db418 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:40.171286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7fbbd-4998-4aa4-9faf-66960529f369 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:40.195523 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7fbbd-4998-4aa4-9faf-66960529f369 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:40.204561 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b33eb5-5cb7-40e0-8d31-0d3d9cd4e401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:40.206127 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b33eb5-5cb7-40e0-8d31-0d3d9cd4e401 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:40.206957 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b33eb5-5cb7-40e0-8d31-0d3d9cd4e401 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:40.207456 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b33eb5-5cb7-40e0-8d31-0d3d9cd4e401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:40.220159 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b33eb5-5cb7-40e0-8d31-0d3d9cd4e401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:40.221850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b33eb5-5cb7-40e0-8d31-0d3d9cd4e401 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:40.232608 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 828/1621] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:40.239440 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b33eb5-5cb7-40e0-8d31-0d3d9cd4e401 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:40.253855 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b33eb5-5cb7-40e0-8d31-0d3d9cd4e401 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:40.257249 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 794/1622] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:36:40 2022] POST /identity/v3/projects => generated 355 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:40.257249 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e282cfd-cc70-44c8-9d5c-445dc16db418 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:40.358838 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e282cfd-cc70-44c8-9d5c-445dc16db418 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:40.377580 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f095e9-2d16-46a4-8b82-aed37d021740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:40.380148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f095e9-2d16-46a4-8b82-aed37d021740 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:40.380148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f095e9-2d16-46a4-8b82-aed37d021740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:40.380148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f095e9-2d16-46a4-8b82-aed37d021740 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:40.380618 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f095e9-2d16-46a4-8b82-aed37d021740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:40.385711 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f095e9-2d16-46a4-8b82-aed37d021740 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:40.392287 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54aea2-1ec0-4681-82b5-d78114aba2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:40.393799 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54aea2-1ec0-4681-82b5-d78114aba2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:40.394089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54aea2-1ec0-4681-82b5-d78114aba2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:40.394368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54aea2-1ec0-4681-82b5-d78114aba2d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:40.396556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54aea2-1ec0-4681-82b5-d78114aba2d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:40.401496 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54aea2-1ec0-4681-82b5-d78114aba2d8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:40.410509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 795/1623] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:40.412754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f095e9-2d16-46a4-8b82-aed37d021740 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:40.441859 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f095e9-2d16-46a4-8b82-aed37d021740 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:40.448164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa606a7-aa29-4799-b58b-ef1f92e72e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:40.449276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa606a7-aa29-4799-b58b-ef1f92e72e41 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:40.450298 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa606a7-aa29-4799-b58b-ef1f92e72e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:40.455123 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa606a7-aa29-4799-b58b-ef1f92e72e41 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:40.455123 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa606a7-aa29-4799-b58b-ef1f92e72e41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:40.455123 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa606a7-aa29-4799-b58b-ef1f92e72e41 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:40.520479 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 829/1624] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:36:40 2022] POST /identity/v3/users => generated 290 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:40.521562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54aea2-1ec0-4681-82b5-d78114aba2d8 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:40.540876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 796/1625] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:36:40 2022] POST /identity/v3/users => generated 284 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:40.540876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ee926-e268-48ba-a344-6d01db7e5fac None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:40.540876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ee926-e268-48ba-a344-6d01db7e5fac None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:40.540876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ee926-e268-48ba-a344-6d01db7e5fac None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:40.542038 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 797/1626] 10.222.0.26 () {54 vars in 912 bytes} [Tue Sep 27 16:36:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:36:40.542772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ee926-e268-48ba-a344-6d01db7e5fac None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:40.557562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ee926-e268-48ba-a344-6d01db7e5fac None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:40.560069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54aea2-1ec0-4681-82b5-d78114aba2d8 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:40.563264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a6ae8-7a6d-4bbb-bd59-8d9f47401bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:40.563928 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a6ae8-7a6d-4bbb-bd59-8d9f47401bce admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:40.564220 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a6ae8-7a6d-4bbb-bd59-8d9f47401bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:40.564573 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a6ae8-7a6d-4bbb-bd59-8d9f47401bce admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:40.565492 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a6ae8-7a6d-4bbb-bd59-8d9f47401bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:40.567532 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a6ae8-7a6d-4bbb-bd59-8d9f47401bce admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:40.570330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:40.579830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16ef08-9bef-425d-a637-cb0c701c3e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:40.580785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16ef08-9bef-425d-a637-cb0c701c3e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:40.581215 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16ef08-9bef-425d-a637-cb0c701c3e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:40.581662 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16ef08-9bef-425d-a637-cb0c701c3e99 admin admin] PATH_INFO: `/v3/projects/4c3b94a301504b2f9b6e2ebf6d827c08/users/cf613d72bc2b44aaa2f7946b37fbc1bd/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:40.583227 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 798/1627] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:40.584151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a6ae8-7a6d-4bbb-bd59-8d9f47401bce admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:40.598492 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a6ae8-7a6d-4bbb-bd59-8d9f47401bce admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:40.615447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce674e3-9890-4ef2-941b-9d7d7de34592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:40.692843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce674e3-9890-4ef2-941b-9d7d7de34592 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:40.692843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce674e3-9890-4ef2-941b-9d7d7de34592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:40.692843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce674e3-9890-4ef2-941b-9d7d7de34592 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:40.692843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce674e3-9890-4ef2-941b-9d7d7de34592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:40.692843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce674e3-9890-4ef2-941b-9d7d7de34592 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:40.715671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16ef08-9bef-425d-a637-cb0c701c3e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3b94a301504b2f9b6e2ebf6d827c08, user_id=cf613d72bc2b44aaa2f7946b37fbc1bd, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:40.715671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16ef08-9bef-425d-a637-cb0c701c3e99 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:40.716545 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 799/1628] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:40.716545 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b645b5f-4c96-43c7-8b16-b16e4953a3ac None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:40.716545 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b645b5f-4c96-43c7-8b16-b16e4953a3ac None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:40.716545 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b645b5f-4c96-43c7-8b16-b16e4953a3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:40.730165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-5b645b5f-4c96-43c7-8b16-b16e4953a3ac None None] MFA Rules not processed for user `e71fea96b2b949f9abca12172e69284b`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:40.730165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-5b645b5f-4c96-43c7-8b16-b16e4953a3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:40.788848 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 830/1629] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:36:40 2022] PUT /identity/v3/projects/4c3b94a301504b2f9b6e2ebf6d827c08/users/cf613d72bc2b44aaa2f7946b37fbc1bd/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:40.827039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16ef08-9bef-425d-a637-cb0c701c3e99 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:40.827039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:40.862700 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 800/1630] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 27 16:36:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:40.864067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b645b5f-4c96-43c7-8b16-b16e4953a3ac None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:40.887171 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b645b5f-4c96-43c7-8b16-b16e4953a3ac None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:40.962046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16ef08-9bef-425d-a637-cb0c701c3e99 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:40.970020 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490c64d-6f5e-44fd-8ef2-ca15cb4d9b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:40.971268 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490c64d-6f5e-44fd-8ef2-ca15cb4d9b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:40.971788 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490c64d-6f5e-44fd-8ef2-ca15cb4d9b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:40.972310 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490c64d-6f5e-44fd-8ef2-ca15cb4d9b4d admin admin] PATH_INFO: `/v3/projects/00baa293751c46c4aca9f551ebaf7f75/users/b316a96aa6d641d688f0fde970256f54/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:40.975790 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f04eee-6210-42af-b5b5-cc56418017d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:40.976698 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f04eee-6210-42af-b5b5-cc56418017d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:40.984034 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f04eee-6210-42af-b5b5-cc56418017d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:40.984034 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f04eee-6210-42af-b5b5-cc56418017d6 admin admin] PATH_INFO: `/v3/projects/4ae02617c2824ad3811393599948012d/users/b065ca43fd2449d287e58b3312a11ccc/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:40.994529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490c64d-6f5e-44fd-8ef2-ca15cb4d9b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=00baa293751c46c4aca9f551ebaf7f75, user_id=b316a96aa6d641d688f0fde970256f54, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:40.997014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f04eee-6210-42af-b5b5-cc56418017d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae02617c2824ad3811393599948012d, user_id=b065ca43fd2449d287e58b3312a11ccc, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:40.999501 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490c64d-6f5e-44fd-8ef2-ca15cb4d9b4d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:41.001110 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f04eee-6210-42af-b5b5-cc56418017d6 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:41.094984 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 831/1631] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:36:40 2022] PUT /identity/v3/projects/00baa293751c46c4aca9f551ebaf7f75/users/b316a96aa6d641d688f0fde970256f54/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:41.096194 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490c64d-6f5e-44fd-8ef2-ca15cb4d9b4d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:41.107108 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 801/1632] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:36:40 2022] PUT /identity/v3/projects/4ae02617c2824ad3811393599948012d/users/b065ca43fd2449d287e58b3312a11ccc/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:41.127272 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f04eee-6210-42af-b5b5-cc56418017d6 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:41.208929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f04eee-6210-42af-b5b5-cc56418017d6 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:41.230757 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490c64d-6f5e-44fd-8ef2-ca15cb4d9b4d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:41.245686 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49374d49-1894-4c0e-ab03-2a0dcf910fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:41.246309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49374d49-1894-4c0e-ab03-2a0dcf910fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:41.246975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49374d49-1894-4c0e-ab03-2a0dcf910fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:41.246975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49374d49-1894-4c0e-ab03-2a0dcf910fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:41.247530 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49374d49-1894-4c0e-ab03-2a0dcf910fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:41.249210 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49374d49-1894-4c0e-ab03-2a0dcf910fd2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:41.271440 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 832/1633] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:41.273971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49374d49-1894-4c0e-ab03-2a0dcf910fd2 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:41.514810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49374d49-1894-4c0e-ab03-2a0dcf910fd2 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:41.514810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd731da-4c4d-4931-bab9-8eadd47d6a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:41.514810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd731da-4c4d-4931-bab9-8eadd47d6a5f admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:41.514810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd731da-4c4d-4931-bab9-8eadd47d6a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:41.521036 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd731da-4c4d-4931-bab9-8eadd47d6a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:41.521036 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd731da-4c4d-4931-bab9-8eadd47d6a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:41.522955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69727a-7551-4d5e-b171-627da0b08196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:41.522955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69727a-7551-4d5e-b171-627da0b08196 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:41.522955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69727a-7551-4d5e-b171-627da0b08196 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:41.522955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69727a-7551-4d5e-b171-627da0b08196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:41.526276 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd731da-4c4d-4931-bab9-8eadd47d6a5f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:41.526276 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 833/1634] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:41.526276 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd731da-4c4d-4931-bab9-8eadd47d6a5f admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:41.526276 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd731da-4c4d-4931-bab9-8eadd47d6a5f admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:41.528475 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75dc7f-ede5-4bdf-8cbf-342179643e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:41.528475 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75dc7f-ede5-4bdf-8cbf-342179643e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:41.528475 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75dc7f-ede5-4bdf-8cbf-342179643e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:41.528475 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75dc7f-ede5-4bdf-8cbf-342179643e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:41.531844 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75dc7f-ede5-4bdf-8cbf-342179643e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:41.531844 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75dc7f-ede5-4bdf-8cbf-342179643e82 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:41.531844 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 834/1635] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:41.531844 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75dc7f-ede5-4bdf-8cbf-342179643e82 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:41.531844 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75dc7f-ede5-4bdf-8cbf-342179643e82 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:41.532866 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e51a8e-c832-445d-af49-1010d13bcae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:41.532866 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51a8e-c832-445d-af49-1010d13bcae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:41.532866 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51a8e-c832-445d-af49-1010d13bcae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:41.532866 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51a8e-c832-445d-af49-1010d13bcae2 admin admin] PATH_INFO: `/v3/projects/4c3b94a301504b2f9b6e2ebf6d827c08/users/cf613d72bc2b44aaa2f7946b37fbc1bd/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:41.533332 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e51a8e-c832-445d-af49-1010d13bcae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3b94a301504b2f9b6e2ebf6d827c08, user_id=cf613d72bc2b44aaa2f7946b37fbc1bd, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:41.533332 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e51a8e-c832-445d-af49-1010d13bcae2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:41.533518 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69727a-7551-4d5e-b171-627da0b08196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:41.533518 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69727a-7551-4d5e-b171-627da0b08196 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:41.533711 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 835/1636] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:36:41 2022] PUT /identity/v3/projects/4c3b94a301504b2f9b6e2ebf6d827c08/users/cf613d72bc2b44aaa2f7946b37fbc1bd/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:41.533711 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e51a8e-c832-445d-af49-1010d13bcae2 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:41.533873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 802/1637] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:41.533873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69727a-7551-4d5e-b171-627da0b08196 service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:41.533873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:41.535646 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69727a-7551-4d5e-b171-627da0b08196 service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:41.640495 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6c174-19fe-4130-86f4-43d6e672087e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:41.641371 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6c174-19fe-4130-86f4-43d6e672087e admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:41.641660 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6c174-19fe-4130-86f4-43d6e672087e admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:41.642801 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6c174-19fe-4130-86f4-43d6e672087e admin admin] PATH_INFO: `/v3/projects/4ae02617c2824ad3811393599948012d/users/b065ca43fd2449d287e58b3312a11ccc/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:41.645420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6c174-19fe-4130-86f4-43d6e672087e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae02617c2824ad3811393599948012d, user_id=b065ca43fd2449d287e58b3312a11ccc, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:41.650475 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6c174-19fe-4130-86f4-43d6e672087e admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:41.669395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 803/1638] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:36:41 2022] PUT /identity/v3/projects/4ae02617c2824ad3811393599948012d/users/b065ca43fd2449d287e58b3312a11ccc/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:41.671542 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15515453-59a9-4877-bd36-8aefab0c4871 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:41.671774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15515453-59a9-4877-bd36-8aefab0c4871 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:41.672446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15515453-59a9-4877-bd36-8aefab0c4871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:41.701487 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e51a8e-c832-445d-af49-1010d13bcae2 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:41.726496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-15515453-59a9-4877-bd36-8aefab0c4871 None None] MFA Rules not processed for user `cf613d72bc2b44aaa2f7946b37fbc1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:41.727909 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-15515453-59a9-4877-bd36-8aefab0c4871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:41.826681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aa174-0890-4631-8e19-d312e1393741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:41.827369 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aa174-0890-4631-8e19-d312e1393741 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:41.827649 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aa174-0890-4631-8e19-d312e1393741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:41.827921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aa174-0890-4631-8e19-d312e1393741 admin admin] PATH_INFO: `/v3/projects/00baa293751c46c4aca9f551ebaf7f75/users/b316a96aa6d641d688f0fde970256f54/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:41.830753 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058aa174-0890-4631-8e19-d312e1393741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00baa293751c46c4aca9f551ebaf7f75, user_id=b316a96aa6d641d688f0fde970256f54, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:41.831738 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 804/1639] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:41.833334 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3842c-26df-4c5f-9809-1108f7416dd0 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:41.833986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3842c-26df-4c5f-9809-1108f7416dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:41.834871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058aa174-0890-4631-8e19-d312e1393741 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:41.835075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3842c-26df-4c5f-9809-1108f7416dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:41.848765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 836/1640] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:36:41 2022] PUT /identity/v3/projects/00baa293751c46c4aca9f551ebaf7f75/users/b316a96aa6d641d688f0fde970256f54/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:41.848765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aa174-0890-4631-8e19-d312e1393741 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:41.909558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-9dd3842c-26df-4c5f-9809-1108f7416dd0 None None] MFA Rules not processed for user `b065ca43fd2449d287e58b3312a11ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:41.911113 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-9dd3842c-26df-4c5f-9809-1108f7416dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:41.949230 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aa174-0890-4631-8e19-d312e1393741 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:41.954702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd9320-7c8a-44c7-ac89-68b1aedcbabc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:41.955521 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd9320-7c8a-44c7-ac89-68b1aedcbabc service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:41.955890 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd9320-7c8a-44c7-ac89-68b1aedcbabc service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:41.956227 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd9320-7c8a-44c7-ac89-68b1aedcbabc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:42.072238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd9320-7c8a-44c7-ac89-68b1aedcbabc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:42.073902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd9320-7c8a-44c7-ac89-68b1aedcbabc service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:42.088612 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 805/1641] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:42.090085 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647cb7c-0906-4ccb-aa89-bf44846577f2 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:42.090662 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647cb7c-0906-4ccb-aa89-bf44846577f2 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:42.091554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647cb7c-0906-4ccb-aa89-bf44846577f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:42.093572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 837/1642] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:42.146950 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-3647cb7c-0906-4ccb-aa89-bf44846577f2 None None] MFA Rules not processed for user `b316a96aa6d641d688f0fde970256f54`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:42.152527 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3647cb7c-0906-4ccb-aa89-bf44846577f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:42.196407 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:42.262438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 806/1643] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:42.670924 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:42.902444 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd9320-7c8a-44c7-ac89-68b1aedcbabc service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:42.915617 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd9320-7c8a-44c7-ac89-68b1aedcbabc service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:42.926037 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa7b3b-495f-4316-bbd8-948c642ed594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:42.928555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa7b3b-495f-4316-bbd8-948c642ed594 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:42.928955 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa7b3b-495f-4316-bbd8-948c642ed594 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:42.931781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa7b3b-495f-4316-bbd8-948c642ed594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:42.951131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa7b3b-495f-4316-bbd8-948c642ed594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:42.953880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa7b3b-495f-4316-bbd8-948c642ed594 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:42.969303 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 838/1644] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:43.128858 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647cb7c-0906-4ccb-aa89-bf44846577f2 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:43.150269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647cb7c-0906-4ccb-aa89-bf44846577f2 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:43.167626 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e33d4-bf34-4771-977d-6e5f8a8aa500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:43.168281 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e33d4-bf34-4771-977d-6e5f8a8aa500 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:43.168594 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e33d4-bf34-4771-977d-6e5f8a8aa500 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:43.169515 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e33d4-bf34-4771-977d-6e5f8a8aa500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:43.191658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e33d4-bf34-4771-977d-6e5f8a8aa500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:43.196072 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e33d4-bf34-4771-977d-6e5f8a8aa500 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:43.221729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 807/1645] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:43.582523 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa7b3b-495f-4316-bbd8-948c642ed594 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:43.592679 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa7b3b-495f-4316-bbd8-948c642ed594 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:43.605447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9025b1-53e0-44d1-b6c2-41480498205f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:43.606017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9025b1-53e0-44d1-b6c2-41480498205f service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:43.606299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9025b1-53e0-44d1-b6c2-41480498205f service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:43.606573 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9025b1-53e0-44d1-b6c2-41480498205f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:43.627715 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e33d4-bf34-4771-977d-6e5f8a8aa500 service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:43.640287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e33d4-bf34-4771-977d-6e5f8a8aa500 service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:43.653812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ba3bc-2ad5-42ce-9d09-03ffc1e409e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:43.653812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ba3bc-2ad5-42ce-9d09-03ffc1e409e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:43.654114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ba3bc-2ad5-42ce-9d09-03ffc1e409e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:43.654114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ba3bc-2ad5-42ce-9d09-03ffc1e409e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:43.679440 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:43.736983 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:43.752912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9025b1-53e0-44d1-b6c2-41480498205f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:43.754377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9025b1-53e0-44d1-b6c2-41480498205f service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:43.783163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 839/1646] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:43.796073 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ba3bc-2ad5-42ce-9d09-03ffc1e409e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:43.797574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ba3bc-2ad5-42ce-9d09-03ffc1e409e1 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:43.823383 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 808/1647] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:43.923796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba3f49-637d-4ca4-8567-e88a285f30d1 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:43.924411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba3f49-637d-4ca4-8567-e88a285f30d1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:43.924565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba3f49-637d-4ca4-8567-e88a285f30d1 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:43.926336 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 840/1648] 10.222.0.26 () {54 vars in 961 bytes} [Tue Sep 27 16:36:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:36:43.939368 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0fd89-164c-4c63-bf59-01b257c0878a None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:43.939895 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0fd89-164c-4c63-bf59-01b257c0878a None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:43.940613 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0fd89-164c-4c63-bf59-01b257c0878a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:43.972637 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-68c0fd89-164c-4c63-bf59-01b257c0878a None None] MFA Rules not processed for user `e71fea96b2b949f9abca12172e69284b`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:43.975730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-68c0fd89-164c-4c63-bf59-01b257c0878a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:44.074402 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 809/1649] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Sep 27 16:36:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:36:44.081523 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1747ab-f7df-4e24-bdd8-d542407e4d5d None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:44.082364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1747ab-f7df-4e24-bdd8-d542407e4d5d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:44.082858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1747ab-f7df-4e24-bdd8-d542407e4d5d None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:44.094865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 841/1650] 10.222.0.26 () {54 vars in 912 bytes} [Tue Sep 27 16:36:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:36:44.096309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877fd15-9ab7-47b7-a1be-d55a05836d3b None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:44.096858 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877fd15-9ab7-47b7-a1be-d55a05836d3b None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:44.097331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877fd15-9ab7-47b7-a1be-d55a05836d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:44.126931 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-b877fd15-9ab7-47b7-a1be-d55a05836d3b None None] MFA Rules not processed for user `e71fea96b2b949f9abca12172e69284b`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:44.128364 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b877fd15-9ab7-47b7-a1be-d55a05836d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:44.144149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 810/1651] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 27 16:36:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:44.437488 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1747ab-f7df-4e24-bdd8-d542407e4d5d None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:44.473547 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1747ab-f7df-4e24-bdd8-d542407e4d5d None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:44.486372 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef5bfb-5317-4c35-9179-d1dfddf128dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:44.487137 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef5bfb-5317-4c35-9179-d1dfddf128dc service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:44.487430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef5bfb-5317-4c35-9179-d1dfddf128dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:44.488824 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef5bfb-5317-4c35-9179-d1dfddf128dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:44.513558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef5bfb-5317-4c35-9179-d1dfddf128dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:44.517313 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef5bfb-5317-4c35-9179-d1dfddf128dc service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:44.533996 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 842/1652] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:45.213391 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877fd15-9ab7-47b7-a1be-d55a05836d3b None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:45.240694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877fd15-9ab7-47b7-a1be-d55a05836d3b None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:45.247214 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad45b5-771b-4475-971f-63be18c72b34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:45.247907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad45b5-771b-4475-971f-63be18c72b34 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:45.248190 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad45b5-771b-4475-971f-63be18c72b34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:45.248527 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad45b5-771b-4475-971f-63be18c72b34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:45.407521 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad45b5-771b-4475-971f-63be18c72b34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:45.409475 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad45b5-771b-4475-971f-63be18c72b34 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:45.424694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 811/1653] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:46.426489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3175c4-b999-4577-ad5e-8e701677f350 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:46.426998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3175c4-b999-4577-ad5e-8e701677f350 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:46.427094 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3175c4-b999-4577-ad5e-8e701677f350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:46.468494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-5a3175c4-b999-4577-ad5e-8e701677f350 None None] MFA Rules not processed for user `603658cfa91440faa2584d8647aebd77`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:46.469958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5a3175c4-b999-4577-ad5e-8e701677f350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:46.626466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 843/1654] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:46.641508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d117cf-9142-4cbd-88ed-a3e3c1ca0573 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:46.641508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d117cf-9142-4cbd-88ed-a3e3c1ca0573 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:46.641508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d117cf-9142-4cbd-88ed-a3e3c1ca0573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:46.693306 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-e5d117cf-9142-4cbd-88ed-a3e3c1ca0573 None None] MFA Rules not processed for user `603658cfa91440faa2584d8647aebd77`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:46.704461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-e5d117cf-9142-4cbd-88ed-a3e3c1ca0573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:46.736651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 812/1655] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:46.749640 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3175c4-b999-4577-ad5e-8e701677f350 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:46.774858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3175c4-b999-4577-ad5e-8e701677f350 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:46.782155 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3d119-3001-41ac-b86c-87c2fc3249b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:46.783597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3d119-3001-41ac-b86c-87c2fc3249b5 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:46.784106 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3d119-3001-41ac-b86c-87c2fc3249b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:46.784875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3d119-3001-41ac-b86c-87c2fc3249b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:46.822062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3d119-3001-41ac-b86c-87c2fc3249b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:46.829934 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3d119-3001-41ac-b86c-87c2fc3249b5 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:46.845676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 844/1656] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:47.619306 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49186337-7d24-4f03-858e-7b15457528f6 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:47.619607 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49186337-7d24-4f03-858e-7b15457528f6 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:47.619887 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49186337-7d24-4f03-858e-7b15457528f6 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:47.621298 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 813/1657] 10.222.0.26 () {54 vars in 912 bytes} [Tue Sep 27 16:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:36:47.637499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8206a2-fa80-47af-b8d4-3e4e25046314 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:47.637499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8206a2-fa80-47af-b8d4-3e4e25046314 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:47.637499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8206a2-fa80-47af-b8d4-3e4e25046314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:47.720104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ff8206a2-fa80-47af-b8d4-3e4e25046314 None None] MFA Rules not processed for user `758380280e33458f8f9112147d5a7819`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:47.721874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ff8206a2-fa80-47af-b8d4-3e4e25046314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:47.810440 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49186337-7d24-4f03-858e-7b15457528f6 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:47.830303 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 845/1658] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 27 16:36:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:47.831639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8206a2-fa80-47af-b8d4-3e4e25046314 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:47.844028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8206a2-fa80-47af-b8d4-3e4e25046314 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:47.849789 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c0a0f-20cf-4934-96ee-656bfbf38d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:47.850506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c0a0f-20cf-4934-96ee-656bfbf38d27 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:47.851021 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c0a0f-20cf-4934-96ee-656bfbf38d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:47.851517 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c0a0f-20cf-4934-96ee-656bfbf38d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:47.862584 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c0a0f-20cf-4934-96ee-656bfbf38d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:47.864891 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c0a0f-20cf-4934-96ee-656bfbf38d27 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:47.919394 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 846/1659] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:47.942049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:47.979390 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49186337-7d24-4f03-858e-7b15457528f6 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:47.992080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcff05a-23ca-41a3-a0b1-1e12317061c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:47.992538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcff05a-23ca-41a3-a0b1-1e12317061c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:47.993478 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcff05a-23ca-41a3-a0b1-1e12317061c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:47.993909 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcff05a-23ca-41a3-a0b1-1e12317061c7 admin admin] PATH_INFO: `/v3/users/aa0f2a16dd6548648477f4b441f58e9f` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:47.997544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcff05a-23ca-41a3-a0b1-1e12317061c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa0f2a16dd6548648477f4b441f58e9f)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:48.010139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcff05a-23ca-41a3-a0b1-1e12317061c7 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:48.220484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6fcff05a-23ca-41a3-a0b1-1e12317061c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa0f2a16dd6548648477f4b441f58e9f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:48.221266 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6fcff05a-23ca-41a3-a0b1-1e12317061c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa0f2a16dd6548648477f4b441f58e9f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:48.268392 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6fcff05a-23ca-41a3-a0b1-1e12317061c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa0f2a16dd6548648477f4b441f58e9f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:48.373213 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6fcff05a-23ca-41a3-a0b1-1e12317061c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa0f2a16dd6548648477f4b441f58e9f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:48.374586 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6fcff05a-23ca-41a3-a0b1-1e12317061c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa0f2a16dd6548648477f4b441f58e9f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:48.399104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 814/1660] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:36:47 2022] DELETE /identity/v3/users/aa0f2a16dd6548648477f4b441f58e9f => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:48.404068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d593698-1db4-4847-9b40-72186d1079cc None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:48.408847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d593698-1db4-4847-9b40-72186d1079cc None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:48.408847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d593698-1db4-4847-9b40-72186d1079cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:48.438686 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-5d593698-1db4-4847-9b40-72186d1079cc None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:48.440062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5d593698-1db4-4847-9b40-72186d1079cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:48.473312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:48.591515 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 847/1661] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:48.603675 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcff05a-23ca-41a3-a0b1-1e12317061c7 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:48.605848 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6fcff05a-23ca-41a3-a0b1-1e12317061c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:48.721116 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcff05a-23ca-41a3-a0b1-1e12317061c7 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:48.727004 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f6713-8779-4a75-a3e3-30513e3d0d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:48.730294 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f6713-8779-4a75-a3e3-30513e3d0d77 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:48.730294 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f6713-8779-4a75-a3e3-30513e3d0d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:48.730294 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f6713-8779-4a75-a3e3-30513e3d0d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:48.755264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f6713-8779-4a75-a3e3-30513e3d0d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:48.760789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f6713-8779-4a75-a3e3-30513e3d0d77 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:48.778948 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 815/1662] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:48.927277 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d593698-1db4-4847-9b40-72186d1079cc None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:48.928787 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5d593698-1db4-4847-9b40-72186d1079cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:49.019573 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d593698-1db4-4847-9b40-72186d1079cc None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:49.026093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e7fe5-e022-40ce-b14f-c03d22cd9acd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5deb7370bc3045c5be2d391d3b1dbd82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:49.027084 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e7fe5-e022-40ce-b14f-c03d22cd9acd service placement] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:49.027577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e7fe5-e022-40ce-b14f-c03d22cd9acd service placement] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:49.028035 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e7fe5-e022-40ce-b14f-c03d22cd9acd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:49.031476 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-606e7fe5-e022-40ce-b14f-c03d22cd9acd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:49.046288 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e7fe5-e022-40ce-b14f-c03d22cd9acd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:49.048547 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e7fe5-e022-40ce-b14f-c03d22cd9acd service placement] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:49.068480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 848/1663] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:50.157662 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f6713-8779-4a75-a3e3-30513e3d0d77 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:50.158233 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b41f6713-8779-4a75-a3e3-30513e3d0d77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:50.185273 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f6713-8779-4a75-a3e3-30513e3d0d77 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:50.199343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df056553-034a-4f15-8758-09f0d8f2af49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:50.203438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df056553-034a-4f15-8758-09f0d8f2af49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:50.203438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df056553-034a-4f15-8758-09f0d8f2af49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:50.203438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df056553-034a-4f15-8758-09f0d8f2af49 admin admin] PATH_INFO: `/v3/projects/d886724ab9c7423b846cbd173d7ad21f` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:50.203438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df056553-034a-4f15-8758-09f0d8f2af49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d886724ab9c7423b846cbd173d7ad21f)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:50.204519 dv-cinder-855060-2-smb devstack@keystone.service[81630]: WARNING py.warnings [None req-df056553-034a-4f15-8758-09f0d8f2af49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 16:36:50.204519 dv-cinder-855060-2-smb devstack@keystone.service[81630]: warnings.warn(msg) Sep 27 16:36:50.204519 dv-cinder-855060-2-smb devstack@keystone.service[81630]: Sep 27 16:36:50.206178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df056553-034a-4f15-8758-09f0d8f2af49 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:50.440046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-df056553-034a-4f15-8758-09f0d8f2af49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd886724ab9c7423b846cbd173d7ad21f', 'request_id': 'req-df056553-034a-4f15-8758-09f0d8f2af49'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:50.472272 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-df056553-034a-4f15-8758-09f0d8f2af49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd886724ab9c7423b846cbd173d7ad21f', 'request_id': 'req-df056553-034a-4f15-8758-09f0d8f2af49'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:50.630054 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-df056553-034a-4f15-8758-09f0d8f2af49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd886724ab9c7423b846cbd173d7ad21f', 'request_id': 'req-df056553-034a-4f15-8758-09f0d8f2af49'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:50.634203 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:50.649274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-df056553-034a-4f15-8758-09f0d8f2af49 admin admin] The token cache is being invalidate because project d886724ab9c7423b846cbd173d7ad21f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:36:50.652476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-df056553-034a-4f15-8758-09f0d8f2af49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:50.656965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-df056553-034a-4f15-8758-09f0d8f2af49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:50.659474 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 816/1664] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:36:50 2022] DELETE /identity/v3/projects/d886724ab9c7423b846cbd173d7ad21f => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:50.665009 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440608f-9f86-49d2-afe4-6ce9a3664a2e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:50.667511 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440608f-9f86-49d2-afe4-6ce9a3664a2e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:50.667511 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440608f-9f86-49d2-afe4-6ce9a3664a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:50.700376 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1440608f-9f86-49d2-afe4-6ce9a3664a2e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:50.703985 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1440608f-9f86-49d2-afe4-6ce9a3664a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:50.885901 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 849/1665] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:50.892062 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531ddde-58a6-47e7-93fc-17c157bc29ff None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:50.893218 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531ddde-58a6-47e7-93fc-17c157bc29ff None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:50.893701 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531ddde-58a6-47e7-93fc-17c157bc29ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:50.947667 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-b531ddde-58a6-47e7-93fc-17c157bc29ff None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:50.947667 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b531ddde-58a6-47e7-93fc-17c157bc29ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:50.959989 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 817/1666] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:50.965333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440608f-9f86-49d2-afe4-6ce9a3664a2e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:50.979009 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440608f-9f86-49d2-afe4-6ce9a3664a2e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:50.993010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6f6a4-1ec7-466d-81f3-3d134d808f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:50.993695 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6f6a4-1ec7-466d-81f3-3d134d808f9c admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:50.994142 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6f6a4-1ec7-466d-81f3-3d134d808f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:50.994672 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6f6a4-1ec7-466d-81f3-3d134d808f9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:50.996113 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6f6a4-1ec7-466d-81f3-3d134d808f9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:36:50.996589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6f6a4-1ec7-466d-81f3-3d134d808f9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:51.001166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6f6a4-1ec7-466d-81f3-3d134d808f9c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:51.032095 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 850/1667] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:36:51.035520 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531ddde-58a6-47e7-93fc-17c157bc29ff None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:51.046099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531ddde-58a6-47e7-93fc-17c157bc29ff None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:51.052205 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb97ce9-597c-4c13-9dd7-e8c97626948c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:51.052913 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb97ce9-597c-4c13-9dd7-e8c97626948c admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:51.053294 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb97ce9-597c-4c13-9dd7-e8c97626948c admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:51.053629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb97ce9-597c-4c13-9dd7-e8c97626948c admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:51.054469 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb97ce9-597c-4c13-9dd7-e8c97626948c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:51.057378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb97ce9-597c-4c13-9dd7-e8c97626948c admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:51.194571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 818/1668] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:36:51 2022] POST /identity/v3/projects => generated 403 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:51.200114 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6f6a4-1ec7-466d-81f3-3d134d808f9c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:51.214026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6f6a4-1ec7-466d-81f3-3d134d808f9c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:51.241681 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb97ce9-597c-4c13-9dd7-e8c97626948c admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:51.243895 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-dcb97ce9-597c-4c13-9dd7-e8c97626948c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:51.289945 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:51.349447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb97ce9-597c-4c13-9dd7-e8c97626948c admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:51.354736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1dcb7-39b1-4b1d-910e-833b67291070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:51.355617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1dcb7-39b1-4b1d-910e-833b67291070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:51.355906 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1dcb7-39b1-4b1d-910e-833b67291070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:51.356181 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1dcb7-39b1-4b1d-910e-833b67291070 admin admin] PATH_INFO: `/v3/users/3d0fffe647c348b69f51a9464b595500` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:51.359729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1dcb7-39b1-4b1d-910e-833b67291070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d0fffe647c348b69f51a9464b595500)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:51.361774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1dcb7-39b1-4b1d-910e-833b67291070 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:51.362153 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100c516-6649-4f34-9708-6ec5aff89b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:51.363598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100c516-6649-4f34-9708-6ec5aff89b50 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:51.363954 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100c516-6649-4f34-9708-6ec5aff89b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:51.364912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100c516-6649-4f34-9708-6ec5aff89b50 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:51.366209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100c516-6649-4f34-9708-6ec5aff89b50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:51.368677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100c516-6649-4f34-9708-6ec5aff89b50 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:51.508442 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 851/1669] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:36:51 2022] POST /identity/v3/users => generated 302 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:51.513182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100c516-6649-4f34-9708-6ec5aff89b50 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:51.528620 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100c516-6649-4f34-9708-6ec5aff89b50 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:51.536666 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4273e4d-dafc-4eba-98ac-93015c547265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:51.538113 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4273e4d-dafc-4eba-98ac-93015c547265 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:51.539859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4273e4d-dafc-4eba-98ac-93015c547265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:51.541442 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4273e4d-dafc-4eba-98ac-93015c547265 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:51.541442 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4273e4d-dafc-4eba-98ac-93015c547265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:51.544496 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4273e4d-dafc-4eba-98ac-93015c547265 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:51.580294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 852/1670] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:36:51.581439 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4273e4d-dafc-4eba-98ac-93015c547265 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:51.607462 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4273e4d-dafc-4eba-98ac-93015c547265 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:51.625236 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-1bb1dcb7-39b1-4b1d-910e-833b67291070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d0fffe647c348b69f51a9464b595500'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:51.626771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-1bb1dcb7-39b1-4b1d-910e-833b67291070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d0fffe647c348b69f51a9464b595500'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:51.634486 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96404f14-5e44-454e-bf4e-3e344e634881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:51.634486 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96404f14-5e44-454e-bf4e-3e344e634881 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:51.634486 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96404f14-5e44-454e-bf4e-3e344e634881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:51.634486 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96404f14-5e44-454e-bf4e-3e344e634881 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:51.634880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96404f14-5e44-454e-bf4e-3e344e634881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:51.636484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96404f14-5e44-454e-bf4e-3e344e634881 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:51.671293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-1bb1dcb7-39b1-4b1d-910e-833b67291070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d0fffe647c348b69f51a9464b595500'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:51.692947 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 853/1671] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:51.698788 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96404f14-5e44-454e-bf4e-3e344e634881 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:51.702218 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-96404f14-5e44-454e-bf4e-3e344e634881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:51.727084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-1bb1dcb7-39b1-4b1d-910e-833b67291070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d0fffe647c348b69f51a9464b595500'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:51.728299 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-1bb1dcb7-39b1-4b1d-910e-833b67291070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d0fffe647c348b69f51a9464b595500'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:51.767271 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 819/1672] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:36:51 2022] DELETE /identity/v3/users/3d0fffe647c348b69f51a9464b595500 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:51.771223 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac3c14-0b65-46fc-b87c-91c2bdcd7991 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:51.771512 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac3c14-0b65-46fc-b87c-91c2bdcd7991 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:51.771780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac3c14-0b65-46fc-b87c-91c2bdcd7991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:51.772917 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96404f14-5e44-454e-bf4e-3e344e634881 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:51.845172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-e0ac3c14-0b65-46fc-b87c-91c2bdcd7991 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:51.847658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-e0ac3c14-0b65-46fc-b87c-91c2bdcd7991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:51.913037 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db468fb5-166d-4dcd-99f6-87aed291744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:51.918999 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db468fb5-166d-4dcd-99f6-87aed291744f admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:51.919549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db468fb5-166d-4dcd-99f6-87aed291744f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:51.921168 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db468fb5-166d-4dcd-99f6-87aed291744f admin admin] PATH_INFO: `/v3/projects/5f4b7454b58347fcbf72f03154d8195d/users/da2fcae8b7084ba19a7a94b59181bf70/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:51.963515 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db468fb5-166d-4dcd-99f6-87aed291744f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f4b7454b58347fcbf72f03154d8195d, user_id=da2fcae8b7084ba19a7a94b59181bf70, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:51.966269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db468fb5-166d-4dcd-99f6-87aed291744f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:52.064826 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 854/1673] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:36:51 2022] PUT /identity/v3/projects/5f4b7454b58347fcbf72f03154d8195d/users/da2fcae8b7084ba19a7a94b59181bf70/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:36:52.065774 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db468fb5-166d-4dcd-99f6-87aed291744f admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:52.076903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-db468fb5-166d-4dcd-99f6-87aed291744f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:52.089342 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 820/1674] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:52.092240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940ea2e-85c7-4082-b062-b6d95cd3b57d None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:52.092584 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940ea2e-85c7-4082-b062-b6d95cd3b57d None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:52.092866 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940ea2e-85c7-4082-b062-b6d95cd3b57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:52.160378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-a940ea2e-85c7-4082-b062-b6d95cd3b57d None None] MFA Rules not processed for user `da2fcae8b7084ba19a7a94b59181bf70`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:52.161643 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a940ea2e-85c7-4082-b062-b6d95cd3b57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:52.249718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db468fb5-166d-4dcd-99f6-87aed291744f admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:52.259977 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94e326-85c4-4d19-9e6c-5d75bdfcdbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:52.261096 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94e326-85c4-4d19-9e6c-5d75bdfcdbbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:52.262251 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94e326-85c4-4d19-9e6c-5d75bdfcdbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:52.263165 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94e326-85c4-4d19-9e6c-5d75bdfcdbbe admin admin] PATH_INFO: `/v3/users/8a80c818011b4fa1bc4b4244cb3cbe78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:52.268085 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94e326-85c4-4d19-9e6c-5d75bdfcdbbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a80c818011b4fa1bc4b4244cb3cbe78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:52.270659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: WARNING py.warnings [None req-3e94e326-85c4-4d19-9e6c-5d75bdfcdbbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 16:36:52.270659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: warnings.warn(msg) Sep 27 16:36:52.270659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: Sep 27 16:36:52.276648 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94e326-85c4-4d19-9e6c-5d75bdfcdbbe admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:52.277376 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:52.332040 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 821/1675] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:52 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:52.333304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940ea2e-85c7-4082-b062-b6d95cd3b57d None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:52.337150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a940ea2e-85c7-4082-b062-b6d95cd3b57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:52.384728 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:52.463662 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940ea2e-85c7-4082-b062-b6d95cd3b57d None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:52.474243 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a118ba-6a85-4651-a859-5f45ee8f1144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:52.474889 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a118ba-6a85-4651-a859-5f45ee8f1144 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:52.475181 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a118ba-6a85-4651-a859-5f45ee8f1144 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:52.475465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a118ba-6a85-4651-a859-5f45ee8f1144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:52.496122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a118ba-6a85-4651-a859-5f45ee8f1144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:52.497784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a118ba-6a85-4651-a859-5f45ee8f1144 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:52.518458 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 822/1676] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:52.519325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a118ba-6a85-4651-a859-5f45ee8f1144 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:52.537023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a118ba-6a85-4651-a859-5f45ee8f1144 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:52.545680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdaf14-bec3-4bef-8ad2-87d36e399f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:52.547944 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdaf14-bec3-4bef-8ad2-87d36e399f9f admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:52.548535 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdaf14-bec3-4bef-8ad2-87d36e399f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:52.549013 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdaf14-bec3-4bef-8ad2-87d36e399f9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:52.549868 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdaf14-bec3-4bef-8ad2-87d36e399f9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:52.552728 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdaf14-bec3-4bef-8ad2-87d36e399f9f admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:52.677652 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 823/1677] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:36:52 2022] POST /identity/v3/projects => generated 403 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:52.684495 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdaf14-bec3-4bef-8ad2-87d36e399f9f admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:52.710994 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3e94e326-85c4-4d19-9e6c-5d75bdfcdbbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a80c818011b4fa1bc4b4244cb3cbe78'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:52.712575 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3e94e326-85c4-4d19-9e6c-5d75bdfcdbbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a80c818011b4fa1bc4b4244cb3cbe78'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:52.765179 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3e94e326-85c4-4d19-9e6c-5d75bdfcdbbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a80c818011b4fa1bc4b4244cb3cbe78'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:52.839475 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdaf14-bec3-4bef-8ad2-87d36e399f9f admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:52.850469 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbff72-3446-4067-9f59-ec1c68c13f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:52.851906 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbff72-3446-4067-9f59-ec1c68c13f4a admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:52.852472 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbff72-3446-4067-9f59-ec1c68c13f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:52.853006 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbff72-3446-4067-9f59-ec1c68c13f4a admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:52.853915 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bbff72-3446-4067-9f59-ec1c68c13f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:52.856432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bbff72-3446-4067-9f59-ec1c68c13f4a admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:52.875327 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3e94e326-85c4-4d19-9e6c-5d75bdfcdbbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a80c818011b4fa1bc4b4244cb3cbe78'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:52.877390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3e94e326-85c4-4d19-9e6c-5d75bdfcdbbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a80c818011b4fa1bc4b4244cb3cbe78'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:52.912658 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 855/1678] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:36:52 2022] DELETE /identity/v3/users/8a80c818011b4fa1bc4b4244cb3cbe78 => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:52.917383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb419d2-8d50-4ddb-92bd-10edc93fd625 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:52.917814 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb419d2-8d50-4ddb-92bd-10edc93fd625 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:52.918445 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb419d2-8d50-4ddb-92bd-10edc93fd625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:52.955149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 824/1679] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:36:52 2022] POST /identity/v3/users => generated 308 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:52.959172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbff72-3446-4067-9f59-ec1c68c13f4a admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:52.963916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-79bbff72-3446-4067-9f59-ec1c68c13f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:52.986422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ffb419d2-8d50-4ddb-92bd-10edc93fd625 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:52.991274 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ffb419d2-8d50-4ddb-92bd-10edc93fd625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:52.992203 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbff72-3446-4067-9f59-ec1c68c13f4a admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:53.150158 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 856/1680] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:53.205127 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2643a6-8d26-4bbe-a94c-7f559649f877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:53.207188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2643a6-8d26-4bbe-a94c-7f559649f877 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:53.207188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2643a6-8d26-4bbe-a94c-7f559649f877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:53.207448 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2643a6-8d26-4bbe-a94c-7f559649f877 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:53.214642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2643a6-8d26-4bbe-a94c-7f559649f877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:53.218734 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2643a6-8d26-4bbe-a94c-7f559649f877 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:53.244237 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb419d2-8d50-4ddb-92bd-10edc93fd625 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:53.246090 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ffb419d2-8d50-4ddb-92bd-10edc93fd625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:53.264937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 825/1681] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:53.269377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2643a6-8d26-4bbe-a94c-7f559649f877 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:53.298468 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2643a6-8d26-4bbe-a94c-7f559649f877 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:53.325678 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d786cab-f7cc-4f2c-85b2-b17247bf2a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:53.328741 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d786cab-f7cc-4f2c-85b2-b17247bf2a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:53.329065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d786cab-f7cc-4f2c-85b2-b17247bf2a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:53.329348 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d786cab-f7cc-4f2c-85b2-b17247bf2a5e admin admin] PATH_INFO: `/v3/projects/80987c2bf22a4f4eb1e5db9a41229618/users/d5c22cf08bbc4a4c8bbc9d4e7a0b6935/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:53.405096 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d786cab-f7cc-4f2c-85b2-b17247bf2a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=80987c2bf22a4f4eb1e5db9a41229618, user_id=d5c22cf08bbc4a4c8bbc9d4e7a0b6935, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:53.458303 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d786cab-f7cc-4f2c-85b2-b17247bf2a5e admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:53.581447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb419d2-8d50-4ddb-92bd-10edc93fd625 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:53.585595 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 826/1682] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:36:53 2022] PUT /identity/v3/projects/80987c2bf22a4f4eb1e5db9a41229618/users/d5c22cf08bbc4a4c8bbc9d4e7a0b6935/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:53.590255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d786cab-f7cc-4f2c-85b2-b17247bf2a5e admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:53.689035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:53.718292 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381c8eb-7bdc-4512-aecd-befe63932da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:53.719655 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381c8eb-7bdc-4512-aecd-befe63932da2 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:53.720253 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381c8eb-7bdc-4512-aecd-befe63932da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:53.720763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381c8eb-7bdc-4512-aecd-befe63932da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:53.852838 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d786cab-f7cc-4f2c-85b2-b17247bf2a5e admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:53.867171 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756bf16-bcc9-4321-b0c6-21531918804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:53.868196 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756bf16-bcc9-4321-b0c6-21531918804d admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:53.868196 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756bf16-bcc9-4321-b0c6-21531918804d admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:53.868493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756bf16-bcc9-4321-b0c6-21531918804d admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:53.869441 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756bf16-bcc9-4321-b0c6-21531918804d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:53.870736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756bf16-bcc9-4321-b0c6-21531918804d admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:53.939013 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 827/1683] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:36:53.943837 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756bf16-bcc9-4321-b0c6-21531918804d admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:53.981119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:53.981311 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756bf16-bcc9-4321-b0c6-21531918804d admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:53.989562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381c8eb-7bdc-4512-aecd-befe63932da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:53.993887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381c8eb-7bdc-4512-aecd-befe63932da2 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:54.000820 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2205198-a6ee-4efe-98ca-9ef37f0a475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:54.001501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2205198-a6ee-4efe-98ca-9ef37f0a475b admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:54.001829 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2205198-a6ee-4efe-98ca-9ef37f0a475b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:54.002108 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2205198-a6ee-4efe-98ca-9ef37f0a475b admin admin] PATH_INFO: `/v3/projects/80987c2bf22a4f4eb1e5db9a41229618/users/d5c22cf08bbc4a4c8bbc9d4e7a0b6935/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:54.005907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2205198-a6ee-4efe-98ca-9ef37f0a475b admin admin] RBAC: Authorizing `identity:create_grant(project_id=80987c2bf22a4f4eb1e5db9a41229618, user_id=d5c22cf08bbc4a4c8bbc9d4e7a0b6935, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:54.015161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2205198-a6ee-4efe-98ca-9ef37f0a475b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:54.018444 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 857/1684] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 775 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:36:54.044296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 828/1685] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:36:53 2022] PUT /identity/v3/projects/80987c2bf22a4f4eb1e5db9a41229618/users/d5c22cf08bbc4a4c8bbc9d4e7a0b6935/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:54.056473 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f54dd-3795-4246-8eed-dd47a28ba9da None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:54.056766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f54dd-3795-4246-8eed-dd47a28ba9da None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:54.057069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f54dd-3795-4246-8eed-dd47a28ba9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:54.149113 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c30f54dd-3795-4246-8eed-dd47a28ba9da None None] MFA Rules not processed for user `d5c22cf08bbc4a4c8bbc9d4e7a0b6935`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:54.151697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c30f54dd-3795-4246-8eed-dd47a28ba9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:54.441650 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 858/1686] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:54 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:54.457102 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2205198-a6ee-4efe-98ca-9ef37f0a475b admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:54.459074 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b2205198-a6ee-4efe-98ca-9ef37f0a475b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:54.568675 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:54.591413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2205198-a6ee-4efe-98ca-9ef37f0a475b admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:54.599145 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6ccb1-cf71-4298-8416-557777a8b11e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:54.600282 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6ccb1-cf71-4298-8416-557777a8b11e service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:54.600693 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6ccb1-cf71-4298-8416-557777a8b11e service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:54.601026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6ccb1-cf71-4298-8416-557777a8b11e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:54.615246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6ccb1-cf71-4298-8416-557777a8b11e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:54.617200 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6ccb1-cf71-4298-8416-557777a8b11e service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:54.620867 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db524502-10f5-4cc1-8ba8-c510da37d6c0 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:54.621164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db524502-10f5-4cc1-8ba8-c510da37d6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:54.622089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db524502-10f5-4cc1-8ba8-c510da37d6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:54.684970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 829/1687] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:54 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:54.786211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-db524502-10f5-4cc1-8ba8-c510da37d6c0 None None] MFA Rules not processed for user `0c8d0a718e8347b5af397f866056266e`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:54.787646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-db524502-10f5-4cc1-8ba8-c510da37d6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:54.827595 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6ccb1-cf71-4298-8416-557777a8b11e service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:54.829795 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-e3f6ccb1-cf71-4298-8416-557777a8b11e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:55.030828 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 859/1688] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 27 16:36:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:55.039573 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db524502-10f5-4cc1-8ba8-c510da37d6c0 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:55.058737 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6ccb1-cf71-4298-8416-557777a8b11e service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:55.073915 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db524502-10f5-4cc1-8ba8-c510da37d6c0 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:55.089841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d85426-16dd-42bd-af1d-852bf03cb155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:55.090421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d85426-16dd-42bd-af1d-852bf03cb155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:55.090545 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03240868-624b-41f0-b80f-42db83025750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:55.091048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d85426-16dd-42bd-af1d-852bf03cb155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:55.091458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d85426-16dd-42bd-af1d-852bf03cb155 admin admin] PATH_INFO: `/v3/users/da2fcae8b7084ba19a7a94b59181bf70` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:55.092725 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03240868-624b-41f0-b80f-42db83025750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:55.093012 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03240868-624b-41f0-b80f-42db83025750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:55.093284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03240868-624b-41f0-b80f-42db83025750 admin admin] PATH_INFO: `/v3/projects/10d72d74b5d840128f378a6ad861a52a` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:55.093391 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d85426-16dd-42bd-af1d-852bf03cb155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da2fcae8b7084ba19a7a94b59181bf70)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:55.095565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d85426-16dd-42bd-af1d-852bf03cb155 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:55.099760 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03240868-624b-41f0-b80f-42db83025750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d72d74b5d840128f378a6ad861a52a)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:55.107088 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03240868-624b-41f0-b80f-42db83025750 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:55.497933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-03240868-624b-41f0-b80f-42db83025750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d72d74b5d840128f378a6ad861a52a', 'request_id': 'req-03240868-624b-41f0-b80f-42db83025750'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:55.504704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:55.525985 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-03240868-624b-41f0-b80f-42db83025750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d72d74b5d840128f378a6ad861a52a', 'request_id': 'req-03240868-624b-41f0-b80f-42db83025750'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:55.531174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-85d85426-16dd-42bd-af1d-852bf03cb155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2fcae8b7084ba19a7a94b59181bf70'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:55.532716 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-85d85426-16dd-42bd-af1d-852bf03cb155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2fcae8b7084ba19a7a94b59181bf70'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:55.593883 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-85d85426-16dd-42bd-af1d-852bf03cb155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2fcae8b7084ba19a7a94b59181bf70'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:55.641024 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-03240868-624b-41f0-b80f-42db83025750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d72d74b5d840128f378a6ad861a52a', 'request_id': 'req-03240868-624b-41f0-b80f-42db83025750'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:55.656730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-03240868-624b-41f0-b80f-42db83025750 admin admin] The token cache is being invalidate because project 10d72d74b5d840128f378a6ad861a52a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:36:55.657029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-03240868-624b-41f0-b80f-42db83025750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:55.659668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-03240868-624b-41f0-b80f-42db83025750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:55.663713 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 830/1689] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:36:54 2022] DELETE /identity/v3/projects/10d72d74b5d840128f378a6ad861a52a => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:36:55.664963 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03240868-624b-41f0-b80f-42db83025750 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:55.667387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-03240868-624b-41f0-b80f-42db83025750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:55.807160 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-85d85426-16dd-42bd-af1d-852bf03cb155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2fcae8b7084ba19a7a94b59181bf70'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:55.808031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-85d85426-16dd-42bd-af1d-852bf03cb155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2fcae8b7084ba19a7a94b59181bf70'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:55.845178 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 860/1690] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:36:55 2022] DELETE /identity/v3/users/da2fcae8b7084ba19a7a94b59181bf70 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:55.848426 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d85426-16dd-42bd-af1d-852bf03cb155 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:55.853892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-85d85426-16dd-42bd-af1d-852bf03cb155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:55.961918 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03240868-624b-41f0-b80f-42db83025750 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:56.019380 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:56.073483 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d85426-16dd-42bd-af1d-852bf03cb155 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:56.099228 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791ddc2-9dea-4f99-b836-e34c94e65fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:56.099512 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92660f29-20cb-4489-bec7-bcb9d41f8e25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b85e430004a8b865622354c1d1ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:56.100147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92660f29-20cb-4489-bec7-bcb9d41f8e25 service swift] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:56.100451 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92660f29-20cb-4489-bec7-bcb9d41f8e25 service swift] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:56.100561 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791ddc2-9dea-4f99-b836-e34c94e65fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:56.100722 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92660f29-20cb-4489-bec7-bcb9d41f8e25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:56.101097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791ddc2-9dea-4f99-b836-e34c94e65fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:56.101512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791ddc2-9dea-4f99-b836-e34c94e65fcd admin admin] PATH_INFO: `/v3/users/b316a96aa6d641d688f0fde970256f54` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:56.104275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-92660f29-20cb-4489-bec7-bcb9d41f8e25 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:56.105150 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791ddc2-9dea-4f99-b836-e34c94e65fcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b316a96aa6d641d688f0fde970256f54)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:56.108071 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791ddc2-9dea-4f99-b836-e34c94e65fcd admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:56.261010 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92660f29-20cb-4489-bec7-bcb9d41f8e25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:56.266882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92660f29-20cb-4489-bec7-bcb9d41f8e25 service swift] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:56.332357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 831/1691] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 27 16:36:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 16:36:56.333574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23997a3f-3218-4e1a-8570-4aeeff12ff06 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:56.333912 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23997a3f-3218-4e1a-8570-4aeeff12ff06 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:56.334124 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23997a3f-3218-4e1a-8570-4aeeff12ff06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:56.369468 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7791ddc2-9dea-4f99-b836-e34c94e65fcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b316a96aa6d641d688f0fde970256f54'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:56.370178 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7791ddc2-9dea-4f99-b836-e34c94e65fcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b316a96aa6d641d688f0fde970256f54'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:56.393480 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-23997a3f-3218-4e1a-8570-4aeeff12ff06 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:56.394742 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-23997a3f-3218-4e1a-8570-4aeeff12ff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:56.403316 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7791ddc2-9dea-4f99-b836-e34c94e65fcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b316a96aa6d641d688f0fde970256f54'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:56.422396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 832/1692] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:56.427280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23997a3f-3218-4e1a-8570-4aeeff12ff06 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:56.436799 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-23997a3f-3218-4e1a-8570-4aeeff12ff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:56.466013 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23997a3f-3218-4e1a-8570-4aeeff12ff06 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:56.475508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7791ddc2-9dea-4f99-b836-e34c94e65fcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b316a96aa6d641d688f0fde970256f54'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:56.476169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7791ddc2-9dea-4f99-b836-e34c94e65fcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b316a96aa6d641d688f0fde970256f54'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:56.486802 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:56.495730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b187816-0793-4c2b-9f78-350942c3c5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:56.496439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b187816-0793-4c2b-9f78-350942c3c5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:56.496717 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b187816-0793-4c2b-9f78-350942c3c5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:56.496979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b187816-0793-4c2b-9f78-350942c3c5a6 admin admin] PATH_INFO: `/v3/projects/8767923077094a6e801bc81bd0a4c2bf` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:56.503209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 861/1693] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:36:55 2022] DELETE /identity/v3/users/b316a96aa6d641d688f0fde970256f54 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:56.508952 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b187816-0793-4c2b-9f78-350942c3c5a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8767923077094a6e801bc81bd0a4c2bf)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:56.521851 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b187816-0793-4c2b-9f78-350942c3c5a6 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:56.573259 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791ddc2-9dea-4f99-b836-e34c94e65fcd admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:56.575291 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7791ddc2-9dea-4f99-b836-e34c94e65fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:56.741672 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791ddc2-9dea-4f99-b836-e34c94e65fcd admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:56.752188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a925e-b479-4853-94cc-f66a94727dd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:56.752869 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a925e-b479-4853-94cc-f66a94727dd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:56.753154 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a925e-b479-4853-94cc-f66a94727dd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:56.753430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a925e-b479-4853-94cc-f66a94727dd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:56.833174 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4b187816-0793-4c2b-9f78-350942c3c5a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8767923077094a6e801bc81bd0a4c2bf', 'request_id': 'req-4b187816-0793-4c2b-9f78-350942c3c5a6'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:56.870446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4b187816-0793-4c2b-9f78-350942c3c5a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8767923077094a6e801bc81bd0a4c2bf', 'request_id': 'req-4b187816-0793-4c2b-9f78-350942c3c5a6'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:56.995576 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4b187816-0793-4c2b-9f78-350942c3c5a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8767923077094a6e801bc81bd0a4c2bf', 'request_id': 'req-4b187816-0793-4c2b-9f78-350942c3c5a6'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:57.026890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4b187816-0793-4c2b-9f78-350942c3c5a6 admin admin] The token cache is being invalidate because project 8767923077094a6e801bc81bd0a4c2bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:36:57.027191 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4b187816-0793-4c2b-9f78-350942c3c5a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:57.028166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4b187816-0793-4c2b-9f78-350942c3c5a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:57.035074 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 833/1694] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:36:56 2022] DELETE /identity/v3/projects/8767923077094a6e801bc81bd0a4c2bf => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:57.036087 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc1154-bdb0-4039-b35f-2c757e340fd1 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:57.036392 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc1154-bdb0-4039-b35f-2c757e340fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:57.036674 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc1154-bdb0-4039-b35f-2c757e340fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:57.064074 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a925e-b479-4853-94cc-f66a94727dd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:57.066152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a925e-b479-4853-94cc-f66a94727dd3 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:57.084541 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 862/1695] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:36:57.085794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a925e-b479-4853-94cc-f66a94727dd3 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:57.099783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-b0bc1154-bdb0-4039-b35f-2c757e340fd1 None None] MFA Rules not processed for user `a84e162448a64727acdb841c839a384d`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:57.101439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b0bc1154-bdb0-4039-b35f-2c757e340fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:57.111804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a925e-b479-4853-94cc-f66a94727dd3 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:57.276827 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 834/1696] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:57.292393 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f3197-1802-4cf4-8a02-60fe2d4b50bc None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:57.292393 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f3197-1802-4cf4-8a02-60fe2d4b50bc None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:57.292393 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f3197-1802-4cf4-8a02-60fe2d4b50bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:57.327610 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504294a0-c782-437f-a990-0800c164fed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:57.331940 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504294a0-c782-437f-a990-0800c164fed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:57.332381 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504294a0-c782-437f-a990-0800c164fed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:57.332665 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504294a0-c782-437f-a990-0800c164fed1 admin admin] PATH_INFO: `/v3/users/cf613d72bc2b44aaa2f7946b37fbc1bd` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:57.334932 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504294a0-c782-437f-a990-0800c164fed1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf613d72bc2b44aaa2f7946b37fbc1bd)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:57.340315 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504294a0-c782-437f-a990-0800c164fed1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:57.374548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-6e6f3197-1802-4cf4-8a02-60fe2d4b50bc None None] MFA Rules not processed for user `a84e162448a64727acdb841c839a384d`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:57.379261 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6e6f3197-1802-4cf4-8a02-60fe2d4b50bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:57.426865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 835/1697] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:36:57.436884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f3197-1802-4cf4-8a02-60fe2d4b50bc None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:57.438697 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6e6f3197-1802-4cf4-8a02-60fe2d4b50bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:57.625830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f3197-1802-4cf4-8a02-60fe2d4b50bc None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:57.640690 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-504294a0-c782-437f-a990-0800c164fed1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf613d72bc2b44aaa2f7946b37fbc1bd'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:57.642453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-504294a0-c782-437f-a990-0800c164fed1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf613d72bc2b44aaa2f7946b37fbc1bd'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:57.649398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70acf2-eae2-4e3c-8886-f3a6741495d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:57.650441 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70acf2-eae2-4e3c-8886-f3a6741495d2 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:57.650623 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70acf2-eae2-4e3c-8886-f3a6741495d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:57.650902 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70acf2-eae2-4e3c-8886-f3a6741495d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:57.658183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-df70acf2-eae2-4e3c-8886-f3a6741495d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:57.686212 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70acf2-eae2-4e3c-8886-f3a6741495d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:57.687893 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70acf2-eae2-4e3c-8886-f3a6741495d2 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:57.699624 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-504294a0-c782-437f-a990-0800c164fed1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf613d72bc2b44aaa2f7946b37fbc1bd'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:57.714894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 836/1698] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:57 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:57.716561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc834a-78d8-4e10-a924-622b624e81b9 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:57.717626 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc834a-78d8-4e10-a924-622b624e81b9 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:57.718190 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc834a-78d8-4e10-a924-622b624e81b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:57.778197 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-504294a0-c782-437f-a990-0800c164fed1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf613d72bc2b44aaa2f7946b37fbc1bd'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:57.778989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-504294a0-c782-437f-a990-0800c164fed1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf613d72bc2b44aaa2f7946b37fbc1bd'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:57.797520 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-0bfc834a-78d8-4e10-a924-622b624e81b9 None None] MFA Rules not processed for user `6d32130690454568b620faa8957ce111`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:57.804627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-0bfc834a-78d8-4e10-a924-622b624e81b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:57.837508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 863/1699] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:36:57 2022] DELETE /identity/v3/users/cf613d72bc2b44aaa2f7946b37fbc1bd => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:57.986704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504294a0-c782-437f-a990-0800c164fed1 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:57.988203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-504294a0-c782-437f-a990-0800c164fed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:58.058611 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:58.131734 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 837/1700] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:58.195034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504294a0-c782-437f-a990-0800c164fed1 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:58.203958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b9b20-51cf-4b6e-94ae-0bdbde8b0488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:58.205456 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b9b20-51cf-4b6e-94ae-0bdbde8b0488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:58.206406 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b9b20-51cf-4b6e-94ae-0bdbde8b0488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:58.207516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b9b20-51cf-4b6e-94ae-0bdbde8b0488 admin admin] PATH_INFO: `/v3/projects/00baa293751c46c4aca9f551ebaf7f75` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:58.264476 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:58.266964 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b9b20-51cf-4b6e-94ae-0bdbde8b0488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00baa293751c46c4aca9f551ebaf7f75)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:58.280705 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b9b20-51cf-4b6e-94ae-0bdbde8b0488 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:58.326979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc834a-78d8-4e10-a924-622b624e81b9 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:58.329515 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-0bfc834a-78d8-4e10-a924-622b624e81b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:58.379721 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc834a-78d8-4e10-a924-622b624e81b9 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:58.510875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9bb8f-62e3-4a91-91b2-098a9fed0fff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:58.511849 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9bb8f-62e3-4a91-91b2-098a9fed0fff service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:58.512264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9bb8f-62e3-4a91-91b2-098a9fed0fff service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:58.512598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9bb8f-62e3-4a91-91b2-098a9fed0fff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:58.626479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9bb8f-62e3-4a91-91b2-098a9fed0fff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:58.634301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9bb8f-62e3-4a91-91b2-098a9fed0fff service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:58.661546 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 838/1701] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:36:58.890198 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9e1b9b20-51cf-4b6e-94ae-0bdbde8b0488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00baa293751c46c4aca9f551ebaf7f75', 'request_id': 'req-9e1b9b20-51cf-4b6e-94ae-0bdbde8b0488'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:58.901172 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9e1b9b20-51cf-4b6e-94ae-0bdbde8b0488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00baa293751c46c4aca9f551ebaf7f75', 'request_id': 'req-9e1b9b20-51cf-4b6e-94ae-0bdbde8b0488'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:59.061752 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9e1b9b20-51cf-4b6e-94ae-0bdbde8b0488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00baa293751c46c4aca9f551ebaf7f75', 'request_id': 'req-9e1b9b20-51cf-4b6e-94ae-0bdbde8b0488'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:59.093117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9e1b9b20-51cf-4b6e-94ae-0bdbde8b0488 admin admin] The token cache is being invalidate because project 00baa293751c46c4aca9f551ebaf7f75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:36:59.093808 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9e1b9b20-51cf-4b6e-94ae-0bdbde8b0488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:59.095346 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9e1b9b20-51cf-4b6e-94ae-0bdbde8b0488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:36:59.106166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5693b6-b8bd-4c51-af00-b7c6d6cf48db None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:59.106802 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5693b6-b8bd-4c51-af00-b7c6d6cf48db None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:59.107273 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5693b6-b8bd-4c51-af00-b7c6d6cf48db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:59.124604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 864/1702] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:36:57 2022] DELETE /identity/v3/projects/00baa293751c46c4aca9f551ebaf7f75 => generated 0 bytes in 1112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:36:59.174967 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-6a5693b6-b8bd-4c51-af00-b7c6d6cf48db None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:59.177891 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6a5693b6-b8bd-4c51-af00-b7c6d6cf48db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:59.325608 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afded78f-ccad-4539-9e54-72dd2f8cd24a None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:59.325608 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afded78f-ccad-4539-9e54-72dd2f8cd24a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:59.325608 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afded78f-ccad-4539-9e54-72dd2f8cd24a None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:59.327832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 865/1703] 10.222.0.26 () {54 vars in 912 bytes} [Tue Sep 27 16:36:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:36:59.333315 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923f226-3a1e-4dea-8b73-95ac91117627 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:59.334096 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923f226-3a1e-4dea-8b73-95ac91117627 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:59.335507 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923f226-3a1e-4dea-8b73-95ac91117627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:59.376824 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 839/1704] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:59.380383 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a82d25-43bc-497f-83f4-12e8d6b571ab None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:59.380383 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a82d25-43bc-497f-83f4-12e8d6b571ab None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:59.380383 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a82d25-43bc-497f-83f4-12e8d6b571ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:59.387803 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1923f226-3a1e-4dea-8b73-95ac91117627 None None] MFA Rules not processed for user `758380280e33458f8f9112147d5a7819`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:59.387803 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1923f226-3a1e-4dea-8b73-95ac91117627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:59.408203 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-d6a82d25-43bc-497f-83f4-12e8d6b571ab None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:36:59.410396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-d6a82d25-43bc-497f-83f4-12e8d6b571ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:59.428074 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 840/1705] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:36:59.429343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a82d25-43bc-497f-83f4-12e8d6b571ab None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:59.448271 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a82d25-43bc-497f-83f4-12e8d6b571ab None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:59.461585 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f61b8a-eed5-4edf-8921-948dfa946c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:59.463637 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f61b8a-eed5-4edf-8921-948dfa946c54 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:59.463953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f61b8a-eed5-4edf-8921-948dfa946c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:59.464233 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f61b8a-eed5-4edf-8921-948dfa946c54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:59.464946 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f61b8a-eed5-4edf-8921-948dfa946c54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:36:59.465255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f61b8a-eed5-4edf-8921-948dfa946c54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:59.466942 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f61b8a-eed5-4edf-8921-948dfa946c54 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:59.522893 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 841/1706] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:36:59.527413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f61b8a-eed5-4edf-8921-948dfa946c54 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:59.567369 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f61b8a-eed5-4edf-8921-948dfa946c54 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:59.614946 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc261ea6-3bbb-4aa7-8d03-680b9eb37359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:59.619509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc261ea6-3bbb-4aa7-8d03-680b9eb37359 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:59.623918 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 866/1707] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 27 16:36:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:36:59.624165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc261ea6-3bbb-4aa7-8d03-680b9eb37359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:59.624165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc261ea6-3bbb-4aa7-8d03-680b9eb37359 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:59.624165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc261ea6-3bbb-4aa7-8d03-680b9eb37359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:59.625611 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc261ea6-3bbb-4aa7-8d03-680b9eb37359 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:59.655539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923f226-3a1e-4dea-8b73-95ac91117627 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:59.657216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1923f226-3a1e-4dea-8b73-95ac91117627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:36:59.665106 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:59.686883 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923f226-3a1e-4dea-8b73-95ac91117627 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:36:59.697090 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d1de4-a32b-4e2b-b42f-c43f005ed47b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:36:59.697846 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d1de4-a32b-4e2b-b42f-c43f005ed47b service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:36:59.698235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d1de4-a32b-4e2b-b42f-c43f005ed47b service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:36:59.698617 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d1de4-a32b-4e2b-b42f-c43f005ed47b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:36:59.710370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:59.729392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d1de4-a32b-4e2b-b42f-c43f005ed47b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:36:59.732521 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d1de4-a32b-4e2b-b42f-c43f005ed47b service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:36:59.786450 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 867/1708] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:36:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:36:59.867340 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d1de4-a32b-4e2b-b42f-c43f005ed47b service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:36:59.882773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 842/1709] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:36:59 2022] POST /identity/v3/projects => generated 387 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:36:59.898491 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d1de4-a32b-4e2b-b42f-c43f005ed47b service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:00.129170 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3ea88-7e08-4c4e-90ee-8cf5e850dcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:00.133562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3ea88-7e08-4c4e-90ee-8cf5e850dcac admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:00.133562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3ea88-7e08-4c4e-90ee-8cf5e850dcac admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:00.133562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3ea88-7e08-4c4e-90ee-8cf5e850dcac admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:00.133562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3ea88-7e08-4c4e-90ee-8cf5e850dcac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:00.133562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3ea88-7e08-4c4e-90ee-8cf5e850dcac admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:00.246169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 868/1710] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:36:59 2022] POST /identity/v3/users => generated 294 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:00.247101 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc261ea6-3bbb-4aa7-8d03-680b9eb37359 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:00.255402 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:00.272895 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc261ea6-3bbb-4aa7-8d03-680b9eb37359 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:00.284395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3c8a5-4734-4b30-8edc-1f6516ac8523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:00.284395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3c8a5-4734-4b30-8edc-1f6516ac8523 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:00.291970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3c8a5-4734-4b30-8edc-1f6516ac8523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:00.292289 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3c8a5-4734-4b30-8edc-1f6516ac8523 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:00.294693 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3c8a5-4734-4b30-8edc-1f6516ac8523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:00.313037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3c8a5-4734-4b30-8edc-1f6516ac8523 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:00.368898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 843/1711] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:00.373353 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3ea88-7e08-4c4e-90ee-8cf5e850dcac admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:00.399569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3ea88-7e08-4c4e-90ee-8cf5e850dcac admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:00.411744 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e45add-eda6-4821-b341-b79bc995cd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:00.412626 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e45add-eda6-4821-b341-b79bc995cd11 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:00.412909 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e45add-eda6-4821-b341-b79bc995cd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:00.413282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e45add-eda6-4821-b341-b79bc995cd11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:00.414580 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e45add-eda6-4821-b341-b79bc995cd11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:00.416445 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e45add-eda6-4821-b341-b79bc995cd11 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:00.465800 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 869/1712] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:00.466563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3c8a5-4734-4b30-8edc-1f6516ac8523 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:00.484792 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3c8a5-4734-4b30-8edc-1f6516ac8523 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:00.503271 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f88a64-b51d-49fb-ab26-0c21f1c8c48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:00.516801 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f88a64-b51d-49fb-ab26-0c21f1c8c48a admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:00.518835 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f88a64-b51d-49fb-ab26-0c21f1c8c48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:00.518835 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f88a64-b51d-49fb-ab26-0c21f1c8c48a admin admin] PATH_INFO: `/v3/projects/94afe06cfd3943a2b02ae2b12fac3d1f/users/ab95051b0ddb43c48d8127a68c04bf14/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:00.561792 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfb15e-3aaf-48fa-9727-37d21ff22679 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:00.562295 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfb15e-3aaf-48fa-9727-37d21ff22679 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:00.562429 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfb15e-3aaf-48fa-9727-37d21ff22679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:00.612394 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4dbfb15e-3aaf-48fa-9727-37d21ff22679 None None] MFA Rules not processed for user `758380280e33458f8f9112147d5a7819`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:00.619852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4dbfb15e-3aaf-48fa-9727-37d21ff22679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:00.634153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f88a64-b51d-49fb-ab26-0c21f1c8c48a admin admin] RBAC: Authorizing `identity:create_grant(project_id=94afe06cfd3943a2b02ae2b12fac3d1f, user_id=ab95051b0ddb43c48d8127a68c04bf14, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:00.649367 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f88a64-b51d-49fb-ab26-0c21f1c8c48a admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:00.719336 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 870/1713] 10.222.0.52 () {58 vars in 1015 bytes} [Tue Sep 27 16:37:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:00.780149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 844/1714] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:00 2022] PUT /identity/v3/projects/94afe06cfd3943a2b02ae2b12fac3d1f/users/ab95051b0ddb43c48d8127a68c04bf14/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:00.790323 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfb15e-3aaf-48fa-9727-37d21ff22679 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:00.797587 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f88a64-b51d-49fb-ab26-0c21f1c8c48a admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:00.797768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4dbfb15e-3aaf-48fa-9727-37d21ff22679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:00.802572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-d7f88a64-b51d-49fb-ab26-0c21f1c8c48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:00.849497 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfb15e-3aaf-48fa-9727-37d21ff22679 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:01.034464 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f88a64-b51d-49fb-ab26-0c21f1c8c48a admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:01.038913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7fc8b-47fa-49e5-9893-215384398d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:01.042835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7fc8b-47fa-49e5-9893-215384398d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:01.042835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7fc8b-47fa-49e5-9893-215384398d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:01.042835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7fc8b-47fa-49e5-9893-215384398d7d admin admin] PATH_INFO: `/v3/projects/4c3b94a301504b2f9b6e2ebf6d827c08` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:01.043351 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883c134-41b5-4e30-bf8f-0f40ba016807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:01.045049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7fc8b-47fa-49e5-9893-215384398d7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c3b94a301504b2f9b6e2ebf6d827c08)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:01.048106 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883c134-41b5-4e30-bf8f-0f40ba016807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:01.048790 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883c134-41b5-4e30-bf8f-0f40ba016807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:01.049076 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883c134-41b5-4e30-bf8f-0f40ba016807 admin admin] PATH_INFO: `/v3/projects/5f4b7454b58347fcbf72f03154d8195d` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:01.051916 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7fc8b-47fa-49e5-9893-215384398d7d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:01.055078 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883c134-41b5-4e30-bf8f-0f40ba016807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f4b7454b58347fcbf72f03154d8195d)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:01.056690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883c134-41b5-4e30-bf8f-0f40ba016807 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:01.103917 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:01.247480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0de7fc8b-47fa-49e5-9893-215384398d7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c3b94a301504b2f9b6e2ebf6d827c08', 'request_id': 'req-0de7fc8b-47fa-49e5-9893-215384398d7d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:01.255807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0de7fc8b-47fa-49e5-9893-215384398d7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c3b94a301504b2f9b6e2ebf6d827c08', 'request_id': 'req-0de7fc8b-47fa-49e5-9893-215384398d7d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:01.314110 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-5883c134-41b5-4e30-bf8f-0f40ba016807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f4b7454b58347fcbf72f03154d8195d', 'request_id': 'req-5883c134-41b5-4e30-bf8f-0f40ba016807'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:01.321364 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-5883c134-41b5-4e30-bf8f-0f40ba016807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f4b7454b58347fcbf72f03154d8195d', 'request_id': 'req-5883c134-41b5-4e30-bf8f-0f40ba016807'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:01.354970 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0de7fc8b-47fa-49e5-9893-215384398d7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c3b94a301504b2f9b6e2ebf6d827c08', 'request_id': 'req-0de7fc8b-47fa-49e5-9893-215384398d7d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:01.389749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0de7fc8b-47fa-49e5-9893-215384398d7d admin admin] The token cache is being invalidate because project 4c3b94a301504b2f9b6e2ebf6d827c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:01.390412 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0de7fc8b-47fa-49e5-9893-215384398d7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:01.394581 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0de7fc8b-47fa-49e5-9893-215384398d7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:01.397451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 871/1715] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:00 2022] DELETE /identity/v3/projects/4c3b94a301504b2f9b6e2ebf6d827c08 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:01.397689 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e328b-8aa6-4ace-b48c-3c293962e2bc None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:01.397976 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e328b-8aa6-4ace-b48c-3c293962e2bc None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:01.398255 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e328b-8aa6-4ace-b48c-3c293962e2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:01.466242 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-5883c134-41b5-4e30-bf8f-0f40ba016807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f4b7454b58347fcbf72f03154d8195d', 'request_id': 'req-5883c134-41b5-4e30-bf8f-0f40ba016807'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:01.493143 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-5883c134-41b5-4e30-bf8f-0f40ba016807 admin admin] The token cache is being invalidate because project 5f4b7454b58347fcbf72f03154d8195d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:01.494966 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-5883c134-41b5-4e30-bf8f-0f40ba016807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:01.494966 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-5883c134-41b5-4e30-bf8f-0f40ba016807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:01.497502 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 845/1716] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:00 2022] DELETE /identity/v3/projects/5f4b7454b58347fcbf72f03154d8195d => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:01.499055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883c134-41b5-4e30-bf8f-0f40ba016807 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:01.507243 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-5883c134-41b5-4e30-bf8f-0f40ba016807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:01.530326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1e8e328b-8aa6-4ace-b48c-3c293962e2bc None None] MFA Rules not processed for user `ab95051b0ddb43c48d8127a68c04bf14`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:01.531638 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1e8e328b-8aa6-4ace-b48c-3c293962e2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:01.654467 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883c134-41b5-4e30-bf8f-0f40ba016807 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:01.662171 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bf533-e679-4159-9b11-2ee21dd34411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:01.665960 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bf533-e679-4159-9b11-2ee21dd34411 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:01.665960 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bf533-e679-4159-9b11-2ee21dd34411 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:01.665960 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bf533-e679-4159-9b11-2ee21dd34411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:01.667942 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c00bf533-e679-4159-9b11-2ee21dd34411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:01.695971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 872/1717] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:01.696836 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bf533-e679-4159-9b11-2ee21dd34411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:01.701538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bf533-e679-4159-9b11-2ee21dd34411 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:01.705185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c49b2-30b3-4289-a8a4-3043d1f5fc8c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:01.705901 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c49b2-30b3-4289-a8a4-3043d1f5fc8c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:01.706568 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c49b2-30b3-4289-a8a4-3043d1f5fc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:01.723313 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 846/1718] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:01.725314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701c259-e539-49be-9f33-98341fea1835 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:01.726498 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701c259-e539-49be-9f33-98341fea1835 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:01.727298 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701c259-e539-49be-9f33-98341fea1835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:01.747741 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:01.753797 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-614c49b2-30b3-4289-a8a4-3043d1f5fc8c None None] MFA Rules not processed for user `55a1961b3af6490d9a615e2d907365e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:01.755611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-614c49b2-30b3-4289-a8a4-3043d1f5fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:01.811505 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-9701c259-e539-49be-9f33-98341fea1835 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:01.815768 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-9701c259-e539-49be-9f33-98341fea1835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:01.900886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 873/1719] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:01.902206 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c49b2-30b3-4289-a8a4-3043d1f5fc8c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:01.903949 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-614c49b2-30b3-4289-a8a4-3043d1f5fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:01.973581 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:02.019997 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 847/1720] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:02.021169 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35783646-7de4-4006-9cb6-45fcfec2c62b None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:02.021455 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35783646-7de4-4006-9cb6-45fcfec2c62b None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:02.021726 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35783646-7de4-4006-9cb6-45fcfec2c62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:02.037011 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c49b2-30b3-4289-a8a4-3043d1f5fc8c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:02.043611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb94344-fd1f-42a2-ad36-04cb4c6acba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:02.046162 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb94344-fd1f-42a2-ad36-04cb4c6acba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:02.046770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb94344-fd1f-42a2-ad36-04cb4c6acba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:02.047051 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb94344-fd1f-42a2-ad36-04cb4c6acba4 admin admin] PATH_INFO: `/v3/users/d5c22cf08bbc4a4c8bbc9d4e7a0b6935` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:02.048745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb94344-fd1f-42a2-ad36-04cb4c6acba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5c22cf08bbc4a4c8bbc9d4e7a0b6935)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:02.051876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb94344-fd1f-42a2-ad36-04cb4c6acba4 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:02.088042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-35783646-7de4-4006-9cb6-45fcfec2c62b None None] MFA Rules not processed for user `a84e162448a64727acdb841c839a384d`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:02.094082 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-35783646-7de4-4006-9cb6-45fcfec2c62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:02.231780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 848/1721] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:02.231780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35783646-7de4-4006-9cb6-45fcfec2c62b None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:02.234098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-35783646-7de4-4006-9cb6-45fcfec2c62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:02.286093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ecb94344-fd1f-42a2-ad36-04cb4c6acba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5c22cf08bbc4a4c8bbc9d4e7a0b6935'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:02.288079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ecb94344-fd1f-42a2-ad36-04cb4c6acba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5c22cf08bbc4a4c8bbc9d4e7a0b6935'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:02.315544 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ecb94344-fd1f-42a2-ad36-04cb4c6acba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5c22cf08bbc4a4c8bbc9d4e7a0b6935'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:02.317417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35783646-7de4-4006-9cb6-45fcfec2c62b None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:02.344114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ad149-b943-4cb5-8725-ab987e5bc9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:02.345140 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ad149-b943-4cb5-8725-ab987e5bc9da admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:02.350034 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ad149-b943-4cb5-8725-ab987e5bc9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:02.350528 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ad149-b943-4cb5-8725-ab987e5bc9da admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:02.352582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ad149-b943-4cb5-8725-ab987e5bc9da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:02.355059 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ad149-b943-4cb5-8725-ab987e5bc9da admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:02.413846 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ecb94344-fd1f-42a2-ad36-04cb4c6acba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5c22cf08bbc4a4c8bbc9d4e7a0b6935'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:02.415218 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ecb94344-fd1f-42a2-ad36-04cb4c6acba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5c22cf08bbc4a4c8bbc9d4e7a0b6935'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:02.443006 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 874/1722] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:01 2022] DELETE /identity/v3/users/d5c22cf08bbc4a4c8bbc9d4e7a0b6935 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:02.443006 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb94344-fd1f-42a2-ad36-04cb4c6acba4 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:02.444605 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ecb94344-fd1f-42a2-ad36-04cb4c6acba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:02.577985 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 849/1723] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:02 2022] POST /identity/v3/projects => generated 385 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:02.579614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617a231-8949-42ac-8b47-9f2179d49e58 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:02.581620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617a231-8949-42ac-8b47-9f2179d49e58 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:02.581964 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617a231-8949-42ac-8b47-9f2179d49e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:02.661452 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-6617a231-8949-42ac-8b47-9f2179d49e58 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:02.679388 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6617a231-8949-42ac-8b47-9f2179d49e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:02.712097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb94344-fd1f-42a2-ad36-04cb4c6acba4 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:02.923255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 850/1724] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:02.924284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617a231-8949-42ac-8b47-9f2179d49e58 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:02.930820 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6617a231-8949-42ac-8b47-9f2179d49e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:02.966482 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342b27a-5750-4b73-8e54-4314a631a116 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:02.967280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342b27a-5750-4b73-8e54-4314a631a116 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:02.967466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342b27a-5750-4b73-8e54-4314a631a116 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:02.967700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342b27a-5750-4b73-8e54-4314a631a116 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:02.977603 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0342b27a-5750-4b73-8e54-4314a631a116 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:02.986229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617a231-8949-42ac-8b47-9f2179d49e58 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:03.006821 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ef360-7b7b-452e-9749-28640a7471f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:03.010493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ef360-7b7b-452e-9749-28640a7471f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:03.010786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ef360-7b7b-452e-9749-28640a7471f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:03.011072 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ef360-7b7b-452e-9749-28640a7471f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:03.017195 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ef360-7b7b-452e-9749-28640a7471f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:03.024939 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ef360-7b7b-452e-9749-28640a7471f4 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:03.197883 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342b27a-5750-4b73-8e54-4314a631a116 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:03.202164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342b27a-5750-4b73-8e54-4314a631a116 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:03.232190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 875/1725] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 791 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:03.233583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342b27a-5750-4b73-8e54-4314a631a116 service nova] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:03.252562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 851/1726] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:02 2022] POST /identity/v3/users => generated 299 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:03.256449 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ef360-7b7b-452e-9749-28640a7471f4 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:03.272183 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342b27a-5750-4b73-8e54-4314a631a116 service nova] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:03.305119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced22b7-eb61-4282-ab69-4e91cfc2c79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:03.315246 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced22b7-eb61-4282-ab69-4e91cfc2c79e admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:03.316208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced22b7-eb61-4282-ab69-4e91cfc2c79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:03.318287 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced22b7-eb61-4282-ab69-4e91cfc2c79e admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:03.322814 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ef360-7b7b-452e-9749-28640a7471f4 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:03.322958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced22b7-eb61-4282-ab69-4e91cfc2c79e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:37:03.324940 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced22b7-eb61-4282-ab69-4e91cfc2c79e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:03.332030 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced22b7-eb61-4282-ab69-4e91cfc2c79e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:03.341623 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0bf85-1a93-47d8-8018-d31c811f1eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:03.344142 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0bf85-1a93-47d8-8018-d31c811f1eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:03.347929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0bf85-1a93-47d8-8018-d31c811f1eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:03.351373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0bf85-1a93-47d8-8018-d31c811f1eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:03.351373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0bf85-1a93-47d8-8018-d31c811f1eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:03.367055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0bf85-1a93-47d8-8018-d31c811f1eb5 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:03.377577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:03.406003 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 876/1727] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:37:03.410857 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced22b7-eb61-4282-ab69-4e91cfc2c79e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:03.430124 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 852/1728] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:03.430306 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced22b7-eb61-4282-ab69-4e91cfc2c79e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:03.444773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0bf85-1a93-47d8-8018-d31c811f1eb5 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:03.444871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb1b46-2ec9-4f52-a2b8-e14b25a1992f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:03.445163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb1b46-2ec9-4f52-a2b8-e14b25a1992f admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:03.445535 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb1b46-2ec9-4f52-a2b8-e14b25a1992f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:03.445907 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb1b46-2ec9-4f52-a2b8-e14b25a1992f admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:03.446642 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb1b46-2ec9-4f52-a2b8-e14b25a1992f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:03.448783 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb1b46-2ec9-4f52-a2b8-e14b25a1992f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:03.501825 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0bf85-1a93-47d8-8018-d31c811f1eb5 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:03.511046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:03.522872 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1b8dd-eba0-4c1a-8d79-fb516ef3bc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:03.523773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1b8dd-eba0-4c1a-8d79-fb516ef3bc96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:03.524228 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1b8dd-eba0-4c1a-8d79-fb516ef3bc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:03.524605 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1b8dd-eba0-4c1a-8d79-fb516ef3bc96 admin admin] PATH_INFO: `/v3/projects/a1a5a38b9c6a40a788838e2c1eddc25a/users/27e40fe8a8bf41d483c712590db99377/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:03.565319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1b8dd-eba0-4c1a-8d79-fb516ef3bc96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a5a38b9c6a40a788838e2c1eddc25a, user_id=27e40fe8a8bf41d483c712590db99377, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:03.572759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1b8dd-eba0-4c1a-8d79-fb516ef3bc96 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:03.669929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 853/1729] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:03 2022] PUT /identity/v3/projects/a1a5a38b9c6a40a788838e2c1eddc25a/users/27e40fe8a8bf41d483c712590db99377/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:03.671248 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 877/1730] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:03 2022] POST /identity/v3/projects => generated 391 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:03.671916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1b8dd-eba0-4c1a-8d79-fb516ef3bc96 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:03.672108 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb1b46-2ec9-4f52-a2b8-e14b25a1992f admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:03.852426 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1b8dd-eba0-4c1a-8d79-fb516ef3bc96 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:03.936024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb1b46-2ec9-4f52-a2b8-e14b25a1992f admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:03.956253 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9252b45-83c9-40ac-a950-48f929fa929f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:03.957201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9252b45-83c9-40ac-a950-48f929fa929f admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:03.957687 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9252b45-83c9-40ac-a950-48f929fa929f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:03.958114 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9252b45-83c9-40ac-a950-48f929fa929f admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:03.958916 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9252b45-83c9-40ac-a950-48f929fa929f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:03.961104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9252b45-83c9-40ac-a950-48f929fa929f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:03.983537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a4320-3a22-4d8f-97f1-06820b5d01e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:03.984303 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a4320-3a22-4d8f-97f1-06820b5d01e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:03.984681 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a4320-3a22-4d8f-97f1-06820b5d01e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:03.985024 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a4320-3a22-4d8f-97f1-06820b5d01e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:03.986178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a4320-3a22-4d8f-97f1-06820b5d01e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:03.999877 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a4320-3a22-4d8f-97f1-06820b5d01e3 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:04.030855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 854/1731] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:04.032627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a4320-3a22-4d8f-97f1-06820b5d01e3 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:04.063849 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a4320-3a22-4d8f-97f1-06820b5d01e3 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:04.075424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfb38f-802f-4ab4-b931-a364a6411444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:04.078955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfb38f-802f-4ab4-b931-a364a6411444 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:04.078955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfb38f-802f-4ab4-b931-a364a6411444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:04.078955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfb38f-802f-4ab4-b931-a364a6411444 admin admin] PATH_INFO: `/v3/projects/a1a5a38b9c6a40a788838e2c1eddc25a/users/27e40fe8a8bf41d483c712590db99377/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:04.085083 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbfb38f-802f-4ab4-b931-a364a6411444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a5a38b9c6a40a788838e2c1eddc25a, user_id=27e40fe8a8bf41d483c712590db99377, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:04.088158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbfb38f-802f-4ab4-b931-a364a6411444 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:04.105145 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 878/1732] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:03 2022] POST /identity/v3/users => generated 296 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:04.109846 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9252b45-83c9-40ac-a950-48f929fa929f admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:04.131882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 855/1733] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:04 2022] PUT /identity/v3/projects/a1a5a38b9c6a40a788838e2c1eddc25a/users/27e40fe8a8bf41d483c712590db99377/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:04.132109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9252b45-83c9-40ac-a950-48f929fa929f admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:04.140785 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ead65b-1229-4ae1-9f93-a9192d644a05 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:04.141683 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ead65b-1229-4ae1-9f93-a9192d644a05 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:04.143956 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ead65b-1229-4ae1-9f93-a9192d644a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:04.218730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-61ead65b-1229-4ae1-9f93-a9192d644a05 None None] MFA Rules not processed for user `27e40fe8a8bf41d483c712590db99377`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:04.221378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-61ead65b-1229-4ae1-9f93-a9192d644a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:04.264650 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c92f94-e676-45c6-92fd-9944023ed7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:04.265621 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c92f94-e676-45c6-92fd-9944023ed7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:04.266052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c92f94-e676-45c6-92fd-9944023ed7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:04.266856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c92f94-e676-45c6-92fd-9944023ed7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:04.267733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c92f94-e676-45c6-92fd-9944023ed7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:04.270551 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c92f94-e676-45c6-92fd-9944023ed7e7 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:04.287409 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 879/1734] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:04.290026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c92f94-e676-45c6-92fd-9944023ed7e7 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:04.303462 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c92f94-e676-45c6-92fd-9944023ed7e7 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:04.311609 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240f0bd-b292-4142-a0ca-6a8d9e33ab70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:04.312540 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240f0bd-b292-4142-a0ca-6a8d9e33ab70 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:04.312992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240f0bd-b292-4142-a0ca-6a8d9e33ab70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:04.315181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240f0bd-b292-4142-a0ca-6a8d9e33ab70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:04.315181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240f0bd-b292-4142-a0ca-6a8d9e33ab70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:04.317388 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240f0bd-b292-4142-a0ca-6a8d9e33ab70 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:04.338953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 880/1735] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:04.341008 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240f0bd-b292-4142-a0ca-6a8d9e33ab70 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:04.360691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240f0bd-b292-4142-a0ca-6a8d9e33ab70 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:04.366917 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09dd6b7-29a4-4d10-968d-49057b0ed236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:04.376230 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dd6b7-29a4-4d10-968d-49057b0ed236 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:04.377431 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dd6b7-29a4-4d10-968d-49057b0ed236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:04.377869 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dd6b7-29a4-4d10-968d-49057b0ed236 admin admin] PATH_INFO: `/v3/projects/05fa635061c141c7b1b5041141989338/users/9862d067e11044a6b7d7b867df2dd637/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:04.441986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dd6b7-29a4-4d10-968d-49057b0ed236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05fa635061c141c7b1b5041141989338, user_id=9862d067e11044a6b7d7b867df2dd637, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:04.448169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dd6b7-29a4-4d10-968d-49057b0ed236 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:04.453638 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:04.493822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 856/1736] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:04.505990 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ead65b-1229-4ae1-9f93-a9192d644a05 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:04.509315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-61ead65b-1229-4ae1-9f93-a9192d644a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:04.586433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 881/1737] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:04 2022] PUT /identity/v3/projects/05fa635061c141c7b1b5041141989338/users/9862d067e11044a6b7d7b867df2dd637/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:04.588080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7803a-c410-4ea1-94cd-e3854cbb6545 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:04.588393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7803a-c410-4ea1-94cd-e3854cbb6545 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:04.588680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7803a-c410-4ea1-94cd-e3854cbb6545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:04.593351 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ead65b-1229-4ae1-9f93-a9192d644a05 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:04.677141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:04.730693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-11f7803a-c410-4ea1-94cd-e3854cbb6545 None None] MFA Rules not processed for user `9862d067e11044a6b7d7b867df2dd637`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:04.735153 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-11f7803a-c410-4ea1-94cd-e3854cbb6545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:04.750961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03c947-c219-47c4-b985-5beaf327b66d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:04.750961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03c947-c219-47c4-b985-5beaf327b66d service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:04.750961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03c947-c219-47c4-b985-5beaf327b66d service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:04.750961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03c947-c219-47c4-b985-5beaf327b66d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:04.972104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 882/1738] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:04.975074 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7803a-c410-4ea1-94cd-e3854cbb6545 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:05.043703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03c947-c219-47c4-b985-5beaf327b66d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:05.049365 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03c947-c219-47c4-b985-5beaf327b66d service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:05.058116 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7803a-c410-4ea1-94cd-e3854cbb6545 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:05.071308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e07ac-4150-4995-8279-4e834c3d844d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:05.073044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e07ac-4150-4995-8279-4e834c3d844d admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:05.073580 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e07ac-4150-4995-8279-4e834c3d844d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:05.073865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e07ac-4150-4995-8279-4e834c3d844d admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:05.074520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e07ac-4150-4995-8279-4e834c3d844d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:05.081914 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e07ac-4150-4995-8279-4e834c3d844d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:05.120596 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 857/1739] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:37:05.190520 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03c947-c219-47c4-b985-5beaf327b66d service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:05.203080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03c947-c219-47c4-b985-5beaf327b66d service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:05.231852 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399eb7c-832e-4ef6-bbc0-cd084af99fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:05.232210 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399eb7c-832e-4ef6-bbc0-cd084af99fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:05.232406 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399eb7c-832e-4ef6-bbc0-cd084af99fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:05.232674 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399eb7c-832e-4ef6-bbc0-cd084af99fcf admin admin] PATH_INFO: `/v3/users/ab95051b0ddb43c48d8127a68c04bf14` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:05.234213 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399eb7c-832e-4ef6-bbc0-cd084af99fcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab95051b0ddb43c48d8127a68c04bf14)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:05.243495 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399eb7c-832e-4ef6-bbc0-cd084af99fcf admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:05.249538 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 883/1740] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:04 2022] POST /identity/v3/projects => generated 393 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:05.250768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e07ac-4150-4995-8279-4e834c3d844d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:05.501287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4399eb7c-832e-4ef6-bbc0-cd084af99fcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab95051b0ddb43c48d8127a68c04bf14'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:05.502444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4399eb7c-832e-4ef6-bbc0-cd084af99fcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab95051b0ddb43c48d8127a68c04bf14'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:05.510561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:05.533867 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4399eb7c-832e-4ef6-bbc0-cd084af99fcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab95051b0ddb43c48d8127a68c04bf14'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:05.599585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e07ac-4150-4995-8279-4e834c3d844d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:05.607650 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4399eb7c-832e-4ef6-bbc0-cd084af99fcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab95051b0ddb43c48d8127a68c04bf14'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:05.610286 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4399eb7c-832e-4ef6-bbc0-cd084af99fcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab95051b0ddb43c48d8127a68c04bf14'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:05.627195 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b168641-5959-4442-8224-3138f68ddc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:05.629150 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b168641-5959-4442-8224-3138f68ddc6c admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:05.629802 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b168641-5959-4442-8224-3138f68ddc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:05.631386 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b168641-5959-4442-8224-3138f68ddc6c admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:05.647438 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b168641-5959-4442-8224-3138f68ddc6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:05.656283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b168641-5959-4442-8224-3138f68ddc6c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:05.659422 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 858/1741] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:05 2022] DELETE /identity/v3/users/ab95051b0ddb43c48d8127a68c04bf14 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:05.663546 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399eb7c-832e-4ef6-bbc0-cd084af99fcf admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:05.668651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4399eb7c-832e-4ef6-bbc0-cd084af99fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:05.809546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 884/1742] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:05 2022] POST /identity/v3/users => generated 303 bytes in 556 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:05.809546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa80e8-c499-447f-bf6e-927d68c3a314 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:05.809546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa80e8-c499-447f-bf6e-927d68c3a314 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:05.809546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa80e8-c499-447f-bf6e-927d68c3a314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:05.847702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399eb7c-832e-4ef6-bbc0-cd084af99fcf admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:05.868152 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40b7e3-2046-4043-9912-0a2780a50a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:05.869154 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40b7e3-2046-4043-9912-0a2780a50a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:05.869658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40b7e3-2046-4043-9912-0a2780a50a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:05.870131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40b7e3-2046-4043-9912-0a2780a50a1a admin admin] PATH_INFO: `/v3/projects/80987c2bf22a4f4eb1e5db9a41229618` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:05.884018 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40b7e3-2046-4043-9912-0a2780a50a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=80987c2bf22a4f4eb1e5db9a41229618)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:05.901772 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-87fa80e8-c499-447f-bf6e-927d68c3a314 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:05.911702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-87fa80e8-c499-447f-bf6e-927d68c3a314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:05.932843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:05.932985 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40b7e3-2046-4043-9912-0a2780a50a1a admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:05.984035 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 885/1743] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:05.986288 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa80e8-c499-447f-bf6e-927d68c3a314 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:05.994740 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-87fa80e8-c499-447f-bf6e-927d68c3a314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:06.053307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa80e8-c499-447f-bf6e-927d68c3a314 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:06.074592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ce032-70a1-4645-be1a-6ce8d15fd14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:06.077030 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ce032-70a1-4645-be1a-6ce8d15fd14a admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:06.081133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ce032-70a1-4645-be1a-6ce8d15fd14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:06.081133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ce032-70a1-4645-be1a-6ce8d15fd14a admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:06.081133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ce032-70a1-4645-be1a-6ce8d15fd14a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:06.090481 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ce032-70a1-4645-be1a-6ce8d15fd14a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:06.149200 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 886/1744] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:06.150204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ce032-70a1-4645-be1a-6ce8d15fd14a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:06.153684 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-545ce032-70a1-4645-be1a-6ce8d15fd14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:06.244883 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-8c40b7e3-2046-4043-9912-0a2780a50a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80987c2bf22a4f4eb1e5db9a41229618', 'request_id': 'req-8c40b7e3-2046-4043-9912-0a2780a50a1a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:06.260861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-8c40b7e3-2046-4043-9912-0a2780a50a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80987c2bf22a4f4eb1e5db9a41229618', 'request_id': 'req-8c40b7e3-2046-4043-9912-0a2780a50a1a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:06.357537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-8c40b7e3-2046-4043-9912-0a2780a50a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80987c2bf22a4f4eb1e5db9a41229618', 'request_id': 'req-8c40b7e3-2046-4043-9912-0a2780a50a1a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:06.387658 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ce032-70a1-4645-be1a-6ce8d15fd14a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:06.408985 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-8c40b7e3-2046-4043-9912-0a2780a50a1a admin admin] The token cache is being invalidate because project 80987c2bf22a4f4eb1e5db9a41229618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:06.409281 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-8c40b7e3-2046-4043-9912-0a2780a50a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:06.410133 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-8c40b7e3-2046-4043-9912-0a2780a50a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:06.412047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 859/1745] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:05 2022] DELETE /identity/v3/projects/80987c2bf22a4f4eb1e5db9a41229618 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:06.416748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40b7e3-2046-4043-9912-0a2780a50a1a admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:06.431375 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-8c40b7e3-2046-4043-9912-0a2780a50a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:06.567304 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397bc4d-4474-4b10-a03a-15f3db8a04a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:06.567951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397bc4d-4474-4b10-a03a-15f3db8a04a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:06.568239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397bc4d-4474-4b10-a03a-15f3db8a04a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:06.568587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397bc4d-4474-4b10-a03a-15f3db8a04a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:06.580139 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2397bc4d-4474-4b10-a03a-15f3db8a04a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:06.616269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:06.632189 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40b7e3-2046-4043-9912-0a2780a50a1a admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:06.660300 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a185f-477a-4b06-a261-f9530d9eb634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:06.661198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a185f-477a-4b06-a261-f9530d9eb634 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:06.661540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a185f-477a-4b06-a261-f9530d9eb634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:06.662250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a185f-477a-4b06-a261-f9530d9eb634 admin admin] PATH_INFO: `/v3/projects/9a5f447e42574827b5f699f8c46ab146/users/dd051ff1c3504a3f8cf3560b29e8f89d/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:06.693378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a185f-477a-4b06-a261-f9530d9eb634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5f447e42574827b5f699f8c46ab146, user_id=dd051ff1c3504a3f8cf3560b29e8f89d, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:06.696597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a185f-477a-4b06-a261-f9530d9eb634 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:06.821699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:06.862515 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 860/1746] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:06 2022] PUT /identity/v3/projects/9a5f447e42574827b5f699f8c46ab146/users/dd051ff1c3504a3f8cf3560b29e8f89d/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:06.862728 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397bc4d-4474-4b10-a03a-15f3db8a04a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:06.863920 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397bc4d-4474-4b10-a03a-15f3db8a04a2 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:06.865651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3221d7-befc-4065-9fc3-789832aa2282 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:06.867077 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3221d7-befc-4065-9fc3-789832aa2282 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:06.868049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3221d7-befc-4065-9fc3-789832aa2282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:06.889332 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 887/1747] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:06.889604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397bc4d-4474-4b10-a03a-15f3db8a04a2 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:06.906677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397bc4d-4474-4b10-a03a-15f3db8a04a2 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:06.957214 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-fb3221d7-befc-4065-9fc3-789832aa2282 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:06.960409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-fb3221d7-befc-4065-9fc3-789832aa2282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:07.094504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ad024-f95c-4181-9430-f5b4c0830568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:07.095398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ad024-f95c-4181-9430-f5b4c0830568 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:07.095830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ad024-f95c-4181-9430-f5b4c0830568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:07.096254 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ad024-f95c-4181-9430-f5b4c0830568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:07.097101 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ad024-f95c-4181-9430-f5b4c0830568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:07.099057 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ad024-f95c-4181-9430-f5b4c0830568 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:07.117905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 888/1748] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:07.122525 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ad024-f95c-4181-9430-f5b4c0830568 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:07.160476 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ad024-f95c-4181-9430-f5b4c0830568 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:07.175422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089d7fb-2d75-4b8b-8583-4dad056474a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:07.176112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089d7fb-2d75-4b8b-8583-4dad056474a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:07.176976 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089d7fb-2d75-4b8b-8583-4dad056474a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:07.178234 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089d7fb-2d75-4b8b-8583-4dad056474a8 admin admin] PATH_INFO: `/v3/projects/9a5f447e42574827b5f699f8c46ab146/users/dd051ff1c3504a3f8cf3560b29e8f89d/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:07.182078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089d7fb-2d75-4b8b-8583-4dad056474a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5f447e42574827b5f699f8c46ab146, user_id=dd051ff1c3504a3f8cf3560b29e8f89d, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:07.186507 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089d7fb-2d75-4b8b-8583-4dad056474a8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:07.225389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 861/1749] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:07.234268 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260001f-4df1-447a-8a24-e2b31fb84dde None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:07.235095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260001f-4df1-447a-8a24-e2b31fb84dde None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:07.236476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260001f-4df1-447a-8a24-e2b31fb84dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:07.259970 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 889/1750] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:07 2022] PUT /identity/v3/projects/9a5f447e42574827b5f699f8c46ab146/users/dd051ff1c3504a3f8cf3560b29e8f89d/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:37:07.270780 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f2f9d-c235-42b5-9a7e-23ff817e1015 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:07.272946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f2f9d-c235-42b5-9a7e-23ff817e1015 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:07.274039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f2f9d-c235-42b5-9a7e-23ff817e1015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:07.339339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-c260001f-4df1-447a-8a24-e2b31fb84dde None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:07.344444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c260001f-4df1-447a-8a24-e2b31fb84dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:07.406159 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-944f2f9d-c235-42b5-9a7e-23ff817e1015 None None] MFA Rules not processed for user `dd051ff1c3504a3f8cf3560b29e8f89d`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:07.410367 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-944f2f9d-c235-42b5-9a7e-23ff817e1015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:07.570664 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 862/1751] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:07.574792 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260001f-4df1-447a-8a24-e2b31fb84dde None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:07.598939 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260001f-4df1-447a-8a24-e2b31fb84dde None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:07.614904 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf636ce4-4b78-488b-adb1-1b07c7dc7e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:07.616068 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf636ce4-4b78-488b-adb1-1b07c7dc7e6d admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:07.616633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf636ce4-4b78-488b-adb1-1b07c7dc7e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:07.617269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf636ce4-4b78-488b-adb1-1b07c7dc7e6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:07.618148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf636ce4-4b78-488b-adb1-1b07c7dc7e6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:37:07.618684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf636ce4-4b78-488b-adb1-1b07c7dc7e6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:07.620646 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf636ce4-4b78-488b-adb1-1b07c7dc7e6d admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:07.666891 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 863/1752] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:37:07.670842 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf636ce4-4b78-488b-adb1-1b07c7dc7e6d admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:07.705140 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf636ce4-4b78-488b-adb1-1b07c7dc7e6d admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:07.732494 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d23124-8525-4080-9177-bdddaedc86ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:07.733298 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d23124-8525-4080-9177-bdddaedc86ec admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:07.733684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d23124-8525-4080-9177-bdddaedc86ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:07.734086 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d23124-8525-4080-9177-bdddaedc86ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:07.734840 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d23124-8525-4080-9177-bdddaedc86ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:07.742537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d23124-8525-4080-9177-bdddaedc86ec admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:07.838110 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 890/1753] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:07 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 568 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:07.847428 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f2f9d-c235-42b5-9a7e-23ff817e1015 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:07.850074 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-944f2f9d-c235-42b5-9a7e-23ff817e1015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:07.957207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 864/1754] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:07 2022] POST /identity/v3/projects => generated 405 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:07.961862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d23124-8525-4080-9177-bdddaedc86ec admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:08.055515 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f2f9d-c235-42b5-9a7e-23ff817e1015 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:08.086873 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:08.109337 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:08.140461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d23124-8525-4080-9177-bdddaedc86ec admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:08.142589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f39aea-c09d-4bf2-90b6-6f7f72bd93f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:08.143236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f39aea-c09d-4bf2-90b6-6f7f72bd93f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:08.149216 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a58dac-ae40-470a-850f-db6524af0356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:08.149858 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a58dac-ae40-470a-850f-db6524af0356 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:08.150150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a58dac-ae40-470a-850f-db6524af0356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:08.150671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a58dac-ae40-470a-850f-db6524af0356 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:08.151073 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a58dac-ae40-470a-850f-db6524af0356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:08.156226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f39aea-c09d-4bf2-90b6-6f7f72bd93f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:08.156374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a58dac-ae40-470a-850f-db6524af0356 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:08.156786 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f39aea-c09d-4bf2-90b6-6f7f72bd93f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:08.254935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 865/1755] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:07 2022] POST /identity/v3/users => generated 303 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:08.256550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947ce28-f5d5-4b71-9e92-516607cc0f96 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:08.256977 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947ce28-f5d5-4b71-9e92-516607cc0f96 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:08.257606 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947ce28-f5d5-4b71-9e92-516607cc0f96 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:08.262963 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 866/1756] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 27 16:37:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:37:08.263719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f39aea-c09d-4bf2-90b6-6f7f72bd93f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:08.266133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f39aea-c09d-4bf2-90b6-6f7f72bd93f0 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:08.267315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947ce28-f5d5-4b71-9e92-516607cc0f96 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:08.279016 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 891/1757] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:07 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:37:08.321182 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947ce28-f5d5-4b71-9e92-516607cc0f96 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:08.343231 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe41ae-192a-4401-82e7-b13dedc2ccc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:08.344325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe41ae-192a-4401-82e7-b13dedc2ccc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:08.344675 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe41ae-192a-4401-82e7-b13dedc2ccc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:08.344920 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe41ae-192a-4401-82e7-b13dedc2ccc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:08.345589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe41ae-192a-4401-82e7-b13dedc2ccc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:08.356245 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe41ae-192a-4401-82e7-b13dedc2ccc3 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:08.394572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 867/1758] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:08.398604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f39aea-c09d-4bf2-90b6-6f7f72bd93f0 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:08.423968 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe41ae-192a-4401-82e7-b13dedc2ccc3 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:08.426480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f39aea-c09d-4bf2-90b6-6f7f72bd93f0 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:08.451015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222f53f-ac1f-4730-b85e-4ea9dbb76663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:08.452481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe41ae-192a-4401-82e7-b13dedc2ccc3 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:08.453133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222f53f-ac1f-4730-b85e-4ea9dbb76663 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:08.454415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222f53f-ac1f-4730-b85e-4ea9dbb76663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:08.454859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222f53f-ac1f-4730-b85e-4ea9dbb76663 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:08.457005 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222f53f-ac1f-4730-b85e-4ea9dbb76663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:08.461886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222f53f-ac1f-4730-b85e-4ea9dbb76663 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:08.480776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347effa-7c51-4253-90a7-8e45838a6d98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:08.481457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347effa-7c51-4253-90a7-8e45838a6d98 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:08.481742 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347effa-7c51-4253-90a7-8e45838a6d98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:08.482007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347effa-7c51-4253-90a7-8e45838a6d98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:08.489700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 892/1759] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:08.491162 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222f53f-ac1f-4730-b85e-4ea9dbb76663 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:08.491306 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-5347effa-7c51-4253-90a7-8e45838a6d98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:08.494747 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d222f53f-ac1f-4730-b85e-4ea9dbb76663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:08.511389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222f53f-ac1f-4730-b85e-4ea9dbb76663 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:08.518886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a8cac-669e-4e21-96d7-0cbfa563dc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:08.519877 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a8cac-669e-4e21-96d7-0cbfa563dc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:08.520391 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a8cac-669e-4e21-96d7-0cbfa563dc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:08.520893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a8cac-669e-4e21-96d7-0cbfa563dc62 admin admin] PATH_INFO: `/v3/users/ef1699338c6146e9a713f746ca946e0e` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:08.522614 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a8cac-669e-4e21-96d7-0cbfa563dc62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef1699338c6146e9a713f746ca946e0e)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:08.525635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a8cac-669e-4e21-96d7-0cbfa563dc62 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:08.646151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347effa-7c51-4253-90a7-8e45838a6d98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:08.648629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347effa-7c51-4253-90a7-8e45838a6d98 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:08.679808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 868/1760] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:37:08.683700 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1abac-4064-4ef3-801c-4be393960963 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:08.684326 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1abac-4064-4ef3-801c-4be393960963 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:08.684755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1abac-4064-4ef3-801c-4be393960963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:08.711988 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-f6b1abac-4064-4ef3-801c-4be393960963 None None] MFA Rules not processed for user `e71fea96b2b949f9abca12172e69284b`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:08.713538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f6b1abac-4064-4ef3-801c-4be393960963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:08.799032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-992a8cac-669e-4e21-96d7-0cbfa563dc62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef1699338c6146e9a713f746ca946e0e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:08.800801 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-992a8cac-669e-4e21-96d7-0cbfa563dc62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef1699338c6146e9a713f746ca946e0e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:08.842562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-992a8cac-669e-4e21-96d7-0cbfa563dc62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef1699338c6146e9a713f746ca946e0e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:08.911985 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-992a8cac-669e-4e21-96d7-0cbfa563dc62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef1699338c6146e9a713f746ca946e0e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:08.912899 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-992a8cac-669e-4e21-96d7-0cbfa563dc62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef1699338c6146e9a713f746ca946e0e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:08.951280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 869/1761] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 27 16:37:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:08.954817 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1abac-4064-4ef3-801c-4be393960963 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:08.956451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 893/1762] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:08 2022] DELETE /identity/v3/users/ef1699338c6146e9a713f746ca946e0e => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:08.960191 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f6b1abac-4064-4ef3-801c-4be393960963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:08.964654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d33c3-de5e-457b-8a23-5a35b8d69027 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:08.964955 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d33c3-de5e-457b-8a23-5a35b8d69027 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:08.965459 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d33c3-de5e-457b-8a23-5a35b8d69027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:08.994615 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1abac-4064-4ef3-801c-4be393960963 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:09.042780 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9c7d33c3-de5e-457b-8a23-5a35b8d69027 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:09.052733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9c7d33c3-de5e-457b-8a23-5a35b8d69027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:09.107694 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:09.123885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:09.137987 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb82f1-7d7c-4937-88af-e176fa3f1bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:09.138696 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb82f1-7d7c-4937-88af-e176fa3f1bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:09.138981 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb82f1-7d7c-4937-88af-e176fa3f1bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:09.139310 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb82f1-7d7c-4937-88af-e176fa3f1bfa admin admin] PATH_INFO: `/v3/projects/9f4a4310257242f5945c1cd2b0bea4ec/users/a0ca6ae0f0be4a34a7cf4cc520c63336/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:09.162929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb82f1-7d7c-4937-88af-e176fa3f1bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f4a4310257242f5945c1cd2b0bea4ec, user_id=a0ca6ae0f0be4a34a7cf4cc520c63336, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:09.166559 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb82f1-7d7c-4937-88af-e176fa3f1bfa admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:09.260780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 870/1763] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:08 2022] PUT /identity/v3/projects/9f4a4310257242f5945c1cd2b0bea4ec/users/a0ca6ae0f0be4a34a7cf4cc520c63336/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:09.260780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb82f1-7d7c-4937-88af-e176fa3f1bfa admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:09.267217 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-95bb82f1-7d7c-4937-88af-e176fa3f1bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:09.267568 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 894/1764] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:09.271662 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d01d0e-11ce-4261-b3ae-98138c3eead2 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:09.271967 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d01d0e-11ce-4261-b3ae-98138c3eead2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:09.277425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d01d0e-11ce-4261-b3ae-98138c3eead2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:09.388777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-36d01d0e-11ce-4261-b3ae-98138c3eead2 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:09.391216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-36d01d0e-11ce-4261-b3ae-98138c3eead2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:09.554048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb82f1-7d7c-4937-88af-e176fa3f1bfa admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:09.600886 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9234e96-d160-4028-bfdb-6eb29bef21f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:09.603767 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9234e96-d160-4028-bfdb-6eb29bef21f1 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:09.603767 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9234e96-d160-4028-bfdb-6eb29bef21f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:09.603767 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9234e96-d160-4028-bfdb-6eb29bef21f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:09.628366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9234e96-d160-4028-bfdb-6eb29bef21f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:09.637379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 895/1765] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:09.640620 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f7d81-9d6b-4faa-84c4-778a16b58475 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:09.640918 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f7d81-9d6b-4faa-84c4-778a16b58475 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:09.641339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f7d81-9d6b-4faa-84c4-778a16b58475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:09.671408 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9234e96-d160-4028-bfdb-6eb29bef21f1 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:09.692444 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6e7f7d81-9d6b-4faa-84c4-778a16b58475 None None] MFA Rules not processed for user `6d32130690454568b620faa8957ce111`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:09.692444 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6e7f7d81-9d6b-4faa-84c4-778a16b58475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:09.723421 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 871/1766] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:09.725819 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9234e96-d160-4028-bfdb-6eb29bef21f1 service nova] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:09.729071 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-d9234e96-d160-4028-bfdb-6eb29bef21f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:09.934592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 896/1767] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:09.953710 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9234e96-d160-4028-bfdb-6eb29bef21f1 service nova] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:09.957969 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2e029-ea36-4d40-b51c-ef6b58140b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:09.958773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2e029-ea36-4d40-b51c-ef6b58140b2d service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:09.959308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2e029-ea36-4d40-b51c-ef6b58140b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:09.959733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2e029-ea36-4d40-b51c-ef6b58140b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:09.981232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2e029-ea36-4d40-b51c-ef6b58140b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:09.981232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2e029-ea36-4d40-b51c-ef6b58140b2d service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:09.995067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 872/1768] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:10.007539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f7d81-9d6b-4faa-84c4-778a16b58475 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:10.026364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f7d81-9d6b-4faa-84c4-778a16b58475 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:10.035085 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08ddc8-e8b1-4818-906f-62276bf0b3c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:10.037038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08ddc8-e8b1-4818-906f-62276bf0b3c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:10.037789 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08ddc8-e8b1-4818-906f-62276bf0b3c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:10.038565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08ddc8-e8b1-4818-906f-62276bf0b3c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:10.063721 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08ddc8-e8b1-4818-906f-62276bf0b3c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:10.067413 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08ddc8-e8b1-4818-906f-62276bf0b3c2 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:10.095565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 897/1769] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:11.449969 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2e029-ea36-4d40-b51c-ef6b58140b2d service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:11.452674 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-fea2e029-ea36-4d40-b51c-ef6b58140b2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:11.510343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2e029-ea36-4d40-b51c-ef6b58140b2d service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:11.526899 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ec961-b165-4a02-b3ad-289ff8ba4744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:11.526899 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ec961-b165-4a02-b3ad-289ff8ba4744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:11.526899 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ec961-b165-4a02-b3ad-289ff8ba4744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:11.526899 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ec961-b165-4a02-b3ad-289ff8ba4744 admin admin] PATH_INFO: `/v3/projects/94afe06cfd3943a2b02ae2b12fac3d1f` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:11.527550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ec961-b165-4a02-b3ad-289ff8ba4744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94afe06cfd3943a2b02ae2b12fac3d1f)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:11.540751 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ec961-b165-4a02-b3ad-289ff8ba4744 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:11.848300 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2b5ec961-b165-4a02-b3ad-289ff8ba4744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94afe06cfd3943a2b02ae2b12fac3d1f', 'request_id': 'req-2b5ec961-b165-4a02-b3ad-289ff8ba4744'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:11.879362 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2b5ec961-b165-4a02-b3ad-289ff8ba4744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94afe06cfd3943a2b02ae2b12fac3d1f', 'request_id': 'req-2b5ec961-b165-4a02-b3ad-289ff8ba4744'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:11.980626 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2b5ec961-b165-4a02-b3ad-289ff8ba4744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94afe06cfd3943a2b02ae2b12fac3d1f', 'request_id': 'req-2b5ec961-b165-4a02-b3ad-289ff8ba4744'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:11.988412 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:12.016324 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2b5ec961-b165-4a02-b3ad-289ff8ba4744 admin admin] The token cache is being invalidate because project 94afe06cfd3943a2b02ae2b12fac3d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:12.016845 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2b5ec961-b165-4a02-b3ad-289ff8ba4744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:12.018774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2b5ec961-b165-4a02-b3ad-289ff8ba4744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:12.023646 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 873/1770] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:11 2022] DELETE /identity/v3/projects/94afe06cfd3943a2b02ae2b12fac3d1f => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:12.027788 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08ddc8-e8b1-4818-906f-62276bf0b3c2 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:12.043875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08ddc8-e8b1-4818-906f-62276bf0b3c2 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:12.220477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87aa30-d5d4-44a2-9243-b5433e7ddad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:12.221261 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87aa30-d5d4-44a2-9243-b5433e7ddad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:12.221794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87aa30-d5d4-44a2-9243-b5433e7ddad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:12.222141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87aa30-d5d4-44a2-9243-b5433e7ddad8 admin admin] PATH_INFO: `/v3/users/27e40fe8a8bf41d483c712590db99377` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:12.225176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87aa30-d5d4-44a2-9243-b5433e7ddad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e40fe8a8bf41d483c712590db99377)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:12.227593 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87aa30-d5d4-44a2-9243-b5433e7ddad8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:12.236748 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:12.562193 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-cf87aa30-d5d4-44a2-9243-b5433e7ddad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e40fe8a8bf41d483c712590db99377'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:12.570794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-cf87aa30-d5d4-44a2-9243-b5433e7ddad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e40fe8a8bf41d483c712590db99377'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:12.634309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-cf87aa30-d5d4-44a2-9243-b5433e7ddad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e40fe8a8bf41d483c712590db99377'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:12.729137 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-cf87aa30-d5d4-44a2-9243-b5433e7ddad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e40fe8a8bf41d483c712590db99377'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:12.729905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-cf87aa30-d5d4-44a2-9243-b5433e7ddad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e40fe8a8bf41d483c712590db99377'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:12.766020 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 898/1771] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:12 2022] DELETE /identity/v3/users/27e40fe8a8bf41d483c712590db99377 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:13.125884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81ba9c-d460-49d1-b9c4-d7a57c40d9a5 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:13.126853 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81ba9c-d460-49d1-b9c4-d7a57c40d9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:13.127526 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81ba9c-d460-49d1-b9c4-d7a57c40d9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:13.180311 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-fb81ba9c-d460-49d1-b9c4-d7a57c40d9a5 None None] MFA Rules not processed for user `55a1961b3af6490d9a615e2d907365e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:13.182094 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-fb81ba9c-d460-49d1-b9c4-d7a57c40d9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:13.385966 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 874/1772] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:14.383665 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87aa30-d5d4-44a2-9243-b5433e7ddad8 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:14.385332 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-cf87aa30-d5d4-44a2-9243-b5433e7ddad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:14.400968 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81ba9c-d460-49d1-b9c4-d7a57c40d9a5 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:14.402519 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-fb81ba9c-d460-49d1-b9c4-d7a57c40d9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:14.509799 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87aa30-d5d4-44a2-9243-b5433e7ddad8 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:14.523503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474c01a-eaa1-4578-85b4-759984fa8057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:14.527635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474c01a-eaa1-4578-85b4-759984fa8057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:14.528063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474c01a-eaa1-4578-85b4-759984fa8057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:14.529317 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474c01a-eaa1-4578-85b4-759984fa8057 admin admin] PATH_INFO: `/v3/projects/a1a5a38b9c6a40a788838e2c1eddc25a` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:14.532378 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474c01a-eaa1-4578-85b4-759984fa8057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a5a38b9c6a40a788838e2c1eddc25a)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:14.539068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474c01a-eaa1-4578-85b4-759984fa8057 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:14.561254 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81ba9c-d460-49d1-b9c4-d7a57c40d9a5 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:14.569526 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69313a84-a8db-4451-b577-e4572645d3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:14.576140 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69313a84-a8db-4451-b577-e4572645d3b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:14.576140 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69313a84-a8db-4451-b577-e4572645d3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:14.576140 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69313a84-a8db-4451-b577-e4572645d3b3 admin admin] PATH_INFO: `/v3/projects/0eb94f88f2474ae68abaa777336a0323` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:14.576140 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69313a84-a8db-4451-b577-e4572645d3b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eb94f88f2474ae68abaa777336a0323)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:14.576797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69313a84-a8db-4451-b577-e4572645d3b3 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:14.696451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c474c01a-eaa1-4578-85b4-759984fa8057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a5a38b9c6a40a788838e2c1eddc25a', 'request_id': 'req-c474c01a-eaa1-4578-85b4-759984fa8057'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:14.708657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c474c01a-eaa1-4578-85b4-759984fa8057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a5a38b9c6a40a788838e2c1eddc25a', 'request_id': 'req-c474c01a-eaa1-4578-85b4-759984fa8057'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:14.756423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-69313a84-a8db-4451-b577-e4572645d3b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eb94f88f2474ae68abaa777336a0323', 'request_id': 'req-69313a84-a8db-4451-b577-e4572645d3b3'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:14.767662 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-69313a84-a8db-4451-b577-e4572645d3b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eb94f88f2474ae68abaa777336a0323', 'request_id': 'req-69313a84-a8db-4451-b577-e4572645d3b3'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:14.813619 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c474c01a-eaa1-4578-85b4-759984fa8057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a5a38b9c6a40a788838e2c1eddc25a', 'request_id': 'req-c474c01a-eaa1-4578-85b4-759984fa8057'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:14.830157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c474c01a-eaa1-4578-85b4-759984fa8057 admin admin] The token cache is being invalidate because project a1a5a38b9c6a40a788838e2c1eddc25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:14.830464 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c474c01a-eaa1-4578-85b4-759984fa8057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:14.834284 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c474c01a-eaa1-4578-85b4-759984fa8057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:14.837872 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 899/1773] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:14 2022] DELETE /identity/v3/projects/a1a5a38b9c6a40a788838e2c1eddc25a => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:14.843887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268c179-635f-42b9-a7b2-e0232d42fcba None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:14.844183 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268c179-635f-42b9-a7b2-e0232d42fcba None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:14.844492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268c179-635f-42b9-a7b2-e0232d42fcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:14.880369 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-2268c179-635f-42b9-a7b2-e0232d42fcba None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:14.881613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2268c179-635f-42b9-a7b2-e0232d42fcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:14.890869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-69313a84-a8db-4451-b577-e4572645d3b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eb94f88f2474ae68abaa777336a0323', 'request_id': 'req-69313a84-a8db-4451-b577-e4572645d3b3'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:14.895903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:14.944002 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-69313a84-a8db-4451-b577-e4572645d3b3 admin admin] The token cache is being invalidate because project 0eb94f88f2474ae68abaa777336a0323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:14.946194 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-69313a84-a8db-4451-b577-e4572645d3b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:14.953003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-69313a84-a8db-4451-b577-e4572645d3b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:14.959680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 875/1774] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:14 2022] DELETE /identity/v3/projects/0eb94f88f2474ae68abaa777336a0323 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:14.960684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69313a84-a8db-4451-b577-e4572645d3b3 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:14.964839 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-69313a84-a8db-4451-b577-e4572645d3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:15.016217 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 900/1775] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:15.018084 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09387356-5a69-4617-a1e2-a46b634de975 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:15.019497 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09387356-5a69-4617-a1e2-a46b634de975 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:15.019497 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09387356-5a69-4617-a1e2-a46b634de975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:15.021687 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:15.057079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-09387356-5a69-4617-a1e2-a46b634de975 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:15.058381 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-09387356-5a69-4617-a1e2-a46b634de975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:15.081540 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 901/1776] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:15.083497 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efabfc2-94b6-4600-a2cd-c6ba5c4f2d51 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:15.083772 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efabfc2-94b6-4600-a2cd-c6ba5c4f2d51 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:15.084245 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efabfc2-94b6-4600-a2cd-c6ba5c4f2d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:15.148647 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69313a84-a8db-4451-b577-e4572645d3b3 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:15.160020 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d376b-db7e-46a7-95a1-ef615ad08dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:15.160931 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d376b-db7e-46a7-95a1-ef615ad08dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:15.161291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d376b-db7e-46a7-95a1-ef615ad08dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:15.162293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d376b-db7e-46a7-95a1-ef615ad08dcb admin admin] PATH_INFO: `/v3/users/b065ca43fd2449d287e58b3312a11ccc` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:15.168083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-0efabfc2-94b6-4600-a2cd-c6ba5c4f2d51 None None] MFA Rules not processed for user `a0ca6ae0f0be4a34a7cf4cc520c63336`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:15.170553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0efabfc2-94b6-4600-a2cd-c6ba5c4f2d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:15.174209 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d376b-db7e-46a7-95a1-ef615ad08dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b065ca43fd2449d287e58b3312a11ccc)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:15.178545 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d376b-db7e-46a7-95a1-ef615ad08dcb admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:15.329700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 902/1777] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:15 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:15.330834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efabfc2-94b6-4600-a2cd-c6ba5c4f2d51 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:15.380532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efabfc2-94b6-4600-a2cd-c6ba5c4f2d51 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:15.387337 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ea26f-521b-47e5-a67d-723b59556b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:15.389479 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ea26f-521b-47e5-a67d-723b59556b3e admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:15.389885 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ea26f-521b-47e5-a67d-723b59556b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:15.390454 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ea26f-521b-47e5-a67d-723b59556b3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:15.400118 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ea26f-521b-47e5-a67d-723b59556b3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:37:15.400733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ea26f-521b-47e5-a67d-723b59556b3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:15.402950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ea26f-521b-47e5-a67d-723b59556b3e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:15.416977 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 903/1778] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:37:15.418232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ea26f-521b-47e5-a67d-723b59556b3e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:15.421483 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e68ea26f-521b-47e5-a67d-723b59556b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:15.441267 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-fc8d376b-db7e-46a7-95a1-ef615ad08dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b065ca43fd2449d287e58b3312a11ccc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:15.441819 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ea26f-521b-47e5-a67d-723b59556b3e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:15.442187 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-fc8d376b-db7e-46a7-95a1-ef615ad08dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b065ca43fd2449d287e58b3312a11ccc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:15.450312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891d9c3-d4e3-440e-859b-39cefc32a512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:15.450964 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891d9c3-d4e3-440e-859b-39cefc32a512 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:15.451232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891d9c3-d4e3-440e-859b-39cefc32a512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:15.451589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891d9c3-d4e3-440e-859b-39cefc32a512 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:15.452363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891d9c3-d4e3-440e-859b-39cefc32a512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:15.454342 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891d9c3-d4e3-440e-859b-39cefc32a512 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:15.457646 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-fc8d376b-db7e-46a7-95a1-ef615ad08dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b065ca43fd2449d287e58b3312a11ccc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:15.539510 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-fc8d376b-db7e-46a7-95a1-ef615ad08dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b065ca43fd2449d287e58b3312a11ccc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:15.540134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-fc8d376b-db7e-46a7-95a1-ef615ad08dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b065ca43fd2449d287e58b3312a11ccc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:15.554259 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 876/1779] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:14 2022] DELETE /identity/v3/users/b065ca43fd2449d287e58b3312a11ccc => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:15.555067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d376b-db7e-46a7-95a1-ef615ad08dcb admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:15.556424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-fc8d376b-db7e-46a7-95a1-ef615ad08dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:15.576542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 904/1780] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:15 2022] POST /identity/v3/projects => generated 405 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:15.577787 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891d9c3-d4e3-440e-859b-39cefc32a512 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:15.579374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f891d9c3-d4e3-440e-859b-39cefc32a512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:15.645177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d376b-db7e-46a7-95a1-ef615ad08dcb admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:15.652534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b85c7-0dde-4264-9e28-a653f5ca235b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:15.652534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b85c7-0dde-4264-9e28-a653f5ca235b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:15.652534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b85c7-0dde-4264-9e28-a653f5ca235b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:15.652534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b85c7-0dde-4264-9e28-a653f5ca235b admin admin] PATH_INFO: `/v3/users/9862d067e11044a6b7d7b867df2dd637` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:15.653017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891d9c3-d4e3-440e-859b-39cefc32a512 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:15.653653 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b85c7-0dde-4264-9e28-a653f5ca235b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9862d067e11044a6b7d7b867df2dd637)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:15.656166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b85c7-0dde-4264-9e28-a653f5ca235b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:15.658409 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fdc1e-e06b-4e0f-ac3b-d80a967b4bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:15.659496 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fdc1e-e06b-4e0f-ac3b-d80a967b4bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:15.659782 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fdc1e-e06b-4e0f-ac3b-d80a967b4bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:15.660061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fdc1e-e06b-4e0f-ac3b-d80a967b4bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:15.660798 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59fdc1e-e06b-4e0f-ac3b-d80a967b4bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:15.662701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59fdc1e-e06b-4e0f-ac3b-d80a967b4bc1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:15.758433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 905/1781] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:15 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:15.759740 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175f3f3-9844-4060-a562-9f22ea7fe4ef None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:15.760072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175f3f3-9844-4060-a562-9f22ea7fe4ef None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:15.760463 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175f3f3-9844-4060-a562-9f22ea7fe4ef None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:15.762244 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 906/1782] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 27 16:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:37:15.762650 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175f3f3-9844-4060-a562-9f22ea7fe4ef None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:15.764298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a175f3f3-9844-4060-a562-9f22ea7fe4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:15.836714 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-9c9b85c7-0dde-4264-9e28-a653f5ca235b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9862d067e11044a6b7d7b867df2dd637'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:15.837733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-9c9b85c7-0dde-4264-9e28-a653f5ca235b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9862d067e11044a6b7d7b867df2dd637'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:15.853681 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-9c9b85c7-0dde-4264-9e28-a653f5ca235b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9862d067e11044a6b7d7b867df2dd637'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:15.858234 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175f3f3-9844-4060-a562-9f22ea7fe4ef None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:15.864095 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200749d1-2612-4e4b-904b-d056bc7a0725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:15.864743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200749d1-2612-4e4b-904b-d056bc7a0725 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:15.865030 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200749d1-2612-4e4b-904b-d056bc7a0725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:15.865329 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200749d1-2612-4e4b-904b-d056bc7a0725 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:15.865966 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200749d1-2612-4e4b-904b-d056bc7a0725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:15.867878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200749d1-2612-4e4b-904b-d056bc7a0725 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:15.939430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-9c9b85c7-0dde-4264-9e28-a653f5ca235b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9862d067e11044a6b7d7b867df2dd637'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:15.940120 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-9c9b85c7-0dde-4264-9e28-a653f5ca235b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9862d067e11044a6b7d7b867df2dd637'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:15.955373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 877/1783] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:15 2022] DELETE /identity/v3/users/9862d067e11044a6b7d7b867df2dd637 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:15.956199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b85c7-0dde-4264-9e28-a653f5ca235b admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:15.957576 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-9c9b85c7-0dde-4264-9e28-a653f5ca235b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:15.977739 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 907/1784] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:15 2022] POST /identity/v3/users => generated 309 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:15.979638 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361366ce-dc1f-4e6b-9f31-48b81715a4d5 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:15.980032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361366ce-dc1f-4e6b-9f31-48b81715a4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:15.980523 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361366ce-dc1f-4e6b-9f31-48b81715a4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:16.031385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-361366ce-dc1f-4e6b-9f31-48b81715a4d5 None None] MFA Rules not processed for user `e71fea96b2b949f9abca12172e69284b`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:16.034660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-361366ce-dc1f-4e6b-9f31-48b81715a4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:16.114293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b85c7-0dde-4264-9e28-a653f5ca235b admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:16.130765 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9a288-a5bd-4f3c-acbc-10621ad457ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:16.132256 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9a288-a5bd-4f3c-acbc-10621ad457ac admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:16.132570 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9a288-a5bd-4f3c-acbc-10621ad457ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:16.133048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9a288-a5bd-4f3c-acbc-10621ad457ac admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:16.133548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9a288-a5bd-4f3c-acbc-10621ad457ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:16.136525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9a288-a5bd-4f3c-acbc-10621ad457ac admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:16.181771 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 908/1785] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 27 16:37:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:16.183446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ed677-c6c2-4c2a-8d80-05bb171254ce None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:16.183877 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ed677-c6c2-4c2a-8d80-05bb171254ce None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:16.184363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ed677-c6c2-4c2a-8d80-05bb171254ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:16.210448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-5d1ed677-c6c2-4c2a-8d80-05bb171254ce None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:16.211766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5d1ed677-c6c2-4c2a-8d80-05bb171254ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:16.221012 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 909/1786] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:16.221472 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ed677-c6c2-4c2a-8d80-05bb171254ce None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:16.222829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5d1ed677-c6c2-4c2a-8d80-05bb171254ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:16.235701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ed677-c6c2-4c2a-8d80-05bb171254ce None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:16.240494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6806ce-5fe0-4c04-be9f-ca4bd5a56963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:16.241112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6806ce-5fe0-4c04-be9f-ca4bd5a56963 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:16.241392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6806ce-5fe0-4c04-be9f-ca4bd5a56963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:16.241694 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6806ce-5fe0-4c04-be9f-ca4bd5a56963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:16.242340 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6806ce-5fe0-4c04-be9f-ca4bd5a56963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:16.243981 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6806ce-5fe0-4c04-be9f-ca4bd5a56963 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:16.259087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 910/1787] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:16.260062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6806ce-5fe0-4c04-be9f-ca4bd5a56963 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:16.264878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8c6806ce-5fe0-4c04-be9f-ca4bd5a56963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:16.271595 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 878/1788] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:15 2022] POST /identity/v3/users => generated 292 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:16.275346 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9a288-a5bd-4f3c-acbc-10621ad457ac admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:16.290518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6806ce-5fe0-4c04-be9f-ca4bd5a56963 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:16.298615 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9a288-a5bd-4f3c-acbc-10621ad457ac admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:16.298869 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b80076-1c80-4039-ba8d-7cb524dc2228 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:16.299600 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b80076-1c80-4039-ba8d-7cb524dc2228 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:16.299769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b80076-1c80-4039-ba8d-7cb524dc2228 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:16.300047 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b80076-1c80-4039-ba8d-7cb524dc2228 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:16.304605 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253f81e-13a0-4ecf-a942-934cc4581c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:16.306093 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253f81e-13a0-4ecf-a942-934cc4581c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:16.306093 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253f81e-13a0-4ecf-a942-934cc4581c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:16.306093 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253f81e-13a0-4ecf-a942-934cc4581c5b admin admin] PATH_INFO: `/v3/projects/57caa757444f4288a845729c52944d84/users/827fca47c0ab41e59b969091e22d4963/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:16.324240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b80076-1c80-4039-ba8d-7cb524dc2228 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:16.326473 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b80076-1c80-4039-ba8d-7cb524dc2228 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:16.340031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 911/1789] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:16.340904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b80076-1c80-4039-ba8d-7cb524dc2228 service nova] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:16.355671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b80076-1c80-4039-ba8d-7cb524dc2228 service nova] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:16.368550 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbe666-a11a-4ab1-984a-2cf7483ae571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:16.368783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253f81e-13a0-4ecf-a942-934cc4581c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=57caa757444f4288a845729c52944d84, user_id=827fca47c0ab41e59b969091e22d4963, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:16.369781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbe666-a11a-4ab1-984a-2cf7483ae571 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:16.369781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbe666-a11a-4ab1-984a-2cf7483ae571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:16.370016 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbe666-a11a-4ab1-984a-2cf7483ae571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:16.370944 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbe666-a11a-4ab1-984a-2cf7483ae571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:16.371470 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253f81e-13a0-4ecf-a942-934cc4581c5b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:16.372720 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbe666-a11a-4ab1-984a-2cf7483ae571 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:16.387438 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 912/1790] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:16.388354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbe666-a11a-4ab1-984a-2cf7483ae571 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:16.391169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-73bbe666-a11a-4ab1-984a-2cf7483ae571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:16.410826 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbe666-a11a-4ab1-984a-2cf7483ae571 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:16.422389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc1eec-c7f8-4828-a11d-840ebabecfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:16.423726 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc1eec-c7f8-4828-a11d-840ebabecfed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:16.424312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc1eec-c7f8-4828-a11d-840ebabecfed admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:16.425593 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc1eec-c7f8-4828-a11d-840ebabecfed admin admin] PATH_INFO: `/v3/projects/4ae02617c2824ad3811393599948012d` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:16.427337 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc1eec-c7f8-4828-a11d-840ebabecfed admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ae02617c2824ad3811393599948012d)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:16.429708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc1eec-c7f8-4828-a11d-840ebabecfed admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:16.468177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 879/1791] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:16 2022] PUT /identity/v3/projects/57caa757444f4288a845729c52944d84/users/827fca47c0ab41e59b969091e22d4963/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:16.470034 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253f81e-13a0-4ecf-a942-934cc4581c5b admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:16.472785 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-5253f81e-13a0-4ecf-a942-934cc4581c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:16.588556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253f81e-13a0-4ecf-a942-934cc4581c5b admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:16.592976 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81a2a2-f96a-4181-b4a0-6e76c7603914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:16.593617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81a2a2-f96a-4181-b4a0-6e76c7603914 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:16.594068 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81a2a2-f96a-4181-b4a0-6e76c7603914 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:16.594422 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81a2a2-f96a-4181-b4a0-6e76c7603914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:16.667148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81a2a2-f96a-4181-b4a0-6e76c7603914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:16.668955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81a2a2-f96a-4181-b4a0-6e76c7603914 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:16.703480 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 880/1792] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:16.706662 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81a2a2-f96a-4181-b4a0-6e76c7603914 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:16.711155 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2abc1eec-c7f8-4828-a11d-840ebabecfed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae02617c2824ad3811393599948012d', 'request_id': 'req-2abc1eec-c7f8-4828-a11d-840ebabecfed'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:16.724668 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2abc1eec-c7f8-4828-a11d-840ebabecfed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae02617c2824ad3811393599948012d', 'request_id': 'req-2abc1eec-c7f8-4828-a11d-840ebabecfed'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:16.728641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81a2a2-f96a-4181-b4a0-6e76c7603914 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:16.825040 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2abc1eec-c7f8-4828-a11d-840ebabecfed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae02617c2824ad3811393599948012d', 'request_id': 'req-2abc1eec-c7f8-4828-a11d-840ebabecfed'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:16.831227 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dab05-4a9b-42b2-a01d-8cacedee122a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:16.832535 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dab05-4a9b-42b2-a01d-8cacedee122a admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:16.833048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dab05-4a9b-42b2-a01d-8cacedee122a admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:16.833730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dab05-4a9b-42b2-a01d-8cacedee122a admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:16.834297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936dab05-4a9b-42b2-a01d-8cacedee122a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:16.836765 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936dab05-4a9b-42b2-a01d-8cacedee122a admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:16.838499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2abc1eec-c7f8-4828-a11d-840ebabecfed admin admin] The token cache is being invalidate because project 4ae02617c2824ad3811393599948012d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:16.838893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2abc1eec-c7f8-4828-a11d-840ebabecfed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:16.839942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2abc1eec-c7f8-4828-a11d-840ebabecfed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:16.841612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 913/1793] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:16 2022] DELETE /identity/v3/projects/4ae02617c2824ad3811393599948012d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:16.842543 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc1eec-c7f8-4828-a11d-840ebabecfed admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:16.844054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2abc1eec-c7f8-4828-a11d-840ebabecfed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:16.853089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 881/1794] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:16.856755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5cf2a-824b-4c20-b53d-b50b5b967907 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:16.856755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5cf2a-824b-4c20-b53d-b50b5b967907 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:16.856755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5cf2a-824b-4c20-b53d-b50b5b967907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:16.863851 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc1eec-c7f8-4828-a11d-840ebabecfed admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:16.876298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce329f52-4b6a-4fdb-8981-87ab5a0a0755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:16.877151 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce329f52-4b6a-4fdb-8981-87ab5a0a0755 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:16.878029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce329f52-4b6a-4fdb-8981-87ab5a0a0755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:16.879098 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce329f52-4b6a-4fdb-8981-87ab5a0a0755 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:16.880601 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce329f52-4b6a-4fdb-8981-87ab5a0a0755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:16.891409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-05a5cf2a-824b-4c20-b53d-b50b5b967907 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:16.892780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-05a5cf2a-824b-4c20-b53d-b50b5b967907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:16.897832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce329f52-4b6a-4fdb-8981-87ab5a0a0755 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:16.902303 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 882/1795] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:16.903219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5cf2a-824b-4c20-b53d-b50b5b967907 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:16.904691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-05a5cf2a-824b-4c20-b53d-b50b5b967907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:16.920148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5cf2a-824b-4c20-b53d-b50b5b967907 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:16.924072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 914/1796] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:16.926450 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1ecae-008f-4b73-8b3b-82212a6bb0fd None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:16.926943 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1ecae-008f-4b73-8b3b-82212a6bb0fd None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:16.927627 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1ecae-008f-4b73-8b3b-82212a6bb0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:16.941062 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa16a2-c2ae-4f3c-871e-01a755f96eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:16.941855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa16a2-c2ae-4f3c-871e-01a755f96eff admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:16.943426 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa16a2-c2ae-4f3c-871e-01a755f96eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:16.943878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa16a2-c2ae-4f3c-871e-01a755f96eff admin admin] PATH_INFO: `/v3/projects/10da4488f33b4c6f945b221ecb498ec9/users/9fcdffee3d3d40ea8ad89858b115c385/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:16.972725 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa16a2-c2ae-4f3c-871e-01a755f96eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=10da4488f33b4c6f945b221ecb498ec9, user_id=9fcdffee3d3d40ea8ad89858b115c385, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:16.983385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa16a2-c2ae-4f3c-871e-01a755f96eff admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:16.983649 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-12c1ecae-008f-4b73-8b3b-82212a6bb0fd None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:16.986558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-12c1ecae-008f-4b73-8b3b-82212a6bb0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:17.046222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 915/1797] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:17.046222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1ecae-008f-4b73-8b3b-82212a6bb0fd None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:17.056723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1ecae-008f-4b73-8b3b-82212a6bb0fd None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:17.081074 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 883/1798] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:16 2022] PUT /identity/v3/projects/10da4488f33b4c6f945b221ecb498ec9/users/9fcdffee3d3d40ea8ad89858b115c385/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:17.081074 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa16a2-c2ae-4f3c-871e-01a755f96eff admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:17.081392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962e73d-1900-421f-be52-8ad4bb77a66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:17.081392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962e73d-1900-421f-be52-8ad4bb77a66e admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:17.081392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962e73d-1900-421f-be52-8ad4bb77a66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:17.081392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962e73d-1900-421f-be52-8ad4bb77a66e admin admin] PATH_INFO: `/v3/projects/57caa757444f4288a845729c52944d84/users/827fca47c0ab41e59b969091e22d4963/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:17.091947 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962e73d-1900-421f-be52-8ad4bb77a66e admin admin] RBAC: Authorizing `identity:create_grant(project_id=57caa757444f4288a845729c52944d84, user_id=827fca47c0ab41e59b969091e22d4963, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:17.099838 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962e73d-1900-421f-be52-8ad4bb77a66e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:17.115864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 916/1799] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:17 2022] PUT /identity/v3/projects/57caa757444f4288a845729c52944d84/users/827fca47c0ab41e59b969091e22d4963/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:17.115864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdf5f5-634d-44f4-87da-d76ce816d305 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:17.115864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdf5f5-634d-44f4-87da-d76ce816d305 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:17.115864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdf5f5-634d-44f4-87da-d76ce816d305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:17.156506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:17.187180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-fdbdf5f5-634d-44f4-87da-d76ce816d305 None None] MFA Rules not processed for user `9fcdffee3d3d40ea8ad89858b115c385`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:17.189137 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-fdbdf5f5-634d-44f4-87da-d76ce816d305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:17.234427 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa16a2-c2ae-4f3c-871e-01a755f96eff admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:17.307810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 917/1800] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:17.323812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdf5f5-634d-44f4-87da-d76ce816d305 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:17.334881 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:17.361457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949527b-a47b-4c6c-9f58-c027542da93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:17.362105 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949527b-a47b-4c6c-9f58-c027542da93c admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:17.362386 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949527b-a47b-4c6c-9f58-c027542da93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:17.362660 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949527b-a47b-4c6c-9f58-c027542da93c admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:17.364877 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949527b-a47b-4c6c-9f58-c027542da93c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:37:17.365196 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949527b-a47b-4c6c-9f58-c027542da93c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:17.368772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949527b-a47b-4c6c-9f58-c027542da93c admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:17.394987 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 884/1801] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:37:17.394987 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949527b-a47b-4c6c-9f58-c027542da93c admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:17.401197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4949527b-a47b-4c6c-9f58-c027542da93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:17.439323 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949527b-a47b-4c6c-9f58-c027542da93c admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:17.446480 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a29a17-5c59-463c-a5dc-6bd4394e1195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:17.447149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a29a17-5c59-463c-a5dc-6bd4394e1195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:17.447431 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a29a17-5c59-463c-a5dc-6bd4394e1195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:17.447709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a29a17-5c59-463c-a5dc-6bd4394e1195 admin admin] PATH_INFO: `/v3/projects/05fa635061c141c7b1b5041141989338` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:17.453206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a29a17-5c59-463c-a5dc-6bd4394e1195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05fa635061c141c7b1b5041141989338)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:17.454980 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a29a17-5c59-463c-a5dc-6bd4394e1195 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:17.482968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdf5f5-634d-44f4-87da-d76ce816d305 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:17.490044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0e58c-a0a1-4211-adc0-821c6e8d73f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:17.490675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0e58c-a0a1-4211-adc0-821c6e8d73f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:17.490953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0e58c-a0a1-4211-adc0-821c6e8d73f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:17.491224 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0e58c-a0a1-4211-adc0-821c6e8d73f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:17.491892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0e58c-a0a1-4211-adc0-821c6e8d73f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:17.493847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0e58c-a0a1-4211-adc0-821c6e8d73f5 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:17.595489 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-24a29a17-5c59-463c-a5dc-6bd4394e1195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05fa635061c141c7b1b5041141989338', 'request_id': 'req-24a29a17-5c59-463c-a5dc-6bd4394e1195'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:17.610476 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 918/1802] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:17 2022] POST /identity/v3/projects => generated 381 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:17.614030 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0e58c-a0a1-4211-adc0-821c6e8d73f5 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:17.621019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-24a29a17-5c59-463c-a5dc-6bd4394e1195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05fa635061c141c7b1b5041141989338', 'request_id': 'req-24a29a17-5c59-463c-a5dc-6bd4394e1195'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:17.681099 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0e58c-a0a1-4211-adc0-821c6e8d73f5 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:17.685788 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec019dc-d802-4c56-a707-c2f691284da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:17.687079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec019dc-d802-4c56-a707-c2f691284da1 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:17.687362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec019dc-d802-4c56-a707-c2f691284da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:17.687641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec019dc-d802-4c56-a707-c2f691284da1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:17.688265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec019dc-d802-4c56-a707-c2f691284da1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:17.690247 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec019dc-d802-4c56-a707-c2f691284da1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:17.722882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-24a29a17-5c59-463c-a5dc-6bd4394e1195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05fa635061c141c7b1b5041141989338', 'request_id': 'req-24a29a17-5c59-463c-a5dc-6bd4394e1195'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:17.736873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-24a29a17-5c59-463c-a5dc-6bd4394e1195 admin admin] The token cache is being invalidate because project 05fa635061c141c7b1b5041141989338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:17.737125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-24a29a17-5c59-463c-a5dc-6bd4394e1195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:17.737966 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-24a29a17-5c59-463c-a5dc-6bd4394e1195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:17.740440 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 885/1803] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:17 2022] DELETE /identity/v3/projects/05fa635061c141c7b1b5041141989338 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:17.741421 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a29a17-5c59-463c-a5dc-6bd4394e1195 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:17.743514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-24a29a17-5c59-463c-a5dc-6bd4394e1195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:17.791321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 919/1804] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:17 2022] POST /identity/v3/projects => generated 363 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:17.792400 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec019dc-d802-4c56-a707-c2f691284da1 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:17.810571 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2ec019dc-d802-4c56-a707-c2f691284da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:17.841783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a29a17-5c59-463c-a5dc-6bd4394e1195 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:17.918823 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a058f8-9750-4795-aca9-5f1bea157187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:17.919435 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a058f8-9750-4795-aca9-5f1bea157187 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:17.919812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a058f8-9750-4795-aca9-5f1bea157187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:17.920104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a058f8-9750-4795-aca9-5f1bea157187 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:17.921332 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a058f8-9750-4795-aca9-5f1bea157187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:17.922828 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec019dc-d802-4c56-a707-c2f691284da1 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:17.923540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a058f8-9750-4795-aca9-5f1bea157187 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:17.938411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1df2b-4d00-41bc-a27c-822e2827b992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:17.939841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1df2b-4d00-41bc-a27c-822e2827b992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:17.940135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1df2b-4d00-41bc-a27c-822e2827b992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:17.940496 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1df2b-4d00-41bc-a27c-822e2827b992 admin admin] PATH_INFO: `/v3/users/dd051ff1c3504a3f8cf3560b29e8f89d` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:17.941637 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1df2b-4d00-41bc-a27c-822e2827b992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd051ff1c3504a3f8cf3560b29e8f89d)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:17.943667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1df2b-4d00-41bc-a27c-822e2827b992 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:18.064262 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 886/1805] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:17 2022] POST /identity/v3/users => generated 297 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:18.065173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a058f8-9750-4795-aca9-5f1bea157187 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:18.067211 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f6a058f8-9750-4795-aca9-5f1bea157187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:18.084776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a058f8-9750-4795-aca9-5f1bea157187 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:18.089528 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562dd13-a76d-4718-8629-b72169d53722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:18.090141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562dd13-a76d-4718-8629-b72169d53722 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:18.090419 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562dd13-a76d-4718-8629-b72169d53722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:18.090690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562dd13-a76d-4718-8629-b72169d53722 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:18.091318 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562dd13-a76d-4718-8629-b72169d53722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:18.093881 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562dd13-a76d-4718-8629-b72169d53722 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:18.181819 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-51e1df2b-4d00-41bc-a27c-822e2827b992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd051ff1c3504a3f8cf3560b29e8f89d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:18.182497 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-51e1df2b-4d00-41bc-a27c-822e2827b992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd051ff1c3504a3f8cf3560b29e8f89d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:18.202047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 887/1806] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:18 2022] POST /identity/v3/users => generated 282 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:18.203601 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562dd13-a76d-4718-8629-b72169d53722 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:18.212545 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b562dd13-a76d-4718-8629-b72169d53722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:18.223737 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-51e1df2b-4d00-41bc-a27c-822e2827b992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd051ff1c3504a3f8cf3560b29e8f89d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:18.237862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562dd13-a76d-4718-8629-b72169d53722 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:18.247975 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8b4e0-f061-4173-9d49-cd1ca3947bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:18.248636 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8b4e0-f061-4173-9d49-cd1ca3947bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:18.252310 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8b4e0-f061-4173-9d49-cd1ca3947bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:18.252310 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8b4e0-f061-4173-9d49-cd1ca3947bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:18.252310 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8b4e0-f061-4173-9d49-cd1ca3947bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:18.252612 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8b4e0-f061-4173-9d49-cd1ca3947bd2 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:18.268566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 888/1807] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:18.268566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8b4e0-f061-4173-9d49-cd1ca3947bd2 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:18.270663 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-0db8b4e0-f061-4173-9d49-cd1ca3947bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:18.285265 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8b4e0-f061-4173-9d49-cd1ca3947bd2 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:18.290380 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1c428-caf1-4979-9def-608262a775bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:18.290996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1c428-caf1-4979-9def-608262a775bc admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:18.291275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1c428-caf1-4979-9def-608262a775bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:18.291548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1c428-caf1-4979-9def-608262a775bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:18.292188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1c428-caf1-4979-9def-608262a775bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:18.293926 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1c428-caf1-4979-9def-608262a775bc admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:18.315449 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 889/1808] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:18.317986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1c428-caf1-4979-9def-608262a775bc admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:18.328276 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-51e1df2b-4d00-41bc-a27c-822e2827b992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd051ff1c3504a3f8cf3560b29e8f89d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:18.329041 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-51e1df2b-4d00-41bc-a27c-822e2827b992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd051ff1c3504a3f8cf3560b29e8f89d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:18.360634 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1c428-caf1-4979-9def-608262a775bc admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:18.367310 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 920/1809] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:17 2022] DELETE /identity/v3/users/dd051ff1c3504a3f8cf3560b29e8f89d => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:18.367310 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1df2b-4d00-41bc-a27c-822e2827b992 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:18.483310 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:18.484546 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e46af-0118-4fe0-bbc7-80d1bb7ec760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:18.485559 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e46af-0118-4fe0-bbc7-80d1bb7ec760 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:18.486193 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e46af-0118-4fe0-bbc7-80d1bb7ec760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:18.486672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e46af-0118-4fe0-bbc7-80d1bb7ec760 admin admin] PATH_INFO: `/v3/projects/decc734892a94c28bbb00cf7b59e7ef7/users/bb599ce0a15544df93974ba181d91113/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:18.506292 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e46af-0118-4fe0-bbc7-80d1bb7ec760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=decc734892a94c28bbb00cf7b59e7ef7, user_id=bb599ce0a15544df93974ba181d91113, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:18.512548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e46af-0118-4fe0-bbc7-80d1bb7ec760 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:18.515880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1df2b-4d00-41bc-a27c-822e2827b992 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:18.522959 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edab81-e955-41c1-b768-48897134e9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:18.523585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edab81-e955-41c1-b768-48897134e9fe admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:18.523870 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edab81-e955-41c1-b768-48897134e9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:18.524146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edab81-e955-41c1-b768-48897134e9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:18.524840 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edab81-e955-41c1-b768-48897134e9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:18.526478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edab81-e955-41c1-b768-48897134e9fe admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:18.544479 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 921/1810] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:18.546504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edab81-e955-41c1-b768-48897134e9fe admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:18.558457 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edab81-e955-41c1-b768-48897134e9fe admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:18.563407 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedb35e-2c7b-4545-9c23-0eff503fd47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:18.564093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedb35e-2c7b-4545-9c23-0eff503fd47d admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:18.564438 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedb35e-2c7b-4545-9c23-0eff503fd47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:18.564723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedb35e-2c7b-4545-9c23-0eff503fd47d admin admin] PATH_INFO: `/v3/projects/1149c604578742289b9a33c58ccdc5b2/users/9838ca43128744c294716329c36af578/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:18.588630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfedb35e-2c7b-4545-9c23-0eff503fd47d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1149c604578742289b9a33c58ccdc5b2, user_id=9838ca43128744c294716329c36af578, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:18.591524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfedb35e-2c7b-4545-9c23-0eff503fd47d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:18.609201 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 890/1811] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:18 2022] PUT /identity/v3/projects/decc734892a94c28bbb00cf7b59e7ef7/users/bb599ce0a15544df93974ba181d91113/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:18.613274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e46af-0118-4fe0-bbc7-80d1bb7ec760 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:18.696903 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e46af-0118-4fe0-bbc7-80d1bb7ec760 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:18.705075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402391d-6bc6-443d-bca8-4d9966a4ee8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:18.708572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402391d-6bc6-443d-bca8-4d9966a4ee8e admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:18.710835 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402391d-6bc6-443d-bca8-4d9966a4ee8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:18.711706 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402391d-6bc6-443d-bca8-4d9966a4ee8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:18.721505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 922/1812] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:18 2022] PUT /identity/v3/projects/1149c604578742289b9a33c58ccdc5b2/users/9838ca43128744c294716329c36af578/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:18.723391 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680620a-8fb2-4615-917b-6c8873d44afb None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:18.724065 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680620a-8fb2-4615-917b-6c8873d44afb None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:18.724065 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680620a-8fb2-4615-917b-6c8873d44afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:18.726122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402391d-6bc6-443d-bca8-4d9966a4ee8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:18.729149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402391d-6bc6-443d-bca8-4d9966a4ee8e admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:18.746229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 891/1813] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:18.752828 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402391d-6bc6-443d-bca8-4d9966a4ee8e admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:18.776721 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6680620a-8fb2-4615-917b-6c8873d44afb None None] MFA Rules not processed for user `9838ca43128744c294716329c36af578`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:18.776721 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6680620a-8fb2-4615-917b-6c8873d44afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:18.777816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402391d-6bc6-443d-bca8-4d9966a4ee8e admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:18.876108 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 923/1814] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:18.877101 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680620a-8fb2-4615-917b-6c8873d44afb None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:18.962574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680620a-8fb2-4615-917b-6c8873d44afb None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:18.972820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6963d7-b7ef-4d36-88d9-e4dcee7be3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:18.974041 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6963d7-b7ef-4d36-88d9-e4dcee7be3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:18.974567 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6963d7-b7ef-4d36-88d9-e4dcee7be3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:18.974952 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6963d7-b7ef-4d36-88d9-e4dcee7be3f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:18.976255 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6963d7-b7ef-4d36-88d9-e4dcee7be3f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:18.976988 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac7aa0-ff2f-4549-a27a-e12c7e1f6438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:18.977729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac7aa0-ff2f-4549-a27a-e12c7e1f6438 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:18.978000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac7aa0-ff2f-4549-a27a-e12c7e1f6438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:18.978277 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac7aa0-ff2f-4549-a27a-e12c7e1f6438 admin admin] PATH_INFO: `/v3/projects/decc734892a94c28bbb00cf7b59e7ef7/users/bb599ce0a15544df93974ba181d91113/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:18.979276 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6963d7-b7ef-4d36-88d9-e4dcee7be3f8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:18.980230 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac7aa0-ff2f-4549-a27a-e12c7e1f6438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=decc734892a94c28bbb00cf7b59e7ef7, user_id=bb599ce0a15544df93974ba181d91113, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:18.983851 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac7aa0-ff2f-4549-a27a-e12c7e1f6438 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:19.006553 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 892/1815] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:18 2022] PUT /identity/v3/projects/decc734892a94c28bbb00cf7b59e7ef7/users/bb599ce0a15544df93974ba181d91113/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:19.018836 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ad51b-1e32-45fb-b601-3a54e927d7a9 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:19.019123 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ad51b-1e32-45fb-b601-3a54e927d7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:19.019406 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ad51b-1e32-45fb-b601-3a54e927d7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:19.068676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-a65ad51b-1e32-45fb-b601-3a54e927d7a9 None None] MFA Rules not processed for user `bb599ce0a15544df93974ba181d91113`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:19.070271 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a65ad51b-1e32-45fb-b601-3a54e927d7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:19.161181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 924/1816] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:18 2022] POST /identity/v3/projects => generated 365 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:19.165923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6963d7-b7ef-4d36-88d9-e4dcee7be3f8 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:19.216458 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 893/1817] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:19.239910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ad51b-1e32-45fb-b601-3a54e927d7a9 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:19.241575 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a65ad51b-1e32-45fb-b601-3a54e927d7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:19.357570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6963d7-b7ef-4d36-88d9-e4dcee7be3f8 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:19.372926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eaff2-6a18-490f-ad1f-91bf62d956ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:19.373851 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eaff2-6a18-490f-ad1f-91bf62d956ba admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:19.374855 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eaff2-6a18-490f-ad1f-91bf62d956ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:19.375228 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eaff2-6a18-490f-ad1f-91bf62d956ba admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:19.376131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eaff2-6a18-490f-ad1f-91bf62d956ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:19.385390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eaff2-6a18-490f-ad1f-91bf62d956ba admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:19.424967 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ad51b-1e32-45fb-b601-3a54e927d7a9 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:19.549176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e971b4-16ce-4154-84d8-e7cfeff5965c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:19.549994 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e971b4-16ce-4154-84d8-e7cfeff5965c service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:19.550339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e971b4-16ce-4154-84d8-e7cfeff5965c service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:19.550672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e971b4-16ce-4154-84d8-e7cfeff5965c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:19.652961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e971b4-16ce-4154-84d8-e7cfeff5965c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:19.654461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e971b4-16ce-4154-84d8-e7cfeff5965c service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:19.666303 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 894/1818] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:37:19.821340 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e971b4-16ce-4154-84d8-e7cfeff5965c service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:19.830840 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e971b4-16ce-4154-84d8-e7cfeff5965c service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:19.834356 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512de1d-44db-4860-824c-2c07e848e2fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:19.835033 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512de1d-44db-4860-824c-2c07e848e2fd service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:19.835454 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512de1d-44db-4860-824c-2c07e848e2fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:19.835799 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512de1d-44db-4860-824c-2c07e848e2fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:19.839840 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-2512de1d-44db-4860-824c-2c07e848e2fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:19.912651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512de1d-44db-4860-824c-2c07e848e2fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:19.914118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512de1d-44db-4860-824c-2c07e848e2fd service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:19.923376 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 895/1819] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:37:20.254667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 925/1820] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:19 2022] POST /identity/v3/users => generated 289 bytes in 1090 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:20.259952 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512de1d-44db-4860-824c-2c07e848e2fd service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:20.271186 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52e009-fad9-47e7-9d28-f21fabaaf097 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:20.271454 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52e009-fad9-47e7-9d28-f21fabaaf097 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:20.271936 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52e009-fad9-47e7-9d28-f21fabaaf097 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:20.273404 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 926/1821] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 27 16:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:37:20.276590 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512de1d-44db-4860-824c-2c07e848e2fd service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:20.286318 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:20.293987 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3243cef-6772-4394-b967-af44813481e1 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:20.294281 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3243cef-6772-4394-b967-af44813481e1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:20.296609 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3243cef-6772-4394-b967-af44813481e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:20.311865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1763a6-c77f-49b2-9c1e-d8abfbb60d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:20.314026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1763a6-c77f-49b2-9c1e-d8abfbb60d3a admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:20.316306 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1763a6-c77f-49b2-9c1e-d8abfbb60d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:20.329509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1763a6-c77f-49b2-9c1e-d8abfbb60d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:20.332203 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1763a6-c77f-49b2-9c1e-d8abfbb60d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:20.337672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1763a6-c77f-49b2-9c1e-d8abfbb60d3a admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:20.373527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-e3243cef-6772-4394-b967-af44813481e1 None None] MFA Rules not processed for user `e71fea96b2b949f9abca12172e69284b`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:20.375272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e3243cef-6772-4394-b967-af44813481e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:20.376546 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 896/1822] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:20.377534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1763a6-c77f-49b2-9c1e-d8abfbb60d3a admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:20.380242 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6d1763a6-c77f-49b2-9c1e-d8abfbb60d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:20.417541 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1763a6-c77f-49b2-9c1e-d8abfbb60d3a admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:20.440021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261860fe-5187-4fc2-8e67-9bf91e2dc102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:20.446660 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261860fe-5187-4fc2-8e67-9bf91e2dc102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:20.446660 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261860fe-5187-4fc2-8e67-9bf91e2dc102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:20.446660 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261860fe-5187-4fc2-8e67-9bf91e2dc102 admin admin] PATH_INFO: `/v3/projects/9a5f447e42574827b5f699f8c46ab146` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:20.454703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261860fe-5187-4fc2-8e67-9bf91e2dc102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a5f447e42574827b5f699f8c46ab146)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:20.456710 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261860fe-5187-4fc2-8e67-9bf91e2dc102 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:20.561327 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 927/1823] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 27 16:37:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:20.562490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3243cef-6772-4394-b967-af44813481e1 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:20.576376 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3243cef-6772-4394-b967-af44813481e1 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:20.583741 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a40fa5-b960-4150-8ee3-8c0e91be02ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:20.599894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a40fa5-b960-4150-8ee3-8c0e91be02ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:20.600400 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:20.601173 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a40fa5-b960-4150-8ee3-8c0e91be02ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:20.601893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a40fa5-b960-4150-8ee3-8c0e91be02ec admin admin] PATH_INFO: `/v3/projects/1db638b987524d8781a147c16de24ec2/users/2e6e67fed58c4e57bad0e5d6193acf4e/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:20.638412 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-261860fe-5187-4fc2-8e67-9bf91e2dc102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a5f447e42574827b5f699f8c46ab146', 'request_id': 'req-261860fe-5187-4fc2-8e67-9bf91e2dc102'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:20.648515 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a40fa5-b960-4150-8ee3-8c0e91be02ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db638b987524d8781a147c16de24ec2, user_id=2e6e67fed58c4e57bad0e5d6193acf4e, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:20.651437 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a40fa5-b960-4150-8ee3-8c0e91be02ec admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:20.655926 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-261860fe-5187-4fc2-8e67-9bf91e2dc102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a5f447e42574827b5f699f8c46ab146', 'request_id': 'req-261860fe-5187-4fc2-8e67-9bf91e2dc102'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:20.757834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-261860fe-5187-4fc2-8e67-9bf91e2dc102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a5f447e42574827b5f699f8c46ab146', 'request_id': 'req-261860fe-5187-4fc2-8e67-9bf91e2dc102'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:20.767436 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 928/1824] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:20 2022] PUT /identity/v3/projects/1db638b987524d8781a147c16de24ec2/users/2e6e67fed58c4e57bad0e5d6193acf4e/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:20.767436 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a40fa5-b960-4150-8ee3-8c0e91be02ec admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:20.772741 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-97a40fa5-b960-4150-8ee3-8c0e91be02ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:20.777856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-261860fe-5187-4fc2-8e67-9bf91e2dc102 admin admin] The token cache is being invalidate because project 9a5f447e42574827b5f699f8c46ab146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:20.778445 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-261860fe-5187-4fc2-8e67-9bf91e2dc102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:20.779131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-261860fe-5187-4fc2-8e67-9bf91e2dc102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:20.787781 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 897/1825] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:20 2022] DELETE /identity/v3/projects/9a5f447e42574827b5f699f8c46ab146 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:20.792959 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261860fe-5187-4fc2-8e67-9bf91e2dc102 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:20.804205 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-261860fe-5187-4fc2-8e67-9bf91e2dc102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:20.888000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a40fa5-b960-4150-8ee3-8c0e91be02ec admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:20.895131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a1207-cf50-42e8-8983-b7121ab01b27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:20.895897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a1207-cf50-42e8-8983-b7121ab01b27 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:20.896277 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a1207-cf50-42e8-8983-b7121ab01b27 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:20.896661 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a1207-cf50-42e8-8983-b7121ab01b27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:20.898958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d96a1207-cf50-42e8-8983-b7121ab01b27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:20.916230 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a1207-cf50-42e8-8983-b7121ab01b27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:20.918348 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a1207-cf50-42e8-8983-b7121ab01b27 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:20.933215 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 929/1826] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:20.933599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261860fe-5187-4fc2-8e67-9bf91e2dc102 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:20.934823 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5705357-6bd5-4d93-8e27-2304e1b68d08 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:20.935111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5705357-6bd5-4d93-8e27-2304e1b68d08 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:20.935497 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5705357-6bd5-4d93-8e27-2304e1b68d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:21.002595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b5705357-6bd5-4d93-8e27-2304e1b68d08 None None] MFA Rules not processed for user `827fca47c0ab41e59b969091e22d4963`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:21.005982 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b5705357-6bd5-4d93-8e27-2304e1b68d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:21.036755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40263e94-df9b-4c15-83f4-7e05602156c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:21.037782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40263e94-df9b-4c15-83f4-7e05602156c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:21.038063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40263e94-df9b-4c15-83f4-7e05602156c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:21.038334 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40263e94-df9b-4c15-83f4-7e05602156c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:21.038981 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40263e94-df9b-4c15-83f4-7e05602156c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:21.040612 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40263e94-df9b-4c15-83f4-7e05602156c3 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:21.053112 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 898/1827] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:21.054466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759e67b-ae7e-481e-bce2-f31dbf73409a None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:21.054726 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759e67b-ae7e-481e-bce2-f31dbf73409a None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:21.055002 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759e67b-ae7e-481e-bce2-f31dbf73409a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:21.079143 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-8759e67b-ae7e-481e-bce2-f31dbf73409a None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:21.080411 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-8759e67b-ae7e-481e-bce2-f31dbf73409a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:21.088670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 899/1828] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:21.089444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759e67b-ae7e-481e-bce2-f31dbf73409a None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:21.101258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759e67b-ae7e-481e-bce2-f31dbf73409a None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:21.106503 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa88352-a263-4c7d-b21b-685920a17c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:21.106697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 930/1829] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:20 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:21.107172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa88352-a263-4c7d-b21b-685920a17c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:21.107451 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa88352-a263-4c7d-b21b-685920a17c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:21.107723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa88352-a263-4c7d-b21b-685920a17c15 admin admin] PATH_INFO: `/v3/projects/1db638b987524d8781a147c16de24ec2/users/2e6e67fed58c4e57bad0e5d6193acf4e/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:21.107886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e0a3e-89c9-4391-801a-d164997cdb51 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:21.108171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e0a3e-89c9-4391-801a-d164997cdb51 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:21.109136 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e0a3e-89c9-4391-801a-d164997cdb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:21.115629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa88352-a263-4c7d-b21b-685920a17c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db638b987524d8781a147c16de24ec2, user_id=2e6e67fed58c4e57bad0e5d6193acf4e, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:21.118359 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa88352-a263-4c7d-b21b-685920a17c15 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:21.132439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 900/1830] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:21 2022] PUT /identity/v3/projects/1db638b987524d8781a147c16de24ec2/users/2e6e67fed58c4e57bad0e5d6193acf4e/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:21.135175 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-729e0a3e-89c9-4391-801a-d164997cdb51 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:21.136581 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-729e0a3e-89c9-4391-801a-d164997cdb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:21.145728 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e56f0-1991-44fd-a993-0c8b3d6d4369 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:21.146017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e56f0-1991-44fd-a993-0c8b3d6d4369 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:21.146676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e56f0-1991-44fd-a993-0c8b3d6d4369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:21.194142 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-a20e56f0-1991-44fd-a993-0c8b3d6d4369 None None] MFA Rules not processed for user `2e6e67fed58c4e57bad0e5d6193acf4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:21.195791 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a20e56f0-1991-44fd-a993-0c8b3d6d4369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:21.261885 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 931/1831] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:21.266694 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e0a3e-89c9-4391-801a-d164997cdb51 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:21.283445 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e0a3e-89c9-4391-801a-d164997cdb51 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:21.294242 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd8918-4b00-493b-9358-bfe2ca1ed866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:21.295265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd8918-4b00-493b-9358-bfe2ca1ed866 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:21.296271 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd8918-4b00-493b-9358-bfe2ca1ed866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:21.296865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd8918-4b00-493b-9358-bfe2ca1ed866 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:21.298551 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd8918-4b00-493b-9358-bfe2ca1ed866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:37:21.298958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd8918-4b00-493b-9358-bfe2ca1ed866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:21.301878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd8918-4b00-493b-9358-bfe2ca1ed866 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:21.321886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 932/1832] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:37:21.323639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd8918-4b00-493b-9358-bfe2ca1ed866 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:21.341473 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd8918-4b00-493b-9358-bfe2ca1ed866 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:21.343644 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 901/1833] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:21.349309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb263a88-2dc3-49e2-94c1-4ac2220d6458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:21.352429 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb263a88-2dc3-49e2-94c1-4ac2220d6458 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:21.352429 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb263a88-2dc3-49e2-94c1-4ac2220d6458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:21.352429 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb263a88-2dc3-49e2-94c1-4ac2220d6458 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:21.352429 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb263a88-2dc3-49e2-94c1-4ac2220d6458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:21.353257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb263a88-2dc3-49e2-94c1-4ac2220d6458 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:21.355535 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e56f0-1991-44fd-a993-0c8b3d6d4369 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:21.357100 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a20e56f0-1991-44fd-a993-0c8b3d6d4369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:21.432888 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e56f0-1991-44fd-a993-0c8b3d6d4369 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:21.439014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0c5ae-e340-4e72-9a61-4a63e1c8a639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:21.440027 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0c5ae-e340-4e72-9a61-4a63e1c8a639 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:21.440433 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0c5ae-e340-4e72-9a61-4a63e1c8a639 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:21.440802 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0c5ae-e340-4e72-9a61-4a63e1c8a639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:21.455766 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0c5ae-e340-4e72-9a61-4a63e1c8a639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:21.459955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0c5ae-e340-4e72-9a61-4a63e1c8a639 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:21.465494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 933/1834] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:21 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:21.466673 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb263a88-2dc3-49e2-94c1-4ac2220d6458 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:21.473587 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 902/1835] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:21.629870 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb263a88-2dc3-49e2-94c1-4ac2220d6458 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:21.635680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44cb2b-9687-47f5-b9f6-997f331a5a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:21.636545 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44cb2b-9687-47f5-b9f6-997f331a5a5e admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:21.636970 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44cb2b-9687-47f5-b9f6-997f331a5a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:21.637431 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44cb2b-9687-47f5-b9f6-997f331a5a5e admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:21.638239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44cb2b-9687-47f5-b9f6-997f331a5a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:21.643028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44cb2b-9687-47f5-b9f6-997f331a5a5e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:21.759147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0c5ae-e340-4e72-9a61-4a63e1c8a639 service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:21.766167 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 934/1836] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:21 2022] POST /identity/v3/users => generated 291 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:37:21.769061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44cb2b-9687-47f5-b9f6-997f331a5a5e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:21.775618 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0c5ae-e340-4e72-9a61-4a63e1c8a639 service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:21.802893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44cb2b-9687-47f5-b9f6-997f331a5a5e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:21.823321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e535647-e5fd-45c0-ad0f-8c7da64c30a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:21.824124 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e535647-e5fd-45c0-ad0f-8c7da64c30a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:21.824449 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e535647-e5fd-45c0-ad0f-8c7da64c30a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:21.824765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e535647-e5fd-45c0-ad0f-8c7da64c30a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:21.825423 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e535647-e5fd-45c0-ad0f-8c7da64c30a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:21.827046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e535647-e5fd-45c0-ad0f-8c7da64c30a4 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:21.848595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 935/1837] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:21.852265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e535647-e5fd-45c0-ad0f-8c7da64c30a4 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:21.869763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e535647-e5fd-45c0-ad0f-8c7da64c30a4 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:21.877986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429bd77-1c01-4219-9776-9ba348fccc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:21.878802 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429bd77-1c01-4219-9776-9ba348fccc73 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:21.879086 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429bd77-1c01-4219-9776-9ba348fccc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:21.879455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429bd77-1c01-4219-9776-9ba348fccc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:21.880006 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429bd77-1c01-4219-9776-9ba348fccc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:21.881794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429bd77-1c01-4219-9776-9ba348fccc73 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:21.895289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 936/1838] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:21.899279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429bd77-1c01-4219-9776-9ba348fccc73 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:21.910978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429bd77-1c01-4219-9776-9ba348fccc73 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:21.915812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ef40c-2fcf-410f-84fe-2ffebd6e81f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:21.916462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ef40c-2fcf-410f-84fe-2ffebd6e81f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:21.916758 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ef40c-2fcf-410f-84fe-2ffebd6e81f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:21.917014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ef40c-2fcf-410f-84fe-2ffebd6e81f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:21.918857 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6b3ef40c-2fcf-410f-84fe-2ffebd6e81f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:21.920562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2dc294-75fb-4e09-b456-fedcf9ec41d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:21.926474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dc294-75fb-4e09-b456-fedcf9ec41d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:21.926474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dc294-75fb-4e09-b456-fedcf9ec41d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:21.926474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dc294-75fb-4e09-b456-fedcf9ec41d2 admin admin] PATH_INFO: `/v3/projects/ae30a4bf1342449fa30e9f1ea926d00c/users/562210fca99243829ce82ad66fa98edd/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:21.941462 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2dc294-75fb-4e09-b456-fedcf9ec41d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae30a4bf1342449fa30e9f1ea926d00c, user_id=562210fca99243829ce82ad66fa98edd, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:21.945232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2dc294-75fb-4e09-b456-fedcf9ec41d2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:21.996912 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ef40c-2fcf-410f-84fe-2ffebd6e81f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:21.999545 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ef40c-2fcf-410f-84fe-2ffebd6e81f6 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:22.014059 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 903/1839] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:37:22.044381 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 937/1840] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:21 2022] PUT /identity/v3/projects/ae30a4bf1342449fa30e9f1ea926d00c/users/562210fca99243829ce82ad66fa98edd/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:37:22.056895 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209c235-af25-4b5e-b4a5-bad53354a58c None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:22.057330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209c235-af25-4b5e-b4a5-bad53354a58c None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:22.057696 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209c235-af25-4b5e-b4a5-bad53354a58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:22.130757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-0209c235-af25-4b5e-b4a5-bad53354a58c None None] MFA Rules not processed for user `562210fca99243829ce82ad66fa98edd`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:22.132256 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-0209c235-af25-4b5e-b4a5-bad53354a58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:22.303247 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 904/1841] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:22.307932 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2dc294-75fb-4e09-b456-fedcf9ec41d2 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:22.329036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:22.396581 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2dc294-75fb-4e09-b456-fedcf9ec41d2 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:22.407294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e665f-3b2f-409d-9e46-03d982b7649f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:22.408450 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e665f-3b2f-409d-9e46-03d982b7649f admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:22.409036 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e665f-3b2f-409d-9e46-03d982b7649f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:22.409737 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e665f-3b2f-409d-9e46-03d982b7649f admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:22.411112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e665f-3b2f-409d-9e46-03d982b7649f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:22.414180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e665f-3b2f-409d-9e46-03d982b7649f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:22.507178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f578d3-3f45-4bbb-b339-2b414ba51d37 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:22.507790 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f578d3-3f45-4bbb-b339-2b414ba51d37 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:22.508556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f578d3-3f45-4bbb-b339-2b414ba51d37 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:22.510424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 905/1842] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 27 16:37:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:37:22.527338 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef811016-f1d6-4c8f-bbc1-f658d4615bfb None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:22.527623 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef811016-f1d6-4c8f-bbc1-f658d4615bfb None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:22.527904 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef811016-f1d6-4c8f-bbc1-f658d4615bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:22.551895 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-ef811016-f1d6-4c8f-bbc1-f658d4615bfb None None] MFA Rules not processed for user `5deb7370bc3045c5be2d391d3b1dbd82`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:22.553395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ef811016-f1d6-4c8f-bbc1-f658d4615bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:22.576497 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 938/1843] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:22 2022] POST /identity/v3/projects => generated 383 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:22.578445 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e665f-3b2f-409d-9e46-03d982b7649f admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:22.606404 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:22.670841 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 906/1844] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 27 16:37:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:22.679032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e665f-3b2f-409d-9e46-03d982b7649f admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:22.684095 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d7cbd-e401-456c-96c3-1c703c3ef0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:22.685456 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d7cbd-e401-456c-96c3-1c703c3ef0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:22.685777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d7cbd-e401-456c-96c3-1c703c3ef0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:22.686119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d7cbd-e401-456c-96c3-1c703c3ef0b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:22.687299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d7cbd-e401-456c-96c3-1c703c3ef0b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:22.689297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d7cbd-e401-456c-96c3-1c703c3ef0b5 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:22.694049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c1100-d316-409f-b441-d26810f67c3c None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:22.694342 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c1100-d316-409f-b441-d26810f67c3c None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:22.694624 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c1100-d316-409f-b441-d26810f67c3c None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:22.700246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 907/1845] 10.222.0.26 () {54 vars in 961 bytes} [Tue Sep 27 16:37:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:37:22.701719 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb30258-10eb-4cd4-ac25-e6a1f29ec561 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:22.702007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb30258-10eb-4cd4-ac25-e6a1f29ec561 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:22.703429 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb30258-10eb-4cd4-ac25-e6a1f29ec561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:22.725716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-dcb30258-10eb-4cd4-ac25-e6a1f29ec561 None None] MFA Rules not processed for user `5deb7370bc3045c5be2d391d3b1dbd82`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:22.727016 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-dcb30258-10eb-4cd4-ac25-e6a1f29ec561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:22.820294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 939/1846] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:22 2022] POST /identity/v3/users => generated 298 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:22.829168 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d7cbd-e401-456c-96c3-1c703c3ef0b5 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:22.842733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d7cbd-e401-456c-96c3-1c703c3ef0b5 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:22.847957 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe1e71-5859-46a9-9a07-a71e16c09698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:22.848841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe1e71-5859-46a9-9a07-a71e16c09698 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:22.849331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe1e71-5859-46a9-9a07-a71e16c09698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:22.850139 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe1e71-5859-46a9-9a07-a71e16c09698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:22.850994 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe1e71-5859-46a9-9a07-a71e16c09698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:22.853023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe1e71-5859-46a9-9a07-a71e16c09698 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:22.872738 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 940/1847] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:37:22.875338 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe1e71-5859-46a9-9a07-a71e16c09698 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:22.893409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 908/1848] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Sep 27 16:37:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:22.895817 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb30258-10eb-4cd4-ac25-e6a1f29ec561 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:22.907475 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe1e71-5859-46a9-9a07-a71e16c09698 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:22.910977 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb30258-10eb-4cd4-ac25-e6a1f29ec561 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:22.913472 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d862c6a-0282-472c-972e-de29e0acf65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:22.914425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d862c6a-0282-472c-972e-de29e0acf65c admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:22.914775 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d862c6a-0282-472c-972e-de29e0acf65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:22.915820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d862c6a-0282-472c-972e-de29e0acf65c admin admin] PATH_INFO: `/v3/projects/88ef094f06924f36900a66f6e6dd91ae/users/d3cee41067f548c89cef565124062a1e/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:22.922036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702184c-51d8-41e9-bc4c-11db338239bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5deb7370bc3045c5be2d391d3b1dbd82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:22.923576 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702184c-51d8-41e9-bc4c-11db338239bc service placement] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:22.924099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702184c-51d8-41e9-bc4c-11db338239bc service placement] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:22.924745 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702184c-51d8-41e9-bc4c-11db338239bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:22.939432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702184c-51d8-41e9-bc4c-11db338239bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:22.940062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d862c6a-0282-472c-972e-de29e0acf65c admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ef094f06924f36900a66f6e6dd91ae, user_id=d3cee41067f548c89cef565124062a1e, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:22.941644 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702184c-51d8-41e9-bc4c-11db338239bc service placement] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:22.943710 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d862c6a-0282-472c-972e-de29e0acf65c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:22.956685 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 909/1849] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:23.061733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 941/1850] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:22 2022] PUT /identity/v3/projects/88ef094f06924f36900a66f6e6dd91ae/users/d3cee41067f548c89cef565124062a1e/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:23.066770 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702184c-51d8-41e9-bc4c-11db338239bc service placement] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:23.078607 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702184c-51d8-41e9-bc4c-11db338239bc service placement] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:23.153273 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13de91-6e8b-42f1-afeb-a03eebf41535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:23.154166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13de91-6e8b-42f1-afeb-a03eebf41535 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:23.156076 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13de91-6e8b-42f1-afeb-a03eebf41535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:23.156494 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13de91-6e8b-42f1-afeb-a03eebf41535 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:23.157547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13de91-6e8b-42f1-afeb-a03eebf41535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:23.160753 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13de91-6e8b-42f1-afeb-a03eebf41535 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:23.182702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d862c6a-0282-472c-972e-de29e0acf65c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:23.183795 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 910/1851] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:23.194835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d862c6a-0282-472c-972e-de29e0acf65c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:23.199997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64ede0-17b0-472b-a196-54af92b0d40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:23.201048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64ede0-17b0-472b-a196-54af92b0d40d admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:23.201502 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64ede0-17b0-472b-a196-54af92b0d40d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:23.202191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64ede0-17b0-472b-a196-54af92b0d40d admin admin] PATH_INFO: `/v3/projects/88ef094f06924f36900a66f6e6dd91ae/users/d3cee41067f548c89cef565124062a1e/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:23.205072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64ede0-17b0-472b-a196-54af92b0d40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ef094f06924f36900a66f6e6dd91ae, user_id=d3cee41067f548c89cef565124062a1e, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:23.208226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64ede0-17b0-472b-a196-54af92b0d40d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:23.224966 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 942/1852] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:23 2022] PUT /identity/v3/projects/88ef094f06924f36900a66f6e6dd91ae/users/d3cee41067f548c89cef565124062a1e/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:23.235395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495f9b6-0909-4ba4-b70b-2451b9d5c05b None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:23.235876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495f9b6-0909-4ba4-b70b-2451b9d5c05b None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:23.236640 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495f9b6-0909-4ba4-b70b-2451b9d5c05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:23.278031 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-3495f9b6-0909-4ba4-b70b-2451b9d5c05b None None] MFA Rules not processed for user `d3cee41067f548c89cef565124062a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:23.279378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3495f9b6-0909-4ba4-b70b-2451b9d5c05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:23.438289 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 911/1853] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:23.449806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64ede0-17b0-472b-a196-54af92b0d40d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:23.546768 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495f9b6-0909-4ba4-b70b-2451b9d5c05b None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:23.549493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3495f9b6-0909-4ba4-b70b-2451b9d5c05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:23.730131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64ede0-17b0-472b-a196-54af92b0d40d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:23.741282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6786afd-c62e-4fa3-928e-2a08af0f18a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:23.741883 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:23.742433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6786afd-c62e-4fa3-928e-2a08af0f18a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:23.744400 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6786afd-c62e-4fa3-928e-2a08af0f18a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:23.745682 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6786afd-c62e-4fa3-928e-2a08af0f18a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:23.777618 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6786afd-c62e-4fa3-928e-2a08af0f18a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:23.782335 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6786afd-c62e-4fa3-928e-2a08af0f18a0 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:23.805686 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495f9b6-0909-4ba4-b70b-2451b9d5c05b None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:23.811490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 943/1854] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:23.834264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ccdb2-25d3-448a-a408-c80c086e6309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:23.836244 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ccdb2-25d3-448a-a408-c80c086e6309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:23.836562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ccdb2-25d3-448a-a408-c80c086e6309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:23.836845 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ccdb2-25d3-448a-a408-c80c086e6309 admin admin] PATH_INFO: `/v3/users/9fcdffee3d3d40ea8ad89858b115c385` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:23.838140 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ccdb2-25d3-448a-a408-c80c086e6309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fcdffee3d3d40ea8ad89858b115c385)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:23.840346 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ccdb2-25d3-448a-a408-c80c086e6309 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:24.048615 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6786afd-c62e-4fa3-928e-2a08af0f18a0 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:24.060067 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6786afd-c62e-4fa3-928e-2a08af0f18a0 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:24.076476 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77c02f-f417-41e5-8eab-bab224b7984d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:24.077491 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77c02f-f417-41e5-8eab-bab224b7984d service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:24.077775 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77c02f-f417-41e5-8eab-bab224b7984d service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:24.078059 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77c02f-f417-41e5-8eab-bab224b7984d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:24.115621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-0a5ccdb2-25d3-448a-a408-c80c086e6309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fcdffee3d3d40ea8ad89858b115c385'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:24.117263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-0a5ccdb2-25d3-448a-a408-c80c086e6309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fcdffee3d3d40ea8ad89858b115c385'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:24.143304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-0a5ccdb2-25d3-448a-a408-c80c086e6309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fcdffee3d3d40ea8ad89858b115c385'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:24.222277 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-0a5ccdb2-25d3-448a-a408-c80c086e6309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fcdffee3d3d40ea8ad89858b115c385'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:24.223197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-0a5ccdb2-25d3-448a-a408-c80c086e6309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fcdffee3d3d40ea8ad89858b115c385'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:24.272301 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77c02f-f417-41e5-8eab-bab224b7984d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:24.273662 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77c02f-f417-41e5-8eab-bab224b7984d service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:24.281266 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 912/1855] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:23 2022] DELETE /identity/v3/users/9fcdffee3d3d40ea8ad89858b115c385 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:37:24.286793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a5d91-f528-4f9b-bddd-57bfe9cdd93c None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:24.286793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a5d91-f528-4f9b-bddd-57bfe9cdd93c None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:24.286793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a5d91-f528-4f9b-bddd-57bfe9cdd93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:24.301139 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 944/1856] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:37:24.314409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-c90a5d91-f528-4f9b-bddd-57bfe9cdd93c None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:24.315864 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c90a5d91-f528-4f9b-bddd-57bfe9cdd93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:24.425406 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 913/1857] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:24.443557 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77c02f-f417-41e5-8eab-bab224b7984d service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:24.444998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0f77c02f-f417-41e5-8eab-bab224b7984d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:24.505336 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:24.548363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77c02f-f417-41e5-8eab-bab224b7984d service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:24.604060 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42567198-e70c-4b83-91eb-4f752d48a5dc None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:24.604544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42567198-e70c-4b83-91eb-4f752d48a5dc None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:24.604974 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42567198-e70c-4b83-91eb-4f752d48a5dc None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:24.606904 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 914/1858] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 27 16:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 16:37:24.640257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f723f30-5f57-46f7-b2de-ce2e1391b0cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:24.640995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f723f30-5f57-46f7-b2de-ce2e1391b0cf service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:24.641492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f723f30-5f57-46f7-b2de-ce2e1391b0cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:24.641869 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f723f30-5f57-46f7-b2de-ce2e1391b0cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:24.652141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f723f30-5f57-46f7-b2de-ce2e1391b0cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:24.653772 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f723f30-5f57-46f7-b2de-ce2e1391b0cf service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:24.665149 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 945/1859] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:24.693548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b201c6-b616-4e21-98c0-430b745db70e None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:24.693922 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b201c6-b616-4e21-98c0-430b745db70e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:24.694278 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b201c6-b616-4e21-98c0-430b745db70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:24.745727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-39b201c6-b616-4e21-98c0-430b745db70e None None] MFA Rules not processed for user `5deb7370bc3045c5be2d391d3b1dbd82`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:24.747044 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-39b201c6-b616-4e21-98c0-430b745db70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:24.854304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 915/1860] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 27 16:37:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:24.891568 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f723f30-5f57-46f7-b2de-ce2e1391b0cf service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:24.902657 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b201c6-b616-4e21-98c0-430b745db70e None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:24.902956 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7f723f30-5f57-46f7-b2de-ce2e1391b0cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:24.903034 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-39b201c6-b616-4e21-98c0-430b745db70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:24.911743 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b201c6-b616-4e21-98c0-430b745db70e None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:24.921218 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f723f30-5f57-46f7-b2de-ce2e1391b0cf service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:24.932590 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711e3be-7d4f-4d07-bdb4-34973162048f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5deb7370bc3045c5be2d391d3b1dbd82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:24.932590 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711e3be-7d4f-4d07-bdb4-34973162048f service placement] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:24.932590 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711e3be-7d4f-4d07-bdb4-34973162048f service placement] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:24.932897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711e3be-7d4f-4d07-bdb4-34973162048f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:24.932986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b1990-f1c1-4161-ae7c-02d875d99e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:24.933836 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b1990-f1c1-4161-ae7c-02d875d99e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:24.934215 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b1990-f1c1-4161-ae7c-02d875d99e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:24.934587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b1990-f1c1-4161-ae7c-02d875d99e07 admin admin] PATH_INFO: `/v3/users/a0ca6ae0f0be4a34a7cf4cc520c63336` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:24.945879 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b1990-f1c1-4161-ae7c-02d875d99e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ca6ae0f0be4a34a7cf4cc520c63336)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:24.948205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b1990-f1c1-4161-ae7c-02d875d99e07 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:24.956198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711e3be-7d4f-4d07-bdb4-34973162048f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:24.963667 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711e3be-7d4f-4d07-bdb4-34973162048f service placement] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:24.994703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 916/1861] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:25.040310 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711e3be-7d4f-4d07-bdb4-34973162048f service placement] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:25.042992 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a711e3be-7d4f-4d07-bdb4-34973162048f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:25.062147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711e3be-7d4f-4d07-bdb4-34973162048f service placement] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:25.068043 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f437e5-055d-4651-8332-3e969101f5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:25.068826 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f437e5-055d-4651-8332-3e969101f5a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:25.068988 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f437e5-055d-4651-8332-3e969101f5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:25.069566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f437e5-055d-4651-8332-3e969101f5a1 admin admin] PATH_INFO: `/v3/users/562210fca99243829ce82ad66fa98edd` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:25.087990 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f437e5-055d-4651-8332-3e969101f5a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=562210fca99243829ce82ad66fa98edd)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:25.090183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f437e5-055d-4651-8332-3e969101f5a1 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:25.213079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ec6b1990-f1c1-4161-ae7c-02d875d99e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ca6ae0f0be4a34a7cf4cc520c63336'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:25.213079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ec6b1990-f1c1-4161-ae7c-02d875d99e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ca6ae0f0be4a34a7cf4cc520c63336'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:25.222029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ec6b1990-f1c1-4161-ae7c-02d875d99e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ca6ae0f0be4a34a7cf4cc520c63336'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:25.311482 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ec6b1990-f1c1-4161-ae7c-02d875d99e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ca6ae0f0be4a34a7cf4cc520c63336'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:25.312903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ec6b1990-f1c1-4161-ae7c-02d875d99e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ca6ae0f0be4a34a7cf4cc520c63336'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:25.331050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 946/1862] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:24 2022] DELETE /identity/v3/users/a0ca6ae0f0be4a34a7cf4cc520c63336 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:25.344449 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-02f437e5-055d-4651-8332-3e969101f5a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '562210fca99243829ce82ad66fa98edd'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:25.345095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-02f437e5-055d-4651-8332-3e969101f5a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '562210fca99243829ce82ad66fa98edd'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:25.372299 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-02f437e5-055d-4651-8332-3e969101f5a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '562210fca99243829ce82ad66fa98edd'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:25.482267 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-02f437e5-055d-4651-8332-3e969101f5a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '562210fca99243829ce82ad66fa98edd'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:25.482991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-02f437e5-055d-4651-8332-3e969101f5a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '562210fca99243829ce82ad66fa98edd'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:25.516111 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 917/1863] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:25 2022] DELETE /identity/v3/users/562210fca99243829ce82ad66fa98edd => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:25.521166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117be9d5-0aee-4256-8884-efe3e76d24c7 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:25.523258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117be9d5-0aee-4256-8884-efe3e76d24c7 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:25.523258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117be9d5-0aee-4256-8884-efe3e76d24c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:25.529529 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f437e5-055d-4651-8332-3e969101f5a1 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:25.531870 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-02f437e5-055d-4651-8332-3e969101f5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:25.571583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-117be9d5-0aee-4256-8884-efe3e76d24c7 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:25.573048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-117be9d5-0aee-4256-8884-efe3e76d24c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:25.634498 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f437e5-055d-4651-8332-3e969101f5a1 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:25.639215 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb87e0-78a6-4d50-8b83-a6e8f8de0c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:25.639887 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb87e0-78a6-4d50-8b83-a6e8f8de0c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:25.640166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb87e0-78a6-4d50-8b83-a6e8f8de0c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:25.640527 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb87e0-78a6-4d50-8b83-a6e8f8de0c1d admin admin] PATH_INFO: `/v3/projects/10da4488f33b4c6f945b221ecb498ec9` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:25.641672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb87e0-78a6-4d50-8b83-a6e8f8de0c1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=10da4488f33b4c6f945b221ecb498ec9)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:25.643591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb87e0-78a6-4d50-8b83-a6e8f8de0c1d admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:25.650904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 947/1864] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:25.669509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117be9d5-0aee-4256-8884-efe3e76d24c7 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:25.671625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-117be9d5-0aee-4256-8884-efe3e76d24c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:25.730028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117be9d5-0aee-4256-8884-efe3e76d24c7 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:25.734657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbb585-f05d-4fdc-b1b0-35f591eebaed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:25.735399 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbb585-f05d-4fdc-b1b0-35f591eebaed service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:25.735682 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbb585-f05d-4fdc-b1b0-35f591eebaed service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:25.735956 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbb585-f05d-4fdc-b1b0-35f591eebaed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:25.751421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbb585-f05d-4fdc-b1b0-35f591eebaed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:25.753631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbb585-f05d-4fdc-b1b0-35f591eebaed service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:25.766340 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 948/1865] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:25.767059 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbb585-f05d-4fdc-b1b0-35f591eebaed service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:25.769831 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0fcbb585-f05d-4fdc-b1b0-35f591eebaed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:25.772976 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-3bfb87e0-78a6-4d50-8b83-a6e8f8de0c1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10da4488f33b4c6f945b221ecb498ec9', 'request_id': 'req-3bfb87e0-78a6-4d50-8b83-a6e8f8de0c1d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:25.787786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-3bfb87e0-78a6-4d50-8b83-a6e8f8de0c1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10da4488f33b4c6f945b221ecb498ec9', 'request_id': 'req-3bfb87e0-78a6-4d50-8b83-a6e8f8de0c1d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:25.803009 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbb585-f05d-4fdc-b1b0-35f591eebaed service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:25.888893 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-3bfb87e0-78a6-4d50-8b83-a6e8f8de0c1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10da4488f33b4c6f945b221ecb498ec9', 'request_id': 'req-3bfb87e0-78a6-4d50-8b83-a6e8f8de0c1d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:25.895277 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87ef20-e131-4a7a-a68a-8bad2b7f3b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:25.897042 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87ef20-e131-4a7a-a68a-8bad2b7f3b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:25.902921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87ef20-e131-4a7a-a68a-8bad2b7f3b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:25.902921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87ef20-e131-4a7a-a68a-8bad2b7f3b82 admin admin] PATH_INFO: `/v3/projects/9f4a4310257242f5945c1cd2b0bea4ec` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:25.902921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87ef20-e131-4a7a-a68a-8bad2b7f3b82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f4a4310257242f5945c1cd2b0bea4ec)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:25.903663 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87ef20-e131-4a7a-a68a-8bad2b7f3b82 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:25.910535 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-3bfb87e0-78a6-4d50-8b83-a6e8f8de0c1d admin admin] The token cache is being invalidate because project 10da4488f33b4c6f945b221ecb498ec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:25.910834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-3bfb87e0-78a6-4d50-8b83-a6e8f8de0c1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:25.913721 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-3bfb87e0-78a6-4d50-8b83-a6e8f8de0c1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:25.915797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 918/1866] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:25 2022] DELETE /identity/v3/projects/10da4488f33b4c6f945b221ecb498ec9 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:25.919878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb87e0-78a6-4d50-8b83-a6e8f8de0c1d admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:25.921319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3bfb87e0-78a6-4d50-8b83-a6e8f8de0c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:25.943142 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb87e0-78a6-4d50-8b83-a6e8f8de0c1d admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:25.967440 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d5538-ab7c-413b-9ae1-a5178d6a560b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:25.968982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d5538-ab7c-413b-9ae1-a5178d6a560b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:25.969409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d5538-ab7c-413b-9ae1-a5178d6a560b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:25.969828 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d5538-ab7c-413b-9ae1-a5178d6a560b admin admin] PATH_INFO: `/v3/users/bb599ce0a15544df93974ba181d91113` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:25.971421 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d5538-ab7c-413b-9ae1-a5178d6a560b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb599ce0a15544df93974ba181d91113)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:25.984553 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d5538-ab7c-413b-9ae1-a5178d6a560b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:26.116560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3e87ef20-e131-4a7a-a68a-8bad2b7f3b82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f4a4310257242f5945c1cd2b0bea4ec', 'request_id': 'req-3e87ef20-e131-4a7a-a68a-8bad2b7f3b82'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.124187 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3e87ef20-e131-4a7a-a68a-8bad2b7f3b82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f4a4310257242f5945c1cd2b0bea4ec', 'request_id': 'req-3e87ef20-e131-4a7a-a68a-8bad2b7f3b82'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.236155 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3e87ef20-e131-4a7a-a68a-8bad2b7f3b82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f4a4310257242f5945c1cd2b0bea4ec', 'request_id': 'req-3e87ef20-e131-4a7a-a68a-8bad2b7f3b82'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.251206 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3e87ef20-e131-4a7a-a68a-8bad2b7f3b82 admin admin] The token cache is being invalidate because project 9f4a4310257242f5945c1cd2b0bea4ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:26.252469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3e87ef20-e131-4a7a-a68a-8bad2b7f3b82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.253862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3e87ef20-e131-4a7a-a68a-8bad2b7f3b82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.258556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 949/1867] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:25 2022] DELETE /identity/v3/projects/9f4a4310257242f5945c1cd2b0bea4ec => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:26.260621 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87ef20-e131-4a7a-a68a-8bad2b7f3b82 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:26.262403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3e87ef20-e131-4a7a-a68a-8bad2b7f3b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:26.266188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f17d5538-ab7c-413b-9ae1-a5178d6a560b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb599ce0a15544df93974ba181d91113'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.267098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f17d5538-ab7c-413b-9ae1-a5178d6a560b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb599ce0a15544df93974ba181d91113'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.285266 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f17d5538-ab7c-413b-9ae1-a5178d6a560b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb599ce0a15544df93974ba181d91113'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.344644 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87ef20-e131-4a7a-a68a-8bad2b7f3b82 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:26.349864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc835ba-46a7-4799-9af9-7538c17ac91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:26.350719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc835ba-46a7-4799-9af9-7538c17ac91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:26.350926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc835ba-46a7-4799-9af9-7538c17ac91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:26.351210 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc835ba-46a7-4799-9af9-7538c17ac91c admin admin] PATH_INFO: `/v3/users/827fca47c0ab41e59b969091e22d4963` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:26.352379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc835ba-46a7-4799-9af9-7538c17ac91c admin admin] RBAC: Authorizing `identity:delete_user(user_id=827fca47c0ab41e59b969091e22d4963)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:26.360205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc835ba-46a7-4799-9af9-7538c17ac91c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:26.409822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f17d5538-ab7c-413b-9ae1-a5178d6a560b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb599ce0a15544df93974ba181d91113'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.410769 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f17d5538-ab7c-413b-9ae1-a5178d6a560b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb599ce0a15544df93974ba181d91113'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.425918 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 919/1868] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:25 2022] DELETE /identity/v3/users/bb599ce0a15544df93974ba181d91113 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:37:26.427257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d5538-ab7c-413b-9ae1-a5178d6a560b admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:26.429209 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f17d5538-ab7c-413b-9ae1-a5178d6a560b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:26.518007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d5538-ab7c-413b-9ae1-a5178d6a560b admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:26.524188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542daa5-6f26-47a2-9a87-c08dcfc06bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:26.525150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542daa5-6f26-47a2-9a87-c08dcfc06bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:26.526123 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542daa5-6f26-47a2-9a87-c08dcfc06bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:26.526560 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542daa5-6f26-47a2-9a87-c08dcfc06bf2 admin admin] PATH_INFO: `/v3/projects/ae30a4bf1342449fa30e9f1ea926d00c` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:26.528142 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542daa5-6f26-47a2-9a87-c08dcfc06bf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae30a4bf1342449fa30e9f1ea926d00c)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:26.530784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542daa5-6f26-47a2-9a87-c08dcfc06bf2 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:26.641044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3bc835ba-46a7-4799-9af9-7538c17ac91c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '827fca47c0ab41e59b969091e22d4963'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.641044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3bc835ba-46a7-4799-9af9-7538c17ac91c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '827fca47c0ab41e59b969091e22d4963'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.649200 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3bc835ba-46a7-4799-9af9-7538c17ac91c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '827fca47c0ab41e59b969091e22d4963'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.737380 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6542daa5-6f26-47a2-9a87-c08dcfc06bf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae30a4bf1342449fa30e9f1ea926d00c', 'request_id': 'req-6542daa5-6f26-47a2-9a87-c08dcfc06bf2'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.746122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6542daa5-6f26-47a2-9a87-c08dcfc06bf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae30a4bf1342449fa30e9f1ea926d00c', 'request_id': 'req-6542daa5-6f26-47a2-9a87-c08dcfc06bf2'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.774136 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3bc835ba-46a7-4799-9af9-7538c17ac91c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '827fca47c0ab41e59b969091e22d4963'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.775515 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3bc835ba-46a7-4799-9af9-7538c17ac91c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '827fca47c0ab41e59b969091e22d4963'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.789550 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 950/1869] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:26 2022] DELETE /identity/v3/users/827fca47c0ab41e59b969091e22d4963 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:26.838639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:26.871801 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6542daa5-6f26-47a2-9a87-c08dcfc06bf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae30a4bf1342449fa30e9f1ea926d00c', 'request_id': 'req-6542daa5-6f26-47a2-9a87-c08dcfc06bf2'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.893221 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6542daa5-6f26-47a2-9a87-c08dcfc06bf2 admin admin] The token cache is being invalidate because project ae30a4bf1342449fa30e9f1ea926d00c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:26.893575 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6542daa5-6f26-47a2-9a87-c08dcfc06bf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.894492 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6542daa5-6f26-47a2-9a87-c08dcfc06bf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:26.896109 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 920/1870] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:26 2022] DELETE /identity/v3/projects/ae30a4bf1342449fa30e9f1ea926d00c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:26.900088 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc835ba-46a7-4799-9af9-7538c17ac91c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:26.901570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3bc835ba-46a7-4799-9af9-7538c17ac91c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:26.974872 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc835ba-46a7-4799-9af9-7538c17ac91c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:26.979744 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31603d78-4759-4d88-9435-ded4a099f7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:26.980478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31603d78-4759-4d88-9435-ded4a099f7c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:26.980764 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31603d78-4759-4d88-9435-ded4a099f7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:26.981039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31603d78-4759-4d88-9435-ded4a099f7c2 admin admin] PATH_INFO: `/v3/users/d3cee41067f548c89cef565124062a1e` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:26.982197 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31603d78-4759-4d88-9435-ded4a099f7c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3cee41067f548c89cef565124062a1e)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:26.984742 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31603d78-4759-4d88-9435-ded4a099f7c2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:27.048813 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:27.111539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542daa5-6f26-47a2-9a87-c08dcfc06bf2 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:27.111539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6542daa5-6f26-47a2-9a87-c08dcfc06bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:27.213546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-31603d78-4759-4d88-9435-ded4a099f7c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3cee41067f548c89cef565124062a1e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:27.214385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-31603d78-4759-4d88-9435-ded4a099f7c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3cee41067f548c89cef565124062a1e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:27.217346 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542daa5-6f26-47a2-9a87-c08dcfc06bf2 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:27.222872 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2322c8-ab38-4dc6-8aa9-12acc53bfe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:27.223511 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2322c8-ab38-4dc6-8aa9-12acc53bfe2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:27.223780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2322c8-ab38-4dc6-8aa9-12acc53bfe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:27.224055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2322c8-ab38-4dc6-8aa9-12acc53bfe2a admin admin] PATH_INFO: `/v3/projects/57caa757444f4288a845729c52944d84` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:27.225354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2322c8-ab38-4dc6-8aa9-12acc53bfe2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=57caa757444f4288a845729c52944d84)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:27.229387 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-31603d78-4759-4d88-9435-ded4a099f7c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3cee41067f548c89cef565124062a1e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:27.235832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2322c8-ab38-4dc6-8aa9-12acc53bfe2a admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:27.276247 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-31603d78-4759-4d88-9435-ded4a099f7c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3cee41067f548c89cef565124062a1e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:27.276965 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-31603d78-4759-4d88-9435-ded4a099f7c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3cee41067f548c89cef565124062a1e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:27.290644 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 951/1871] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:26 2022] DELETE /identity/v3/users/d3cee41067f548c89cef565124062a1e => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:27.293797 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31603d78-4759-4d88-9435-ded4a099f7c2 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:27.293797 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-31603d78-4759-4d88-9435-ded4a099f7c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:27.376695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-5f2322c8-ab38-4dc6-8aa9-12acc53bfe2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57caa757444f4288a845729c52944d84', 'request_id': 'req-5f2322c8-ab38-4dc6-8aa9-12acc53bfe2a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:27.387500 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-5f2322c8-ab38-4dc6-8aa9-12acc53bfe2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57caa757444f4288a845729c52944d84', 'request_id': 'req-5f2322c8-ab38-4dc6-8aa9-12acc53bfe2a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:27.391542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31603d78-4759-4d88-9435-ded4a099f7c2 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:27.470756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-5f2322c8-ab38-4dc6-8aa9-12acc53bfe2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57caa757444f4288a845729c52944d84', 'request_id': 'req-5f2322c8-ab38-4dc6-8aa9-12acc53bfe2a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:27.478596 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b34b8f-3dc5-42cd-8312-ad36e2682745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:27.479333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b34b8f-3dc5-42cd-8312-ad36e2682745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:27.479677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b34b8f-3dc5-42cd-8312-ad36e2682745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:27.480060 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b34b8f-3dc5-42cd-8312-ad36e2682745 admin admin] PATH_INFO: `/v3/projects/decc734892a94c28bbb00cf7b59e7ef7` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:27.481568 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b34b8f-3dc5-42cd-8312-ad36e2682745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=decc734892a94c28bbb00cf7b59e7ef7)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:27.483271 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b34b8f-3dc5-42cd-8312-ad36e2682745 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:27.486103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-5f2322c8-ab38-4dc6-8aa9-12acc53bfe2a admin admin] The token cache is being invalidate because project 57caa757444f4288a845729c52944d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:27.486775 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-5f2322c8-ab38-4dc6-8aa9-12acc53bfe2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:27.487500 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-5f2322c8-ab38-4dc6-8aa9-12acc53bfe2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:27.489694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 921/1872] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:27 2022] DELETE /identity/v3/projects/57caa757444f4288a845729c52944d84 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:27.494751 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f6144-45f6-4075-a666-83099845dea5 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:27.495259 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f6144-45f6-4075-a666-83099845dea5 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:27.495955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f6144-45f6-4075-a666-83099845dea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:27.522613 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-d87f6144-45f6-4075-a666-83099845dea5 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:27.524211 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-d87f6144-45f6-4075-a666-83099845dea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:27.534300 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 922/1873] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:27.542917 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97770350-c67f-4d9f-bbba-7738aea62e4a None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:27.543461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97770350-c67f-4d9f-bbba-7738aea62e4a None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:27.543854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97770350-c67f-4d9f-bbba-7738aea62e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:27.565632 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-97770350-c67f-4d9f-bbba-7738aea62e4a None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:27.567142 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-97770350-c67f-4d9f-bbba-7738aea62e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:27.580280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 923/1874] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:27.582470 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97770350-c67f-4d9f-bbba-7738aea62e4a None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:27.594050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97770350-c67f-4d9f-bbba-7738aea62e4a None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:27.599558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d49cb-30df-4b7b-8f3e-9fd1537a640e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:27.600207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d49cb-30df-4b7b-8f3e-9fd1537a640e admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:27.600524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d49cb-30df-4b7b-8f3e-9fd1537a640e admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:27.600891 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d49cb-30df-4b7b-8f3e-9fd1537a640e admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:27.601657 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d49cb-30df-4b7b-8f3e-9fd1537a640e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:37:27.601969 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d49cb-30df-4b7b-8f3e-9fd1537a640e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:27.604107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d49cb-30df-4b7b-8f3e-9fd1537a640e admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:27.621251 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 924/1875] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:37:27.624746 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d49cb-30df-4b7b-8f3e-9fd1537a640e admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:27.635502 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d49cb-30df-4b7b-8f3e-9fd1537a640e admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:27.642376 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-50b34b8f-3dc5-42cd-8312-ad36e2682745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'decc734892a94c28bbb00cf7b59e7ef7', 'request_id': 'req-50b34b8f-3dc5-42cd-8312-ad36e2682745'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:27.654263 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-50b34b8f-3dc5-42cd-8312-ad36e2682745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'decc734892a94c28bbb00cf7b59e7ef7', 'request_id': 'req-50b34b8f-3dc5-42cd-8312-ad36e2682745'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:27.728086 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c322180-d9c0-44f4-9501-8703ce3cdbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:27.729232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c322180-d9c0-44f4-9501-8703ce3cdbdc admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:27.729232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c322180-d9c0-44f4-9501-8703ce3cdbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:27.729405 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c322180-d9c0-44f4-9501-8703ce3cdbdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:27.730235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c322180-d9c0-44f4-9501-8703ce3cdbdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:27.733096 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c322180-d9c0-44f4-9501-8703ce3cdbdc admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:27.741847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-50b34b8f-3dc5-42cd-8312-ad36e2682745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'decc734892a94c28bbb00cf7b59e7ef7', 'request_id': 'req-50b34b8f-3dc5-42cd-8312-ad36e2682745'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:27.756503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-50b34b8f-3dc5-42cd-8312-ad36e2682745 admin admin] The token cache is being invalidate because project decc734892a94c28bbb00cf7b59e7ef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:27.756866 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-50b34b8f-3dc5-42cd-8312-ad36e2682745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:27.758069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-50b34b8f-3dc5-42cd-8312-ad36e2682745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:27.759665 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 952/1876] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:27 2022] DELETE /identity/v3/projects/decc734892a94c28bbb00cf7b59e7ef7 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:27.764381 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f75cc-44f4-4cd5-8cb5-aa97974f184b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:27.764695 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f75cc-44f4-4cd5-8cb5-aa97974f184b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:27.765513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f75cc-44f4-4cd5-8cb5-aa97974f184b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:27.788128 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d87f75cc-44f4-4cd5-8cb5-aa97974f184b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:27.789531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d87f75cc-44f4-4cd5-8cb5-aa97974f184b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:27.799749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 953/1877] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:27.808276 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7624cb2-df82-4c51-b861-fe39fd7e8e16 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:27.816284 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7624cb2-df82-4c51-b861-fe39fd7e8e16 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:27.816284 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7624cb2-df82-4c51-b861-fe39fd7e8e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:27.829174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d7624cb2-df82-4c51-b861-fe39fd7e8e16 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:27.830376 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d7624cb2-df82-4c51-b861-fe39fd7e8e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:27.840519 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 954/1878] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:27.844130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 925/1879] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:27 2022] POST /identity/v3/projects => generated 363 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:27.845080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7624cb2-df82-4c51-b861-fe39fd7e8e16 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:27.847839 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c322180-d9c0-44f4-9501-8703ce3cdbdc admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:27.849524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-7c322180-d9c0-44f4-9501-8703ce3cdbdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:27.854359 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7624cb2-df82-4c51-b861-fe39fd7e8e16 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:27.914534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c322180-d9c0-44f4-9501-8703ce3cdbdc admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:27.916881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044451b1-727f-49c3-af2c-4d803eb2cb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:27.917594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044451b1-727f-49c3-af2c-4d803eb2cb8d admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:27.917990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044451b1-727f-49c3-af2c-4d803eb2cb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:27.918262 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044451b1-727f-49c3-af2c-4d803eb2cb8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:27.919157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044451b1-727f-49c3-af2c-4d803eb2cb8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:37:27.919381 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405ec7d-6d13-4cc8-ba41-2bd96c31c886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:27.919487 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044451b1-727f-49c3-af2c-4d803eb2cb8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:27.919993 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405ec7d-6d13-4cc8-ba41-2bd96c31c886 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:27.920272 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405ec7d-6d13-4cc8-ba41-2bd96c31c886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:27.920580 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405ec7d-6d13-4cc8-ba41-2bd96c31c886 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:27.921264 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044451b1-727f-49c3-af2c-4d803eb2cb8d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:27.921767 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405ec7d-6d13-4cc8-ba41-2bd96c31c886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:27.925912 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405ec7d-6d13-4cc8-ba41-2bd96c31c886 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:27.934690 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 955/1880] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:37:27.939564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044451b1-727f-49c3-af2c-4d803eb2cb8d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:27.949649 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044451b1-727f-49c3-af2c-4d803eb2cb8d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:27.954746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780a105-3819-4fa2-8c18-7cf9e19ef319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:27.955346 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780a105-3819-4fa2-8c18-7cf9e19ef319 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:27.955658 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780a105-3819-4fa2-8c18-7cf9e19ef319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:27.955933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780a105-3819-4fa2-8c18-7cf9e19ef319 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:27.956588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780a105-3819-4fa2-8c18-7cf9e19ef319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:27.958476 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780a105-3819-4fa2-8c18-7cf9e19ef319 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:28.060959 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 926/1881] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:27 2022] POST /identity/v3/users => generated 282 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:37:28.060959 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405ec7d-6d13-4cc8-ba41-2bd96c31c886 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:28.065543 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b405ec7d-6d13-4cc8-ba41-2bd96c31c886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:28.076681 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405ec7d-6d13-4cc8-ba41-2bd96c31c886 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:28.081633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f6a97-86dd-49bd-8dad-807de5f99db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:28.082279 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f6a97-86dd-49bd-8dad-807de5f99db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:28.082754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f6a97-86dd-49bd-8dad-807de5f99db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:28.083032 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f6a97-86dd-49bd-8dad-807de5f99db0 admin admin] PATH_INFO: `/v3/projects/88ef094f06924f36900a66f6e6dd91ae` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:28.084187 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f6a97-86dd-49bd-8dad-807de5f99db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88ef094f06924f36900a66f6e6dd91ae)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:28.086115 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f6a97-86dd-49bd-8dad-807de5f99db0 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:28.089682 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 956/1882] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:27 2022] POST /identity/v3/projects => generated 367 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:37:28.091809 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780a105-3819-4fa2-8c18-7cf9e19ef319 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:28.154314 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780a105-3819-4fa2-8c18-7cf9e19ef319 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:28.158993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae0a07-bf1c-4046-9eec-4216316f11bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:28.159590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae0a07-bf1c-4046-9eec-4216316f11bb admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:28.159867 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae0a07-bf1c-4046-9eec-4216316f11bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:28.160144 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae0a07-bf1c-4046-9eec-4216316f11bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:28.160816 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae0a07-bf1c-4046-9eec-4216316f11bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:28.162398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae0a07-bf1c-4046-9eec-4216316f11bb admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:28.175730 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 957/1883] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:28.175730 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae0a07-bf1c-4046-9eec-4216316f11bb admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:28.182244 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f13f6a97-86dd-49bd-8dad-807de5f99db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88ef094f06924f36900a66f6e6dd91ae', 'request_id': 'req-f13f6a97-86dd-49bd-8dad-807de5f99db0'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:28.183967 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae0a07-bf1c-4046-9eec-4216316f11bb admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:28.189683 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f13f6a97-86dd-49bd-8dad-807de5f99db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88ef094f06924f36900a66f6e6dd91ae', 'request_id': 'req-f13f6a97-86dd-49bd-8dad-807de5f99db0'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:28.242047 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7103b-be4e-40f2-8ba7-615815021345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:28.242330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f13f6a97-86dd-49bd-8dad-807de5f99db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88ef094f06924f36900a66f6e6dd91ae', 'request_id': 'req-f13f6a97-86dd-49bd-8dad-807de5f99db0'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:28.242815 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7103b-be4e-40f2-8ba7-615815021345 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:28.243163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7103b-be4e-40f2-8ba7-615815021345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:28.243510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7103b-be4e-40f2-8ba7-615815021345 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:28.244207 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7103b-be4e-40f2-8ba7-615815021345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:28.246204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7103b-be4e-40f2-8ba7-615815021345 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:28.256246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f13f6a97-86dd-49bd-8dad-807de5f99db0 admin admin] The token cache is being invalidate because project 88ef094f06924f36900a66f6e6dd91ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:28.256630 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f13f6a97-86dd-49bd-8dad-807de5f99db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:28.257660 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f13f6a97-86dd-49bd-8dad-807de5f99db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:28.259208 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 927/1884] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:28 2022] DELETE /identity/v3/projects/88ef094f06924f36900a66f6e6dd91ae => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:28.259984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f6a97-86dd-49bd-8dad-807de5f99db0 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:28.261355 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f13f6a97-86dd-49bd-8dad-807de5f99db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:28.274423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f6a97-86dd-49bd-8dad-807de5f99db0 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:28.279228 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b32cf7-12d9-420f-8027-130a1ee0ae9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:28.279910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b32cf7-12d9-420f-8027-130a1ee0ae9c admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:28.280266 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b32cf7-12d9-420f-8027-130a1ee0ae9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:28.281300 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b32cf7-12d9-420f-8027-130a1ee0ae9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:28.282004 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b32cf7-12d9-420f-8027-130a1ee0ae9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:28.283659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b32cf7-12d9-420f-8027-130a1ee0ae9c admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:28.293749 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 928/1885] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:28.294936 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fa2c6-f322-472d-a93a-97e24eb1186c None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:28.295215 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fa2c6-f322-472d-a93a-97e24eb1186c None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:28.295488 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fa2c6-f322-472d-a93a-97e24eb1186c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:28.323853 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-369fa2c6-f322-472d-a93a-97e24eb1186c None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:28.323853 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-369fa2c6-f322-472d-a93a-97e24eb1186c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:28.323853 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 929/1886] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:28.324644 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fa2c6-f322-472d-a93a-97e24eb1186c None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:28.334653 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fa2c6-f322-472d-a93a-97e24eb1186c None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:28.339875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fed17-67ca-4989-933d-d774693b0964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:28.340621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fed17-67ca-4989-933d-d774693b0964 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:28.341028 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fed17-67ca-4989-933d-d774693b0964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:28.341358 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fed17-67ca-4989-933d-d774693b0964 admin admin] PATH_INFO: `/v3/projects/af1522cb05b84f70a755461a2aeb228a/users/9582b0d91fe04d13bd01487cead85b92/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:28.350064 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 958/1887] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:28 2022] POST /identity/v3/users => generated 284 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:28.350064 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdfbde-db2d-43ff-8e7e-1808b79c2adc None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:28.350064 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdfbde-db2d-43ff-8e7e-1808b79c2adc None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:28.350064 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdfbde-db2d-43ff-8e7e-1808b79c2adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:28.359031 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fed17-67ca-4989-933d-d774693b0964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1522cb05b84f70a755461a2aeb228a, user_id=9582b0d91fe04d13bd01487cead85b92, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:28.362222 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fed17-67ca-4989-933d-d774693b0964 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:28.370121 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-63fdfbde-db2d-43ff-8e7e-1808b79c2adc None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:28.371337 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-63fdfbde-db2d-43ff-8e7e-1808b79c2adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:28.387996 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 959/1888] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:28.387996 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fdfbde-db2d-43ff-8e7e-1808b79c2adc None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:28.387996 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-63fdfbde-db2d-43ff-8e7e-1808b79c2adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:28.395158 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fdfbde-db2d-43ff-8e7e-1808b79c2adc None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:28.399735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6258c62-3ab8-4c83-a05b-4b4ef363de06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:28.400325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6258c62-3ab8-4c83-a05b-4b4ef363de06 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:28.400639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6258c62-3ab8-4c83-a05b-4b4ef363de06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:28.404477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6258c62-3ab8-4c83-a05b-4b4ef363de06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:28.404477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6258c62-3ab8-4c83-a05b-4b4ef363de06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:28.404477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6258c62-3ab8-4c83-a05b-4b4ef363de06 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:28.413554 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 960/1889] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:28.414336 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6258c62-3ab8-4c83-a05b-4b4ef363de06 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:28.424686 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 930/1890] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:28 2022] PUT /identity/v3/projects/af1522cb05b84f70a755461a2aeb228a/users/9582b0d91fe04d13bd01487cead85b92/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:28.426318 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fed17-67ca-4989-933d-d774693b0964 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:28.434591 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6258c62-3ab8-4c83-a05b-4b4ef363de06 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:28.530928 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63771d0a-f8b9-41e3-a62f-ba15cf39712d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:28.536214 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fed17-67ca-4989-933d-d774693b0964 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:28.536696 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63771d0a-f8b9-41e3-a62f-ba15cf39712d admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:28.536696 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63771d0a-f8b9-41e3-a62f-ba15cf39712d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:28.536696 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63771d0a-f8b9-41e3-a62f-ba15cf39712d admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:28.536696 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63771d0a-f8b9-41e3-a62f-ba15cf39712d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:37:28.536696 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63771d0a-f8b9-41e3-a62f-ba15cf39712d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:28.536696 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63771d0a-f8b9-41e3-a62f-ba15cf39712d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:28.540556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7dda42-e151-4a66-b3cc-21e8a7bacb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:28.541333 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dda42-e151-4a66-b3cc-21e8a7bacb37 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:28.541782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dda42-e151-4a66-b3cc-21e8a7bacb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:28.543872 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dda42-e151-4a66-b3cc-21e8a7bacb37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:28.544591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7dda42-e151-4a66-b3cc-21e8a7bacb37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:28.546236 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7dda42-e151-4a66-b3cc-21e8a7bacb37 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:28.556672 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 961/1891] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:37:28.562861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76653f7-61d0-4d44-98b5-4b30864a1f0d None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:28.562861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76653f7-61d0-4d44-98b5-4b30864a1f0d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:28.562861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76653f7-61d0-4d44-98b5-4b30864a1f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:28.577322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 931/1892] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:28.579169 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7dda42-e151-4a66-b3cc-21e8a7bacb37 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:28.595139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7dda42-e151-4a66-b3cc-21e8a7bacb37 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:28.600384 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff176d93-3941-4611-bca2-2fba304daefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:28.600996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff176d93-3941-4611-bca2-2fba304daefe admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:28.601275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff176d93-3941-4611-bca2-2fba304daefe admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:28.601549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff176d93-3941-4611-bca2-2fba304daefe admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:28.602185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff176d93-3941-4611-bca2-2fba304daefe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:28.604099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff176d93-3941-4611-bca2-2fba304daefe admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:28.604549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a76653f7-61d0-4d44-98b5-4b30864a1f0d None None] MFA Rules not processed for user `9582b0d91fe04d13bd01487cead85b92`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:28.608373 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a76653f7-61d0-4d44-98b5-4b30864a1f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:28.687121 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 962/1893] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:28.691598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76653f7-61d0-4d44-98b5-4b30864a1f0d None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:28.706377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76653f7-61d0-4d44-98b5-4b30864a1f0d None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:28.706519 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 932/1894] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:28 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:28.706519 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff176d93-3941-4611-bca2-2fba304daefe admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:28.791095 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd755c3-aedc-41b9-9de4-675fd16e355d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:28.791772 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd755c3-aedc-41b9-9de4-675fd16e355d admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:28.792052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd755c3-aedc-41b9-9de4-675fd16e355d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:28.792319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd755c3-aedc-41b9-9de4-675fd16e355d admin admin] PATH_INFO: `/v3/projects/229b90e114e44c889f9c37fe1eaa9b68/users/41685313f3784defbe4f6308e73cd673/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:28.815531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd755c3-aedc-41b9-9de4-675fd16e355d admin admin] RBAC: Authorizing `identity:create_grant(project_id=229b90e114e44c889f9c37fe1eaa9b68, user_id=41685313f3784defbe4f6308e73cd673, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:28.819723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd755c3-aedc-41b9-9de4-675fd16e355d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:28.821602 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff176d93-3941-4611-bca2-2fba304daefe admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:28.827284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7ee62-3fb8-4d07-a3ac-a858b1899705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:28.830414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7ee62-3fb8-4d07-a3ac-a858b1899705 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:28.830414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7ee62-3fb8-4d07-a3ac-a858b1899705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:28.830414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7ee62-3fb8-4d07-a3ac-a858b1899705 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:28.830414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7ee62-3fb8-4d07-a3ac-a858b1899705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:28.831435 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7ee62-3fb8-4d07-a3ac-a858b1899705 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:28.911395 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 963/1895] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:28 2022] PUT /identity/v3/projects/229b90e114e44c889f9c37fe1eaa9b68/users/41685313f3784defbe4f6308e73cd673/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:28.912505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd755c3-aedc-41b9-9de4-675fd16e355d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:28.968095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 933/1896] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:28 2022] POST /identity/v3/projects => generated 365 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:28.968095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1576c0c-edd3-4b69-8c6e-1c896902edd6 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:28.968095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1576c0c-edd3-4b69-8c6e-1c896902edd6 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:28.968095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1576c0c-edd3-4b69-8c6e-1c896902edd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:28.977397 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd755c3-aedc-41b9-9de4-675fd16e355d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:28.995223 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-a1576c0c-edd3-4b69-8c6e-1c896902edd6 None None] MFA Rules not processed for user `41685313f3784defbe4f6308e73cd673`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:28.996452 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a1576c0c-edd3-4b69-8c6e-1c896902edd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:29.033764 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279a467-4049-47ae-a04d-d7ae6ed242a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:29.034354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279a467-4049-47ae-a04d-d7ae6ed242a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:29.034635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279a467-4049-47ae-a04d-d7ae6ed242a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:29.034939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279a467-4049-47ae-a04d-d7ae6ed242a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:29.035582 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279a467-4049-47ae-a04d-d7ae6ed242a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:29.037507 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279a467-4049-47ae-a04d-d7ae6ed242a0 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:29.059702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 934/1897] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:29.060922 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1576c0c-edd3-4b69-8c6e-1c896902edd6 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:29.071657 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1576c0c-edd3-4b69-8c6e-1c896902edd6 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:29.077119 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dca86-71a3-486c-95e9-92179b26edba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:29.078371 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dca86-71a3-486c-95e9-92179b26edba admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:29.078648 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dca86-71a3-486c-95e9-92179b26edba admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:29.078921 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dca86-71a3-486c-95e9-92179b26edba admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:29.079666 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88dca86-71a3-486c-95e9-92179b26edba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:29.081497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88dca86-71a3-486c-95e9-92179b26edba admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:29.148683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 964/1898] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:28 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:29.151227 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279a467-4049-47ae-a04d-d7ae6ed242a0 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:29.164751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279a467-4049-47ae-a04d-d7ae6ed242a0 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:29.170707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c9509-f9ef-486e-bf58-7137f44281e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:29.171363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c9509-f9ef-486e-bf58-7137f44281e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:29.171784 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c9509-f9ef-486e-bf58-7137f44281e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:29.172117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c9509-f9ef-486e-bf58-7137f44281e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:29.172845 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c9509-f9ef-486e-bf58-7137f44281e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:29.174918 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c9509-f9ef-486e-bf58-7137f44281e5 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:29.214584 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 935/1899] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:29 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:29.215660 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dca86-71a3-486c-95e9-92179b26edba admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:29.226738 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dca86-71a3-486c-95e9-92179b26edba admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:29.232045 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1c60-4fef-46a9-902a-6ddea30b713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:29.232794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1c60-4fef-46a9-902a-6ddea30b713e admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:29.233143 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1c60-4fef-46a9-902a-6ddea30b713e admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:29.233422 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1c60-4fef-46a9-902a-6ddea30b713e admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:29.234088 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab1c60-4fef-46a9-902a-6ddea30b713e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:29.235780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab1c60-4fef-46a9-902a-6ddea30b713e admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:29.247257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 936/1900] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:29.248057 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1c60-4fef-46a9-902a-6ddea30b713e admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:29.259472 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1c60-4fef-46a9-902a-6ddea30b713e admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:29.264095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a278af-6fc3-484b-a68f-9a06054d1eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:29.264829 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a278af-6fc3-484b-a68f-9a06054d1eaa admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:29.265619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a278af-6fc3-484b-a68f-9a06054d1eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:29.265917 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a278af-6fc3-484b-a68f-9a06054d1eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:29.269991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a278af-6fc3-484b-a68f-9a06054d1eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:29.269991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a278af-6fc3-484b-a68f-9a06054d1eaa admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:29.278342 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 937/1901] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:29.279122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a278af-6fc3-484b-a68f-9a06054d1eaa admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:29.290892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a278af-6fc3-484b-a68f-9a06054d1eaa admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:29.296028 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5803e9f-f1a0-4c2b-8755-38435a20ac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:29.296659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5803e9f-f1a0-4c2b-8755-38435a20ac77 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:29.296935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5803e9f-f1a0-4c2b-8755-38435a20ac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:29.297772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5803e9f-f1a0-4c2b-8755-38435a20ac77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:29.298798 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5803e9f-f1a0-4c2b-8755-38435a20ac77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:29.300084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5803e9f-f1a0-4c2b-8755-38435a20ac77 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:29.311044 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 938/1902] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:29.312395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5803e9f-f1a0-4c2b-8755-38435a20ac77 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:29.323999 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5803e9f-f1a0-4c2b-8755-38435a20ac77 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:29.331676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e665af-d331-40e1-8985-8d6f87f64730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:29.332524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e665af-d331-40e1-8985-8d6f87f64730 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:29.332853 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e665af-d331-40e1-8985-8d6f87f64730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:29.333127 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e665af-d331-40e1-8985-8d6f87f64730 admin admin] PATH_INFO: `/v3/projects/003b342ef671441f9762769a85f49568/users/a4f567709e9e45919942a4bfc3082b0d/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:29.338815 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 965/1903] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:29 2022] POST /identity/v3/projects => generated 367 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:29.342903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c9509-f9ef-486e-bf58-7137f44281e5 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:29.353951 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e665af-d331-40e1-8985-8d6f87f64730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=003b342ef671441f9762769a85f49568, user_id=a4f567709e9e45919942a4bfc3082b0d, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:29.358813 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e665af-d331-40e1-8985-8d6f87f64730 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:29.427398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 939/1904] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:29 2022] PUT /identity/v3/projects/003b342ef671441f9762769a85f49568/users/a4f567709e9e45919942a4bfc3082b0d/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:29.428487 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e665af-d331-40e1-8985-8d6f87f64730 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:29.465746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c9509-f9ef-486e-bf58-7137f44281e5 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:29.486229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:29.557982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e665af-d331-40e1-8985-8d6f87f64730 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:29.562294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e57e3-b873-49a5-9376-53f64e05e143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:29.563261 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e57e3-b873-49a5-9376-53f64e05e143 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:29.564111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e57e3-b873-49a5-9376-53f64e05e143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:29.564728 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e57e3-b873-49a5-9376-53f64e05e143 admin admin] PATH_INFO: `/v3/projects/429b9c8e356d477a9a8e8e1ad8ac16c0/users/e77fe72284974702a6a63d9c374b562d/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:29.570814 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fec5f-97aa-4119-b8f7-f6fb035ff321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:29.571935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fec5f-97aa-4119-b8f7-f6fb035ff321 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:29.572549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fec5f-97aa-4119-b8f7-f6fb035ff321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:29.572829 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fec5f-97aa-4119-b8f7-f6fb035ff321 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:29.573476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37fec5f-97aa-4119-b8f7-f6fb035ff321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:29.575613 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37fec5f-97aa-4119-b8f7-f6fb035ff321 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:29.596283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e57e3-b873-49a5-9376-53f64e05e143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=429b9c8e356d477a9a8e8e1ad8ac16c0, user_id=e77fe72284974702a6a63d9c374b562d, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:29.599230 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e57e3-b873-49a5-9376-53f64e05e143 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:29.695458 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 940/1905] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:29 2022] POST /identity/v3/users => generated 290 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:29.696658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fec5f-97aa-4119-b8f7-f6fb035ff321 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:29.700663 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 966/1906] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:29 2022] PUT /identity/v3/projects/429b9c8e356d477a9a8e8e1ad8ac16c0/users/e77fe72284974702a6a63d9c374b562d/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:29.701549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e57e3-b873-49a5-9376-53f64e05e143 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:29.708652 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fec5f-97aa-4119-b8f7-f6fb035ff321 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:29.721145 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:29.777038 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc3874-b861-43c9-b592-c45ce8ebefad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:29.777694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc3874-b861-43c9-b592-c45ce8ebefad admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:29.777849 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e57e3-b873-49a5-9376-53f64e05e143 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:29.777993 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc3874-b861-43c9-b592-c45ce8ebefad admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:29.778283 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc3874-b861-43c9-b592-c45ce8ebefad admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:29.778971 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc3874-b861-43c9-b592-c45ce8ebefad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:29.780625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc3874-b861-43c9-b592-c45ce8ebefad admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:29.789006 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037985fd-bd67-4d38-a760-9f975c70ed68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:29.789860 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037985fd-bd67-4d38-a760-9f975c70ed68 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:29.790145 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037985fd-bd67-4d38-a760-9f975c70ed68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:29.790422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037985fd-bd67-4d38-a760-9f975c70ed68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:29.790702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 941/1907] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:29.791395 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037985fd-bd67-4d38-a760-9f975c70ed68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:29.791926 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492f39e-4632-4d83-a093-b8b61f4c0373 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:29.792210 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492f39e-4632-4d83-a093-b8b61f4c0373 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:29.792507 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492f39e-4632-4d83-a093-b8b61f4c0373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:29.799840 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037985fd-bd67-4d38-a760-9f975c70ed68 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:29.813110 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 967/1908] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:29.814228 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037985fd-bd67-4d38-a760-9f975c70ed68 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:29.822766 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-9492f39e-4632-4d83-a093-b8b61f4c0373 None None] MFA Rules not processed for user `e77fe72284974702a6a63d9c374b562d`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:29.824037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-9492f39e-4632-4d83-a093-b8b61f4c0373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:29.825950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037985fd-bd67-4d38-a760-9f975c70ed68 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:29.832385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4805df2-7aa6-41c8-b8ae-2f16a72a0e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:29.832385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805df2-7aa6-41c8-b8ae-2f16a72a0e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:29.832624 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805df2-7aa6-41c8-b8ae-2f16a72a0e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:29.832910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805df2-7aa6-41c8-b8ae-2f16a72a0e2d admin admin] PATH_INFO: `/v3/projects/003b342ef671441f9762769a85f49568/users/a4f567709e9e45919942a4bfc3082b0d/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:29.835750 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4805df2-7aa6-41c8-b8ae-2f16a72a0e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=003b342ef671441f9762769a85f49568, user_id=a4f567709e9e45919942a4bfc3082b0d, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:29.838586 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4805df2-7aa6-41c8-b8ae-2f16a72a0e2d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:29.850424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 968/1909] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:29 2022] PUT /identity/v3/projects/003b342ef671441f9762769a85f49568/users/a4f567709e9e45919942a4bfc3082b0d/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:29.851240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4805df2-7aa6-41c8-b8ae-2f16a72a0e2d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:29.891457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 942/1910] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:29.893615 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a5428-d2bc-4ffe-822b-c657389bd61e None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:29.894030 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a5428-d2bc-4ffe-822b-c657389bd61e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:29.894284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a5428-d2bc-4ffe-822b-c657389bd61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:29.923483 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-8d7a5428-d2bc-4ffe-822b-c657389bd61e None None] MFA Rules not processed for user `a4f567709e9e45919942a4bfc3082b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:29.924879 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-8d7a5428-d2bc-4ffe-822b-c657389bd61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:29.925330 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4805df2-7aa6-41c8-b8ae-2f16a72a0e2d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:29.930200 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189a38-1c98-45ee-b486-d27180a679ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:29.930848 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189a38-1c98-45ee-b486-d27180a679ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:29.931123 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189a38-1c98-45ee-b486-d27180a679ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:29.931403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189a38-1c98-45ee-b486-d27180a679ea admin admin] PATH_INFO: `/v3/projects/81e72fd2323846f996703cf53c136aeb/users/ce0d642a02994a08ade655d4f3f7ac78/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:29.949377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2189a38-1c98-45ee-b486-d27180a679ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e72fd2323846f996703cf53c136aeb, user_id=ce0d642a02994a08ade655d4f3f7ac78, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:29.952059 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2189a38-1c98-45ee-b486-d27180a679ea admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:29.999687 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 943/1911] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:29.999687 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a5428-d2bc-4ffe-822b-c657389bd61e None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:30.009712 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a5428-d2bc-4ffe-822b-c657389bd61e None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:30.015954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4184f6-11e6-444f-aec6-7b26c8fa2db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:30.015954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4184f6-11e6-444f-aec6-7b26c8fa2db7 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:30.015954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4184f6-11e6-444f-aec6-7b26c8fa2db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:30.016292 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4184f6-11e6-444f-aec6-7b26c8fa2db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:30.016931 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4184f6-11e6-444f-aec6-7b26c8fa2db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:30.020824 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4184f6-11e6-444f-aec6-7b26c8fa2db7 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:30.073646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 969/1912] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:29 2022] PUT /identity/v3/projects/81e72fd2323846f996703cf53c136aeb/users/ce0d642a02994a08ade655d4f3f7ac78/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:30.078071 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189a38-1c98-45ee-b486-d27180a679ea admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:30.080030 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e2189a38-1c98-45ee-b486-d27180a679ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:30.143295 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 944/1913] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:29 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:30.143295 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4184f6-11e6-444f-aec6-7b26c8fa2db7 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:30.150480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189a38-1c98-45ee-b486-d27180a679ea admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:30.210406 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564f7be-fbc3-468c-9c93-fe1508dc3a48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:30.211235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564f7be-fbc3-468c-9c93-fe1508dc3a48 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:30.211665 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564f7be-fbc3-468c-9c93-fe1508dc3a48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:30.212692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564f7be-fbc3-468c-9c93-fe1508dc3a48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:30.221034 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4184f6-11e6-444f-aec6-7b26c8fa2db7 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:30.227926 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e389ee-6b0c-43e2-ada6-ae4cc56098aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:30.228650 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e389ee-6b0c-43e2-ada6-ae4cc56098aa admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:30.228931 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e389ee-6b0c-43e2-ada6-ae4cc56098aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:30.229204 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e389ee-6b0c-43e2-ada6-ae4cc56098aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:30.229886 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e389ee-6b0c-43e2-ada6-ae4cc56098aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:30.231509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e389ee-6b0c-43e2-ada6-ae4cc56098aa admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:30.241673 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 945/1914] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:30.242395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e389ee-6b0c-43e2-ada6-ae4cc56098aa admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:30.253017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e389ee-6b0c-43e2-ada6-ae4cc56098aa admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:30.258878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed61ec3-eb72-408e-a53b-ca846223d7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:30.259590 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61ec3-eb72-408e-a53b-ca846223d7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:30.260613 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61ec3-eb72-408e-a53b-ca846223d7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:30.261720 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61ec3-eb72-408e-a53b-ca846223d7d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:30.262554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed61ec3-eb72-408e-a53b-ca846223d7d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:30.264523 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed61ec3-eb72-408e-a53b-ca846223d7d7 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:30.301400 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564f7be-fbc3-468c-9c93-fe1508dc3a48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:30.303088 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564f7be-fbc3-468c-9c93-fe1508dc3a48 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:30.315065 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 970/1915] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:30 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:30.315693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564f7be-fbc3-468c-9c93-fe1508dc3a48 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:30.325581 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564f7be-fbc3-468c-9c93-fe1508dc3a48 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:30.330379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2b4ac-4d0c-4938-b539-4d3cffd5be57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:30.331041 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2b4ac-4d0c-4938-b539-4d3cffd5be57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:30.331324 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2b4ac-4d0c-4938-b539-4d3cffd5be57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:30.331604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2b4ac-4d0c-4938-b539-4d3cffd5be57 admin admin] PATH_INFO: `/v3/projects/81e72fd2323846f996703cf53c136aeb/users/ce0d642a02994a08ade655d4f3f7ac78/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:30.341135 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 946/1916] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:30 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:30.344164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2b4ac-4d0c-4938-b539-4d3cffd5be57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e72fd2323846f996703cf53c136aeb, user_id=ce0d642a02994a08ade655d4f3f7ac78, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:30.345166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed61ec3-eb72-408e-a53b-ca846223d7d7 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:30.346919 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2b4ac-4d0c-4938-b539-4d3cffd5be57 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:30.357875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed61ec3-eb72-408e-a53b-ca846223d7d7 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:30.360925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 971/1917] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:30 2022] PUT /identity/v3/projects/81e72fd2323846f996703cf53c136aeb/users/ce0d642a02994a08ade655d4f3f7ac78/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:30.373460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3f7ac-3609-4ea2-8a60-d6e4281566d4 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:30.374231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3f7ac-3609-4ea2-8a60-d6e4281566d4 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:30.375194 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3f7ac-3609-4ea2-8a60-d6e4281566d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:30.420651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-13c3f7ac-3609-4ea2-8a60-d6e4281566d4 None None] MFA Rules not processed for user `ce0d642a02994a08ade655d4f3f7ac78`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:30.420651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-13c3f7ac-3609-4ea2-8a60-d6e4281566d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:30.432684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49d57f-0c7b-4015-9cbc-c0853d91a3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:30.433338 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49d57f-0c7b-4015-9cbc-c0853d91a3fa admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:30.433622 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49d57f-0c7b-4015-9cbc-c0853d91a3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:30.433896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49d57f-0c7b-4015-9cbc-c0853d91a3fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:30.434619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49d57f-0c7b-4015-9cbc-c0853d91a3fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:30.436138 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49d57f-0c7b-4015-9cbc-c0853d91a3fa admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:30.449509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 947/1918] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:30.453457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49d57f-0c7b-4015-9cbc-c0853d91a3fa admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:30.468716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49d57f-0c7b-4015-9cbc-c0853d91a3fa admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:30.476054 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f42f79-1989-4399-821b-1fb3f27cd31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:30.477659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f42f79-1989-4399-821b-1fb3f27cd31b admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:30.478263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f42f79-1989-4399-821b-1fb3f27cd31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:30.478855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f42f79-1989-4399-821b-1fb3f27cd31b admin admin] PATH_INFO: `/v3/projects/5d84da2b67d14cd6b0052dd969e24bbc/users/4030e92eb47b45599b31afe235bc9a1b/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:30.521694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f42f79-1989-4399-821b-1fb3f27cd31b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d84da2b67d14cd6b0052dd969e24bbc, user_id=4030e92eb47b45599b31afe235bc9a1b, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:30.524366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f42f79-1989-4399-821b-1fb3f27cd31b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:30.546539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 972/1919] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:30.619677 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 948/1920] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:30 2022] PUT /identity/v3/projects/5d84da2b67d14cd6b0052dd969e24bbc/users/4030e92eb47b45599b31afe235bc9a1b/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:37:30.627072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3f7ac-3609-4ea2-8a60-d6e4281566d4 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:30.629862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f42f79-1989-4399-821b-1fb3f27cd31b admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:30.637712 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3f7ac-3609-4ea2-8a60-d6e4281566d4 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:30.685566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f42f79-1989-4399-821b-1fb3f27cd31b admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:30.689550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d70c9-85d3-4344-86fa-5b6feeff408a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:30.690161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d70c9-85d3-4344-86fa-5b6feeff408a service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:30.690439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d70c9-85d3-4344-86fa-5b6feeff408a service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:30.690715 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d70c9-85d3-4344-86fa-5b6feeff408a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:30.694440 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50ee9c-21b5-42f3-b5d0-4c24422fbfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:30.695053 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50ee9c-21b5-42f3-b5d0-4c24422fbfa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:30.695339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50ee9c-21b5-42f3-b5d0-4c24422fbfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:30.695619 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50ee9c-21b5-42f3-b5d0-4c24422fbfa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:30.696283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50ee9c-21b5-42f3-b5d0-4c24422fbfa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:30.698354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50ee9c-21b5-42f3-b5d0-4c24422fbfa0 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:30.716528 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 973/1921] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:30.719840 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50ee9c-21b5-42f3-b5d0-4c24422fbfa0 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:30.736990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50ee9c-21b5-42f3-b5d0-4c24422fbfa0 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:30.738766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83baaa-cd01-4dfe-b66a-57d607fd780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:30.739416 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83baaa-cd01-4dfe-b66a-57d607fd780e admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:30.739823 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83baaa-cd01-4dfe-b66a-57d607fd780e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:30.740106 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83baaa-cd01-4dfe-b66a-57d607fd780e admin admin] PATH_INFO: `/v3/projects/5d84da2b67d14cd6b0052dd969e24bbc/users/4030e92eb47b45599b31afe235bc9a1b/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:30.742174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83baaa-cd01-4dfe-b66a-57d607fd780e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d84da2b67d14cd6b0052dd969e24bbc, user_id=4030e92eb47b45599b31afe235bc9a1b, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:30.745439 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83baaa-cd01-4dfe-b66a-57d607fd780e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:30.769073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 974/1922] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:30 2022] PUT /identity/v3/projects/5d84da2b67d14cd6b0052dd969e24bbc/users/4030e92eb47b45599b31afe235bc9a1b/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:30.771659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d70c9-85d3-4344-86fa-5b6feeff408a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:30.773630 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d70c9-85d3-4344-86fa-5b6feeff408a service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:30.790825 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 949/1923] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:37:30.792276 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eccd7e-c338-4272-b30b-7070ceacf815 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:30.792593 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eccd7e-c338-4272-b30b-7070ceacf815 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:30.792892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eccd7e-c338-4272-b30b-7070ceacf815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:30.827796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-f7eccd7e-c338-4272-b30b-7070ceacf815 None None] MFA Rules not processed for user `4030e92eb47b45599b31afe235bc9a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:30.832378 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f7eccd7e-c338-4272-b30b-7070ceacf815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:30.911305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 975/1924] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:30.974649 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d70c9-85d3-4344-86fa-5b6feeff408a service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:30.983244 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d70c9-85d3-4344-86fa-5b6feeff408a service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:31.034841 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4fcf9-c4c1-4d95-9067-a56f3ab278c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:31.035694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4fcf9-c4c1-4d95-9067-a56f3ab278c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:31.035803 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4fcf9-c4c1-4d95-9067-a56f3ab278c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:31.036240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4fcf9-c4c1-4d95-9067-a56f3ab278c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:31.095633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4fcf9-c4c1-4d95-9067-a56f3ab278c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:31.097167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4fcf9-c4c1-4d95-9067-a56f3ab278c6 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:31.106009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 950/1925] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:31.198747 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eccd7e-c338-4272-b30b-7070ceacf815 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:31.214640 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eccd7e-c338-4272-b30b-7070ceacf815 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:31.218341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a88f9-56f5-470a-9ca5-1c0c86fe6af3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:31.218942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a88f9-56f5-470a-9ca5-1c0c86fe6af3 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:31.219218 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a88f9-56f5-470a-9ca5-1c0c86fe6af3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:31.219487 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a88f9-56f5-470a-9ca5-1c0c86fe6af3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:31.288174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a88f9-56f5-470a-9ca5-1c0c86fe6af3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:31.289666 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a88f9-56f5-470a-9ca5-1c0c86fe6af3 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:31.300199 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 976/1926] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:31.505930 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:31.644153 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:32.895230 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4fcf9-c4c1-4d95-9067-a56f3ab278c6 service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:32.896710 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-17b4fcf9-c4c1-4d95-9067-a56f3ab278c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:32.960981 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4fcf9-c4c1-4d95-9067-a56f3ab278c6 service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:32.965413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e6ba6-65a1-410c-8bd7-ba1b6d0f2420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:32.966035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e6ba6-65a1-410c-8bd7-ba1b6d0f2420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:32.966305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e6ba6-65a1-410c-8bd7-ba1b6d0f2420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:32.966572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e6ba6-65a1-410c-8bd7-ba1b6d0f2420 admin admin] PATH_INFO: `/v3/users/9838ca43128744c294716329c36af578` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:32.967676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e6ba6-65a1-410c-8bd7-ba1b6d0f2420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9838ca43128744c294716329c36af578)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:32.969669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e6ba6-65a1-410c-8bd7-ba1b6d0f2420 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:33.099821 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a88f9-56f5-470a-9ca5-1c0c86fe6af3 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:33.110950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a88f9-56f5-470a-9ca5-1c0c86fe6af3 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:33.115685 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6daa66-0ffa-4b0a-897d-19c8413c6a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:33.116466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6daa66-0ffa-4b0a-897d-19c8413c6a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:33.116867 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6daa66-0ffa-4b0a-897d-19c8413c6a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:33.117164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6daa66-0ffa-4b0a-897d-19c8413c6a24 admin admin] PATH_INFO: `/v3/users/9582b0d91fe04d13bd01487cead85b92` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:33.118270 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6daa66-0ffa-4b0a-897d-19c8413c6a24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9582b0d91fe04d13bd01487cead85b92)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:33.120228 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6daa66-0ffa-4b0a-897d-19c8413c6a24 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:33.125269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a25e6ba6-65a1-410c-8bd7-ba1b6d0f2420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9838ca43128744c294716329c36af578'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:33.125961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a25e6ba6-65a1-410c-8bd7-ba1b6d0f2420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9838ca43128744c294716329c36af578'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:33.138584 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a25e6ba6-65a1-410c-8bd7-ba1b6d0f2420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9838ca43128744c294716329c36af578'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:33.190668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a25e6ba6-65a1-410c-8bd7-ba1b6d0f2420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9838ca43128744c294716329c36af578'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:33.191377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a25e6ba6-65a1-410c-8bd7-ba1b6d0f2420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9838ca43128744c294716329c36af578'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:33.204633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 951/1927] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:32 2022] DELETE /identity/v3/users/9838ca43128744c294716329c36af578 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:33.205158 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:33.209031 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92310ca7-2852-499d-8e9b-e3bc39e51557 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:33.209315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92310ca7-2852-499d-8e9b-e3bc39e51557 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:33.209589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92310ca7-2852-499d-8e9b-e3bc39e51557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:33.227811 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-92310ca7-2852-499d-8e9b-e3bc39e51557 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:33.229055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-92310ca7-2852-499d-8e9b-e3bc39e51557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:33.290049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 952/1928] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:33.298988 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92310ca7-2852-499d-8e9b-e3bc39e51557 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:33.299784 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ee6daa66-0ffa-4b0a-897d-19c8413c6a24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9582b0d91fe04d13bd01487cead85b92'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:33.300480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ee6daa66-0ffa-4b0a-897d-19c8413c6a24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9582b0d91fe04d13bd01487cead85b92'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:33.301034 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-92310ca7-2852-499d-8e9b-e3bc39e51557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:33.317738 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ee6daa66-0ffa-4b0a-897d-19c8413c6a24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9582b0d91fe04d13bd01487cead85b92'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:33.365633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92310ca7-2852-499d-8e9b-e3bc39e51557 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:33.369257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49382815-817d-425d-aabb-0033a3b5f1c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:33.369863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49382815-817d-425d-aabb-0033a3b5f1c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:33.370138 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49382815-817d-425d-aabb-0033a3b5f1c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:33.370419 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49382815-817d-425d-aabb-0033a3b5f1c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:33.372265 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-49382815-817d-425d-aabb-0033a3b5f1c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:33.384734 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49382815-817d-425d-aabb-0033a3b5f1c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:33.388388 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49382815-817d-425d-aabb-0033a3b5f1c7 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:33.400907 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ee6daa66-0ffa-4b0a-897d-19c8413c6a24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9582b0d91fe04d13bd01487cead85b92'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:33.401607 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ee6daa66-0ffa-4b0a-897d-19c8413c6a24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9582b0d91fe04d13bd01487cead85b92'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:33.404381 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 953/1929] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:33.418958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 977/1930] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:33 2022] DELETE /identity/v3/users/9582b0d91fe04d13bd01487cead85b92 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:37:33.424645 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc734df6-1a62-4d8e-a7b4-57ada01bb48a None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:33.425082 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc734df6-1a62-4d8e-a7b4-57ada01bb48a None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:33.425582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc734df6-1a62-4d8e-a7b4-57ada01bb48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:33.451432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-cc734df6-1a62-4d8e-a7b4-57ada01bb48a None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:33.453911 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-cc734df6-1a62-4d8e-a7b4-57ada01bb48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:33.535106 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 954/1931] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:33.546459 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6daa66-0ffa-4b0a-897d-19c8413c6a24 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:33.548395 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ee6daa66-0ffa-4b0a-897d-19c8413c6a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:33.627320 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6daa66-0ffa-4b0a-897d-19c8413c6a24 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:33.631024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845ec9a-5142-47d4-8f0b-dbdb60856ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:33.631643 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845ec9a-5142-47d4-8f0b-dbdb60856ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:33.631924 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845ec9a-5142-47d4-8f0b-dbdb60856ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:33.632199 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845ec9a-5142-47d4-8f0b-dbdb60856ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:33.644409 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845ec9a-5142-47d4-8f0b-dbdb60856ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:33.645843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845ec9a-5142-47d4-8f0b-dbdb60856ae4 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:33.655586 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 978/1932] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:33.888929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:33.959254 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc734df6-1a62-4d8e-a7b4-57ada01bb48a None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:33.961649 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-cc734df6-1a62-4d8e-a7b4-57ada01bb48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:33.977718 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc734df6-1a62-4d8e-a7b4-57ada01bb48a None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:33.986539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101cc0a-9b99-47a4-a656-63c592b8cbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:33.987472 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101cc0a-9b99-47a4-a656-63c592b8cbe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:33.987705 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101cc0a-9b99-47a4-a656-63c592b8cbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:33.988042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101cc0a-9b99-47a4-a656-63c592b8cbe5 admin admin] PATH_INFO: `/v3/projects/1149c604578742289b9a33c58ccdc5b2` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:33.989508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101cc0a-9b99-47a4-a656-63c592b8cbe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1149c604578742289b9a33c58ccdc5b2)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:33.997682 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101cc0a-9b99-47a4-a656-63c592b8cbe5 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:34.123320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4101cc0a-9b99-47a4-a656-63c592b8cbe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1149c604578742289b9a33c58ccdc5b2', 'request_id': 'req-4101cc0a-9b99-47a4-a656-63c592b8cbe5'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:34.132614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4101cc0a-9b99-47a4-a656-63c592b8cbe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1149c604578742289b9a33c58ccdc5b2', 'request_id': 'req-4101cc0a-9b99-47a4-a656-63c592b8cbe5'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:34.188809 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845ec9a-5142-47d4-8f0b-dbdb60856ae4 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:34.190640 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c845ec9a-5142-47d4-8f0b-dbdb60856ae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:34.208398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4101cc0a-9b99-47a4-a656-63c592b8cbe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1149c604578742289b9a33c58ccdc5b2', 'request_id': 'req-4101cc0a-9b99-47a4-a656-63c592b8cbe5'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:34.214057 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845ec9a-5142-47d4-8f0b-dbdb60856ae4 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:34.222007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4101cc0a-9b99-47a4-a656-63c592b8cbe5 admin admin] The token cache is being invalidate because project 1149c604578742289b9a33c58ccdc5b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:34.222399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4101cc0a-9b99-47a4-a656-63c592b8cbe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:34.223093 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4101cc0a-9b99-47a4-a656-63c592b8cbe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:34.224854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 955/1933] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:33 2022] DELETE /identity/v3/projects/1149c604578742289b9a33c58ccdc5b2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:34.228580 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101cc0a-9b99-47a4-a656-63c592b8cbe5 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:34.230299 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4101cc0a-9b99-47a4-a656-63c592b8cbe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:34.296992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32cfb0-38db-4845-9fc4-c57320115635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:34.298016 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32cfb0-38db-4845-9fc4-c57320115635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:34.298502 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32cfb0-38db-4845-9fc4-c57320115635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:34.299006 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32cfb0-38db-4845-9fc4-c57320115635 admin admin] PATH_INFO: `/v3/projects/af1522cb05b84f70a755461a2aeb228a` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:34.300852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32cfb0-38db-4845-9fc4-c57320115635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af1522cb05b84f70a755461a2aeb228a)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:34.303892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32cfb0-38db-4845-9fc4-c57320115635 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:34.309207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101cc0a-9b99-47a4-a656-63c592b8cbe5 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:34.316951 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc1efe-ca71-400e-b61b-eec4481d9679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:34.318713 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc1efe-ca71-400e-b61b-eec4481d9679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:34.318713 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc1efe-ca71-400e-b61b-eec4481d9679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:34.318713 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc1efe-ca71-400e-b61b-eec4481d9679 admin admin] PATH_INFO: `/v3/users/2e6e67fed58c4e57bad0e5d6193acf4e` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:34.319598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc1efe-ca71-400e-b61b-eec4481d9679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e6e67fed58c4e57bad0e5d6193acf4e)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:34.324791 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc1efe-ca71-400e-b61b-eec4481d9679 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:34.425469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-db32cfb0-38db-4845-9fc4-c57320115635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af1522cb05b84f70a755461a2aeb228a', 'request_id': 'req-db32cfb0-38db-4845-9fc4-c57320115635'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:34.431930 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-db32cfb0-38db-4845-9fc4-c57320115635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af1522cb05b84f70a755461a2aeb228a', 'request_id': 'req-db32cfb0-38db-4845-9fc4-c57320115635'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:34.504480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-db32cfb0-38db-4845-9fc4-c57320115635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af1522cb05b84f70a755461a2aeb228a', 'request_id': 'req-db32cfb0-38db-4845-9fc4-c57320115635'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:34.531581 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-db32cfb0-38db-4845-9fc4-c57320115635 admin admin] The token cache is being invalidate because project af1522cb05b84f70a755461a2aeb228a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:34.531882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-db32cfb0-38db-4845-9fc4-c57320115635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:34.532657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-db32cfb0-38db-4845-9fc4-c57320115635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:34.534627 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 979/1934] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:34 2022] DELETE /identity/v3/projects/af1522cb05b84f70a755461a2aeb228a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:34.541846 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32cfb0-38db-4845-9fc4-c57320115635 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:34.545295 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-db32cfb0-38db-4845-9fc4-c57320115635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:34.572874 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-95fc1efe-ca71-400e-b61b-eec4481d9679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e6e67fed58c4e57bad0e5d6193acf4e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:34.573580 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-95fc1efe-ca71-400e-b61b-eec4481d9679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e6e67fed58c4e57bad0e5d6193acf4e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:34.617073 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-95fc1efe-ca71-400e-b61b-eec4481d9679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e6e67fed58c4e57bad0e5d6193acf4e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:34.631873 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:34.654593 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32cfb0-38db-4845-9fc4-c57320115635 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:34.660641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde2445-91f2-4e82-a79e-fdfbb3a3281d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:34.661664 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde2445-91f2-4e82-a79e-fdfbb3a3281d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:34.662061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde2445-91f2-4e82-a79e-fdfbb3a3281d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:34.662442 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde2445-91f2-4e82-a79e-fdfbb3a3281d admin admin] PATH_INFO: `/v3/users/a4f567709e9e45919942a4bfc3082b0d` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:34.664016 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde2445-91f2-4e82-a79e-fdfbb3a3281d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4f567709e9e45919942a4bfc3082b0d)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:34.666129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde2445-91f2-4e82-a79e-fdfbb3a3281d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:34.688524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-95fc1efe-ca71-400e-b61b-eec4481d9679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e6e67fed58c4e57bad0e5d6193acf4e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:34.689517 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-95fc1efe-ca71-400e-b61b-eec4481d9679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e6e67fed58c4e57bad0e5d6193acf4e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:34.713350 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 956/1935] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:34 2022] DELETE /identity/v3/users/2e6e67fed58c4e57bad0e5d6193acf4e => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:37:34.940242 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-adde2445-91f2-4e82-a79e-fdfbb3a3281d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4f567709e9e45919942a4bfc3082b0d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:34.941472 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-adde2445-91f2-4e82-a79e-fdfbb3a3281d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4f567709e9e45919942a4bfc3082b0d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:34.962723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-adde2445-91f2-4e82-a79e-fdfbb3a3281d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4f567709e9e45919942a4bfc3082b0d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:35.059244 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-adde2445-91f2-4e82-a79e-fdfbb3a3281d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4f567709e9e45919942a4bfc3082b0d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:35.060389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-adde2445-91f2-4e82-a79e-fdfbb3a3281d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4f567709e9e45919942a4bfc3082b0d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:35.080781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 980/1936] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:34 2022] DELETE /identity/v3/users/a4f567709e9e45919942a4bfc3082b0d => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:35.353946 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc1efe-ca71-400e-b61b-eec4481d9679 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:35.355465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-95fc1efe-ca71-400e-b61b-eec4481d9679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:35.434291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:35.525171 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc1efe-ca71-400e-b61b-eec4481d9679 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:35.623890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab9519-bc3e-4ab9-9255-f0bd5acda2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:35.625152 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab9519-bc3e-4ab9-9255-f0bd5acda2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:35.625727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab9519-bc3e-4ab9-9255-f0bd5acda2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:35.626002 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab9519-bc3e-4ab9-9255-f0bd5acda2e5 admin admin] PATH_INFO: `/v3/projects/1db638b987524d8781a147c16de24ec2` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:35.627378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab9519-bc3e-4ab9-9255-f0bd5acda2e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db638b987524d8781a147c16de24ec2)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:35.629647 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab9519-bc3e-4ab9-9255-f0bd5acda2e5 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:35.748242 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde2445-91f2-4e82-a79e-fdfbb3a3281d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:35.750511 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-adde2445-91f2-4e82-a79e-fdfbb3a3281d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:35.765288 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde2445-91f2-4e82-a79e-fdfbb3a3281d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:35.776475 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-54ab9519-bc3e-4ab9-9255-f0bd5acda2e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db638b987524d8781a147c16de24ec2', 'request_id': 'req-54ab9519-bc3e-4ab9-9255-f0bd5acda2e5'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:35.800811 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-54ab9519-bc3e-4ab9-9255-f0bd5acda2e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db638b987524d8781a147c16de24ec2', 'request_id': 'req-54ab9519-bc3e-4ab9-9255-f0bd5acda2e5'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:35.849396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b6559-e751-40df-b5c1-d0efdf8460c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:35.849922 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b6559-e751-40df-b5c1-d0efdf8460c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:35.850191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b6559-e751-40df-b5c1-d0efdf8460c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:35.850468 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b6559-e751-40df-b5c1-d0efdf8460c8 admin admin] PATH_INFO: `/v3/projects/003b342ef671441f9762769a85f49568` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:35.851617 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b6559-e751-40df-b5c1-d0efdf8460c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=003b342ef671441f9762769a85f49568)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:35.853584 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b6559-e751-40df-b5c1-d0efdf8460c8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:35.893979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-54ab9519-bc3e-4ab9-9255-f0bd5acda2e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db638b987524d8781a147c16de24ec2', 'request_id': 'req-54ab9519-bc3e-4ab9-9255-f0bd5acda2e5'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:35.906771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-54ab9519-bc3e-4ab9-9255-f0bd5acda2e5 admin admin] The token cache is being invalidate because project 1db638b987524d8781a147c16de24ec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:35.907068 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-54ab9519-bc3e-4ab9-9255-f0bd5acda2e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:35.907794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-54ab9519-bc3e-4ab9-9255-f0bd5acda2e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:35.909609 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 957/1937] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:35 2022] DELETE /identity/v3/projects/1db638b987524d8781a147c16de24ec2 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:35.916291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae4750-032e-4d85-89c0-51d4c3430aea None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:35.916738 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae4750-032e-4d85-89c0-51d4c3430aea None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:35.917081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae4750-032e-4d85-89c0-51d4c3430aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:35.941667 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-54ae4750-032e-4d85-89c0-51d4c3430aea None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:35.942899 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-54ae4750-032e-4d85-89c0-51d4c3430aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:35.951385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 958/1938] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:35.959317 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd14f1-064a-495e-a17b-eaa3b0b7aca0 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:35.959605 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd14f1-064a-495e-a17b-eaa3b0b7aca0 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:35.959882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd14f1-064a-495e-a17b-eaa3b0b7aca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:35.999498 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-63cd14f1-064a-495e-a17b-eaa3b0b7aca0 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:35.999498 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-63cd14f1-064a-495e-a17b-eaa3b0b7aca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:36.006924 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 959/1939] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:36.010974 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd14f1-064a-495e-a17b-eaa3b0b7aca0 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:36.029178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd14f1-064a-495e-a17b-eaa3b0b7aca0 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:36.042593 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ee6b6559-e751-40df-b5c1-d0efdf8460c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '003b342ef671441f9762769a85f49568', 'request_id': 'req-ee6b6559-e751-40df-b5c1-d0efdf8460c8'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:36.052893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ee6b6559-e751-40df-b5c1-d0efdf8460c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '003b342ef671441f9762769a85f49568', 'request_id': 'req-ee6b6559-e751-40df-b5c1-d0efdf8460c8'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:36.108063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9b33a-b00b-4e9a-9ad7-a21f38a6594f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:36.109433 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9b33a-b00b-4e9a-9ad7-a21f38a6594f admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:36.109818 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9b33a-b00b-4e9a-9ad7-a21f38a6594f admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:36.110197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9b33a-b00b-4e9a-9ad7-a21f38a6594f admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:36.110952 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9b33a-b00b-4e9a-9ad7-a21f38a6594f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:37:36.111339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9b33a-b00b-4e9a-9ad7-a21f38a6594f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:36.113112 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9b33a-b00b-4e9a-9ad7-a21f38a6594f admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:36.129590 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 960/1940] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:37:36.130608 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9b33a-b00b-4e9a-9ad7-a21f38a6594f admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:36.134270 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ee6b6559-e751-40df-b5c1-d0efdf8460c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '003b342ef671441f9762769a85f49568', 'request_id': 'req-ee6b6559-e751-40df-b5c1-d0efdf8460c8'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:36.143458 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9b33a-b00b-4e9a-9ad7-a21f38a6594f admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:36.149770 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ea7a3-5625-4494-8ec1-73ddf6dbd0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:36.150641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ea7a3-5625-4494-8ec1-73ddf6dbd0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:36.150776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ee6b6559-e751-40df-b5c1-d0efdf8460c8 admin admin] The token cache is being invalidate because project 003b342ef671441f9762769a85f49568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:36.150975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ee6b6559-e751-40df-b5c1-d0efdf8460c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:36.151200 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ea7a3-5625-4494-8ec1-73ddf6dbd0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:36.151573 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ea7a3-5625-4494-8ec1-73ddf6dbd0c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:36.151686 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ee6b6559-e751-40df-b5c1-d0efdf8460c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:36.152545 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ea7a3-5625-4494-8ec1-73ddf6dbd0c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:36.154903 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ea7a3-5625-4494-8ec1-73ddf6dbd0c9 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:36.157790 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 981/1941] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:35 2022] DELETE /identity/v3/projects/003b342ef671441f9762769a85f49568 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:37:36.159534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e09ea0-9111-434d-a8b7-7c2def6f70c4 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:36.159820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e09ea0-9111-434d-a8b7-7c2def6f70c4 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:36.160103 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e09ea0-9111-434d-a8b7-7c2def6f70c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:36.189512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-30e09ea0-9111-434d-a8b7-7c2def6f70c4 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:36.193833 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-30e09ea0-9111-434d-a8b7-7c2def6f70c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:36.215235 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 982/1942] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:36.217104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86622a5-e74d-41a2-852f-e93355c85ec2 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:36.217503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86622a5-e74d-41a2-852f-e93355c85ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:36.217889 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86622a5-e74d-41a2-852f-e93355c85ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:36.246776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-f86622a5-e74d-41a2-852f-e93355c85ec2 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:36.248134 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f86622a5-e74d-41a2-852f-e93355c85ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:36.260205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 983/1943] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:36.260422 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 961/1944] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:36 2022] POST /identity/v3/projects => generated 401 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:36.262145 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86622a5-e74d-41a2-852f-e93355c85ec2 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:36.262356 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ea7a3-5625-4494-8ec1-73ddf6dbd0c9 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:36.266154 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-af5ea7a3-5625-4494-8ec1-73ddf6dbd0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:36.272876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86622a5-e74d-41a2-852f-e93355c85ec2 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:36.393847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4230b-ee20-447c-8fac-d7475ab29782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:36.395393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4230b-ee20-447c-8fac-d7475ab29782 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:36.395687 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4230b-ee20-447c-8fac-d7475ab29782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:36.397243 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4230b-ee20-447c-8fac-d7475ab29782 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:36.397951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4230b-ee20-447c-8fac-d7475ab29782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:37:36.398271 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4230b-ee20-447c-8fac-d7475ab29782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:36.402395 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4230b-ee20-447c-8fac-d7475ab29782 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:36.416669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ea7a3-5625-4494-8ec1-73ddf6dbd0c9 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:36.422722 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add221ff-4b35-4660-890f-2043596630af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:36.423544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add221ff-4b35-4660-890f-2043596630af admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:36.425872 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add221ff-4b35-4660-890f-2043596630af admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:36.426360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add221ff-4b35-4660-890f-2043596630af admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:36.427205 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add221ff-4b35-4660-890f-2043596630af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:36.436832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:36.439565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add221ff-4b35-4660-890f-2043596630af admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:36.450080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 984/1945] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:37:36.451147 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4230b-ee20-447c-8fac-d7475ab29782 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:36.471429 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4230b-ee20-447c-8fac-d7475ab29782 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:36.481087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42900fba-2321-418e-9ec9-e832561c98b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:36.482379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42900fba-2321-418e-9ec9-e832561c98b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:36.482379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42900fba-2321-418e-9ec9-e832561c98b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:36.482379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42900fba-2321-418e-9ec9-e832561c98b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:36.482966 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42900fba-2321-418e-9ec9-e832561c98b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:36.489292 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42900fba-2321-418e-9ec9-e832561c98b1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:36.564242 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 962/1946] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:36 2022] POST /identity/v3/users => generated 301 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:36.564242 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add221ff-4b35-4660-890f-2043596630af admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:36.574874 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add221ff-4b35-4660-890f-2043596630af admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:36.588830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718314f6-8a45-46f6-89a7-00af9f1a87c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:36.589444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718314f6-8a45-46f6-89a7-00af9f1a87c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:36.589723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718314f6-8a45-46f6-89a7-00af9f1a87c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:36.591594 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718314f6-8a45-46f6-89a7-00af9f1a87c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:36.591594 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718314f6-8a45-46f6-89a7-00af9f1a87c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:36.592376 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718314f6-8a45-46f6-89a7-00af9f1a87c0 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:36.633077 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 985/1947] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:36 2022] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:36.633613 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 963/1948] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:36.637369 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42900fba-2321-418e-9ec9-e832561c98b1 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:36.641197 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718314f6-8a45-46f6-89a7-00af9f1a87c0 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:36.672484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718314f6-8a45-46f6-89a7-00af9f1a87c0 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:36.771393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42900fba-2321-418e-9ec9-e832561c98b1 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:36.775724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7702d-0ab0-4e89-8a26-014714eb58be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:36.776522 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7702d-0ab0-4e89-8a26-014714eb58be admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:36.777086 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7702d-0ab0-4e89-8a26-014714eb58be admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:36.777373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7702d-0ab0-4e89-8a26-014714eb58be admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:36.778608 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7702d-0ab0-4e89-8a26-014714eb58be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:36.779452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2f35e-22f9-4986-9be7-832d6f56ca71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:36.781572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7702d-0ab0-4e89-8a26-014714eb58be admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:36.793651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2f35e-22f9-4986-9be7-832d6f56ca71 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:36.794000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2f35e-22f9-4986-9be7-832d6f56ca71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:36.794286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2f35e-22f9-4986-9be7-832d6f56ca71 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:36.795019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2f35e-22f9-4986-9be7-832d6f56ca71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:36.799003 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2f35e-22f9-4986-9be7-832d6f56ca71 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:36.809219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 964/1949] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:36.810455 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7702d-0ab0-4e89-8a26-014714eb58be admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:36.823422 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7702d-0ab0-4e89-8a26-014714eb58be admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:36.829881 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad221019-7135-4c46-a1d9-bf971b397523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:36.830757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad221019-7135-4c46-a1d9-bf971b397523 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:36.831096 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad221019-7135-4c46-a1d9-bf971b397523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:36.831514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad221019-7135-4c46-a1d9-bf971b397523 admin admin] PATH_INFO: `/v3/projects/bad3345d1827413c95e696df65b9c9d1/users/4b50b87183af477d93b6bed36f3537f4/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:36.863232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad221019-7135-4c46-a1d9-bf971b397523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bad3345d1827413c95e696df65b9c9d1, user_id=4b50b87183af477d93b6bed36f3537f4, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:36.866484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad221019-7135-4c46-a1d9-bf971b397523 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:36.965001 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 965/1950] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:36 2022] PUT /identity/v3/projects/bad3345d1827413c95e696df65b9c9d1/users/4b50b87183af477d93b6bed36f3537f4/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:37:36.967073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 986/1951] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:36 2022] POST /identity/v3/users => generated 283 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:36.975115 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad221019-7135-4c46-a1d9-bf971b397523 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:36.975363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1926c7-33ea-4a92-8eb2-ca68d8398ec7 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:36.975659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1926c7-33ea-4a92-8eb2-ca68d8398ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:36.975937 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1926c7-33ea-4a92-8eb2-ca68d8398ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:37.010595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3d1926c7-33ea-4a92-8eb2-ca68d8398ec7 None None] MFA Rules not processed for user `4b50b87183af477d93b6bed36f3537f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:37.011878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3d1926c7-33ea-4a92-8eb2-ca68d8398ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:37.087415 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad221019-7135-4c46-a1d9-bf971b397523 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:37.092789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52af8ab-1a79-443b-aa24-be79b330fbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:37.093577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52af8ab-1a79-443b-aa24-be79b330fbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:37.093935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52af8ab-1a79-443b-aa24-be79b330fbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:37.094257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52af8ab-1a79-443b-aa24-be79b330fbf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:37.094903 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52af8ab-1a79-443b-aa24-be79b330fbf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:37.096808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52af8ab-1a79-443b-aa24-be79b330fbf6 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:37.108520 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 966/1952] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:37.123227 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52af8ab-1a79-443b-aa24-be79b330fbf6 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:37.132251 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 987/1953] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:36 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:37.133348 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1926c7-33ea-4a92-8eb2-ca68d8398ec7 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:37.140704 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52af8ab-1a79-443b-aa24-be79b330fbf6 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:37.145887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1926c7-33ea-4a92-8eb2-ca68d8398ec7 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:37.147366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4b687-a5f3-4f26-beea-16e3cfb96d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:37.147366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4b687-a5f3-4f26-beea-16e3cfb96d68 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:37.147366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4b687-a5f3-4f26-beea-16e3cfb96d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:37.147680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4b687-a5f3-4f26-beea-16e3cfb96d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:37.148663 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4b687-a5f3-4f26-beea-16e3cfb96d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:37.152750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4b687-a5f3-4f26-beea-16e3cfb96d68 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:37.157621 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f23f9-80e9-4f0f-b5a7-30fee8b7fa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:37.158396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f23f9-80e9-4f0f-b5a7-30fee8b7fa75 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:37.158754 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f23f9-80e9-4f0f-b5a7-30fee8b7fa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:37.159098 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f23f9-80e9-4f0f-b5a7-30fee8b7fa75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:37.159752 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f23f9-80e9-4f0f-b5a7-30fee8b7fa75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:37.161912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f23f9-80e9-4f0f-b5a7-30fee8b7fa75 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:37.166188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 967/1954] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:37.170743 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4b687-a5f3-4f26-beea-16e3cfb96d68 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:37.183482 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4b687-a5f3-4f26-beea-16e3cfb96d68 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:37.189435 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7944dc5-8154-4ee2-87c2-66395fd603b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:37.190322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7944dc5-8154-4ee2-87c2-66395fd603b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:37.190608 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7944dc5-8154-4ee2-87c2-66395fd603b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:37.190886 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7944dc5-8154-4ee2-87c2-66395fd603b7 admin admin] PATH_INFO: `/v3/projects/cb18be5bee4240e085384917fec81274/users/0a7cc1e865244f8b9523814a84978215/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:37.206963 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7944dc5-8154-4ee2-87c2-66395fd603b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb18be5bee4240e085384917fec81274, user_id=0a7cc1e865244f8b9523814a84978215, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:37.209819 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7944dc5-8154-4ee2-87c2-66395fd603b7 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:37.313340 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 988/1955] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:37 2022] POST /identity/v3/projects => generated 399 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:37:37.317899 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f23f9-80e9-4f0f-b5a7-30fee8b7fa75 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:37.331464 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 968/1956] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:37 2022] PUT /identity/v3/projects/cb18be5bee4240e085384917fec81274/users/0a7cc1e865244f8b9523814a84978215/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:37.332457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aa1ca-8a5d-4a1e-8548-90e947641303 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:37.332885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aa1ca-8a5d-4a1e-8548-90e947641303 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:37.333134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aa1ca-8a5d-4a1e-8548-90e947641303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:37.403837 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-992aa1ca-8a5d-4a1e-8548-90e947641303 None None] MFA Rules not processed for user `0a7cc1e865244f8b9523814a84978215`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:37.410428 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-992aa1ca-8a5d-4a1e-8548-90e947641303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:37.425606 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:37.444052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:37.460475 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f23f9-80e9-4f0f-b5a7-30fee8b7fa75 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:37.510406 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 969/1957] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:37.515279 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992aa1ca-8a5d-4a1e-8548-90e947641303 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:37.551569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6f8b7-e0c3-4ec3-864e-89c4d5b78a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:37.552466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6f8b7-e0c3-4ec3-864e-89c4d5b78a31 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:37.552809 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6f8b7-e0c3-4ec3-864e-89c4d5b78a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:37.553586 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6f8b7-e0c3-4ec3-864e-89c4d5b78a31 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:37.554290 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6f8b7-e0c3-4ec3-864e-89c4d5b78a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:37.557058 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6f8b7-e0c3-4ec3-864e-89c4d5b78a31 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:37.632884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992aa1ca-8a5d-4a1e-8548-90e947641303 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:37.638425 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a7f7b-afb3-457d-ba97-c3466a8b2c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:37.639207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a7f7b-afb3-457d-ba97-c3466a8b2c66 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:37.639491 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a7f7b-afb3-457d-ba97-c3466a8b2c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:37.639758 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a7f7b-afb3-457d-ba97-c3466a8b2c66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:37.641322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a7f7b-afb3-457d-ba97-c3466a8b2c66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:37.644241 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a7f7b-afb3-457d-ba97-c3466a8b2c66 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:37.752882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 989/1958] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:37 2022] POST /identity/v3/users => generated 306 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:37.752882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6f8b7-e0c3-4ec3-864e-89c4d5b78a31 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:37.770524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6f8b7-e0c3-4ec3-864e-89c4d5b78a31 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:37.786298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ef257-a05a-4617-a6d4-2468b837eb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:37.787004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ef257-a05a-4617-a6d4-2468b837eb87 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:37.788661 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ef257-a05a-4617-a6d4-2468b837eb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:37.789017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ef257-a05a-4617-a6d4-2468b837eb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:37.790354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ef257-a05a-4617-a6d4-2468b837eb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:37.794728 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ef257-a05a-4617-a6d4-2468b837eb87 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:37.801225 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 970/1959] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:37 2022] POST /identity/v3/projects => generated 367 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:37:37.810956 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a7f7b-afb3-457d-ba97-c3466a8b2c66 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:37.836961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 990/1960] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:37:37.842388 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ef257-a05a-4617-a6d4-2468b837eb87 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:37.857633 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ef257-a05a-4617-a6d4-2468b837eb87 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:37.917263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a7f7b-afb3-457d-ba97-c3466a8b2c66 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:37.923371 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d1ff1-579a-4238-999a-22eebeb2073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:37.924080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d1ff1-579a-4238-999a-22eebeb2073e admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:37.924699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d1ff1-579a-4238-999a-22eebeb2073e admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:37.925043 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d1ff1-579a-4238-999a-22eebeb2073e admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:37.925914 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d1ff1-579a-4238-999a-22eebeb2073e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:37.928152 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d1ff1-579a-4238-999a-22eebeb2073e admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:37.960456 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c4bfa-6f84-479a-84b9-6dd8b22dfde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:37.960456 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4bfa-6f84-479a-84b9-6dd8b22dfde2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:37.960456 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4bfa-6f84-479a-84b9-6dd8b22dfde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:37.960456 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4bfa-6f84-479a-84b9-6dd8b22dfde2 admin admin] PATH_INFO: `/v3/projects/3f1b11982b8c4b82950bb39413c42bb0/users/1e00020069d246d2b8ac9cb11f0d3e39/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:37.967586 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c4bfa-6f84-479a-84b9-6dd8b22dfde2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1b11982b8c4b82950bb39413c42bb0, user_id=1e00020069d246d2b8ac9cb11f0d3e39, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:37.970832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c4bfa-6f84-479a-84b9-6dd8b22dfde2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:38.061925 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 971/1961] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:37 2022] POST /identity/v3/users => generated 290 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:37:38.065513 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d1ff1-579a-4238-999a-22eebeb2073e admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:38.074987 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d1ff1-579a-4238-999a-22eebeb2073e admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:38.080138 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba6e83-c90c-468b-bebf-8ce2f6ff869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:38.080765 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba6e83-c90c-468b-bebf-8ce2f6ff869a admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:38.081044 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba6e83-c90c-468b-bebf-8ce2f6ff869a admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:38.081316 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba6e83-c90c-468b-bebf-8ce2f6ff869a admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:38.081946 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba6e83-c90c-468b-bebf-8ce2f6ff869a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:38.083565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba6e83-c90c-468b-bebf-8ce2f6ff869a admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:38.093851 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 972/1962] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:37:38.097626 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba6e83-c90c-468b-bebf-8ce2f6ff869a admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:38.105854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 991/1963] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:37 2022] PUT /identity/v3/projects/3f1b11982b8c4b82950bb39413c42bb0/users/1e00020069d246d2b8ac9cb11f0d3e39/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:38.116703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba6e83-c90c-468b-bebf-8ce2f6ff869a admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:38.119176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c4bfa-6f84-479a-84b9-6dd8b22dfde2 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:38.167668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ef3fd-7ae1-4ad1-96ac-100e542819a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:38.168358 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ef3fd-7ae1-4ad1-96ac-100e542819a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:38.168659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ef3fd-7ae1-4ad1-96ac-100e542819a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:38.168915 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ef3fd-7ae1-4ad1-96ac-100e542819a0 admin admin] PATH_INFO: `/v3/projects/fe0289e461fe4e3c8050914137c1fe01/users/1484f9610670477bbf70d3f54be98033/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:38.185657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c4bfa-6f84-479a-84b9-6dd8b22dfde2 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:38.185657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49bd03-0515-4586-bb6b-7c8ff0ab5a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:38.185856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ef3fd-7ae1-4ad1-96ac-100e542819a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe0289e461fe4e3c8050914137c1fe01, user_id=1484f9610670477bbf70d3f54be98033, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:38.185943 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49bd03-0515-4586-bb6b-7c8ff0ab5a69 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:38.186205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49bd03-0515-4586-bb6b-7c8ff0ab5a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:38.186483 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49bd03-0515-4586-bb6b-7c8ff0ab5a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:38.187627 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49bd03-0515-4586-bb6b-7c8ff0ab5a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:38.189403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49bd03-0515-4586-bb6b-7c8ff0ab5a69 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:38.189673 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ef3fd-7ae1-4ad1-96ac-100e542819a0 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:38.201964 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 992/1964] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:37:38.206555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49bd03-0515-4586-bb6b-7c8ff0ab5a69 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:38.216943 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49bd03-0515-4586-bb6b-7c8ff0ab5a69 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:38.221901 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8224b-520b-4321-aad0-34dd1339fb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:38.222546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8224b-520b-4321-aad0-34dd1339fb29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:38.222828 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8224b-520b-4321-aad0-34dd1339fb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:38.223113 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8224b-520b-4321-aad0-34dd1339fb29 admin admin] PATH_INFO: `/v3/projects/3f1b11982b8c4b82950bb39413c42bb0/users/1e00020069d246d2b8ac9cb11f0d3e39/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:38.225159 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8224b-520b-4321-aad0-34dd1339fb29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1b11982b8c4b82950bb39413c42bb0, user_id=1e00020069d246d2b8ac9cb11f0d3e39, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:38.227761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8224b-520b-4321-aad0-34dd1339fb29 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:38.238044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 993/1965] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:38 2022] PUT /identity/v3/projects/3f1b11982b8c4b82950bb39413c42bb0/users/1e00020069d246d2b8ac9cb11f0d3e39/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:37:38.249270 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301aedc-0643-4613-9cf6-8084a7c279bb None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:38.250185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301aedc-0643-4613-9cf6-8084a7c279bb None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:38.250461 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301aedc-0643-4613-9cf6-8084a7c279bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:38.275140 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 973/1966] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:38 2022] PUT /identity/v3/projects/fe0289e461fe4e3c8050914137c1fe01/users/1484f9610670477bbf70d3f54be98033/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:37:38.276077 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ef3fd-7ae1-4ad1-96ac-100e542819a0 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:38.281472 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-2301aedc-0643-4613-9cf6-8084a7c279bb None None] MFA Rules not processed for user `1e00020069d246d2b8ac9cb11f0d3e39`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:38.283103 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2301aedc-0643-4613-9cf6-8084a7c279bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:38.343202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ef3fd-7ae1-4ad1-96ac-100e542819a0 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:38.348098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f10f2-64a7-4796-9bfa-e05e16921fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:38.348750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f10f2-64a7-4796-9bfa-e05e16921fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:38.349082 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f10f2-64a7-4796-9bfa-e05e16921fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:38.349437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f10f2-64a7-4796-9bfa-e05e16921fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:38.350122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f10f2-64a7-4796-9bfa-e05e16921fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:38.351787 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f10f2-64a7-4796-9bfa-e05e16921fc4 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:38.370288 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 974/1967] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:37:38.372969 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 994/1968] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:38 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:38.377660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301aedc-0643-4613-9cf6-8084a7c279bb None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:38.390810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301aedc-0643-4613-9cf6-8084a7c279bb None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:38.395140 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b67ed-7ca5-4526-9142-71de67ca0014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:38.395847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b67ed-7ca5-4526-9142-71de67ca0014 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:38.396149 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b67ed-7ca5-4526-9142-71de67ca0014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:38.396472 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b67ed-7ca5-4526-9142-71de67ca0014 admin admin] PATH_INFO: `/v3/projects/fe0289e461fe4e3c8050914137c1fe01/users/1484f9610670477bbf70d3f54be98033/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:38.398418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b67ed-7ca5-4526-9142-71de67ca0014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe0289e461fe4e3c8050914137c1fe01, user_id=1484f9610670477bbf70d3f54be98033, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:38.401203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b67ed-7ca5-4526-9142-71de67ca0014 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:38.414857 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 995/1969] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:38 2022] PUT /identity/v3/projects/fe0289e461fe4e3c8050914137c1fe01/users/1484f9610670477bbf70d3f54be98033/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:38.416091 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f10f2-64a7-4796-9bfa-e05e16921fc4 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:38.418201 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-1c5f10f2-64a7-4796-9bfa-e05e16921fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:38.429677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca03b22-8011-4bd1-95a9-934c4414cece None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:38.430222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca03b22-8011-4bd1-95a9-934c4414cece None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:38.430662 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca03b22-8011-4bd1-95a9-934c4414cece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:38.463384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6ca03b22-8011-4bd1-95a9-934c4414cece None None] MFA Rules not processed for user `1484f9610670477bbf70d3f54be98033`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:38.464667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6ca03b22-8011-4bd1-95a9-934c4414cece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:38.480033 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f10f2-64a7-4796-9bfa-e05e16921fc4 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:38.534989 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90646d97-e527-4e3d-92c4-b654ffaa363a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:38.535698 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90646d97-e527-4e3d-92c4-b654ffaa363a service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:38.535978 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90646d97-e527-4e3d-92c4-b654ffaa363a service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:38.539186 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90646d97-e527-4e3d-92c4-b654ffaa363a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:38.552142 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 996/1970] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:38.553308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca03b22-8011-4bd1-95a9-934c4414cece None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:38.558962 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6ca03b22-8011-4bd1-95a9-934c4414cece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:38.572499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca03b22-8011-4bd1-95a9-934c4414cece None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:38.576276 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8012a2-3217-476e-8126-43f81286a5b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:38.576930 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8012a2-3217-476e-8126-43f81286a5b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:38.577201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8012a2-3217-476e-8126-43f81286a5b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:38.577999 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8012a2-3217-476e-8126-43f81286a5b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:38.579858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-bc8012a2-3217-476e-8126-43f81286a5b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:38.605113 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90646d97-e527-4e3d-92c4-b654ffaa363a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:38.606785 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90646d97-e527-4e3d-92c4-b654ffaa363a service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:38.620184 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 975/1971] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:38 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:38.653299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8012a2-3217-476e-8126-43f81286a5b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:38.653299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8012a2-3217-476e-8126-43f81286a5b4 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:38.663273 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 997/1972] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:38.743301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90646d97-e527-4e3d-92c4-b654ffaa363a service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:38.751610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90646d97-e527-4e3d-92c4-b654ffaa363a service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:38.755273 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943800bf-a331-4e2d-b6ca-282913ea1d61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:38.755875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943800bf-a331-4e2d-b6ca-282913ea1d61 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:38.756153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943800bf-a331-4e2d-b6ca-282913ea1d61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:38.756457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943800bf-a331-4e2d-b6ca-282913ea1d61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:38.766399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943800bf-a331-4e2d-b6ca-282913ea1d61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:38.768020 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943800bf-a331-4e2d-b6ca-282913ea1d61 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:38.778368 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 976/1973] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:39.310627 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8012a2-3217-476e-8126-43f81286a5b4 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:39.320118 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8012a2-3217-476e-8126-43f81286a5b4 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:39.323784 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c4b90-1df0-4d90-a775-29ad4751b048 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:39.324415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c4b90-1df0-4d90-a775-29ad4751b048 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:39.324695 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c4b90-1df0-4d90-a775-29ad4751b048 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:39.324970 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c4b90-1df0-4d90-a775-29ad4751b048 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:39.383171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c4b90-1df0-4d90-a775-29ad4751b048 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:39.384843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c4b90-1df0-4d90-a775-29ad4751b048 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:39.405636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 998/1974] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:39 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:39.861161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:39.917445 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:40.972290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943800bf-a331-4e2d-b6ca-282913ea1d61 service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:40.978924 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-943800bf-a331-4e2d-b6ca-282913ea1d61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:41.070607 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943800bf-a331-4e2d-b6ca-282913ea1d61 service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:41.075333 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bf93c-71ca-480d-b7a0-05f197aa28d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:41.076203 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bf93c-71ca-480d-b7a0-05f197aa28d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:41.076554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bf93c-71ca-480d-b7a0-05f197aa28d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:41.076832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bf93c-71ca-480d-b7a0-05f197aa28d4 admin admin] PATH_INFO: `/v3/users/41685313f3784defbe4f6308e73cd673` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:41.077983 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bf93c-71ca-480d-b7a0-05f197aa28d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41685313f3784defbe4f6308e73cd673)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:41.080067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bf93c-71ca-480d-b7a0-05f197aa28d4 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:41.311762 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-479bf93c-71ca-480d-b7a0-05f197aa28d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41685313f3784defbe4f6308e73cd673'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:41.327871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-479bf93c-71ca-480d-b7a0-05f197aa28d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41685313f3784defbe4f6308e73cd673'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:41.355320 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-479bf93c-71ca-480d-b7a0-05f197aa28d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41685313f3784defbe4f6308e73cd673'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:41.442927 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:41.447378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-479bf93c-71ca-480d-b7a0-05f197aa28d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41685313f3784defbe4f6308e73cd673'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:41.448560 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-479bf93c-71ca-480d-b7a0-05f197aa28d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41685313f3784defbe4f6308e73cd673'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:41.473707 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 977/1975] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:40 2022] DELETE /identity/v3/users/41685313f3784defbe4f6308e73cd673 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:41.479733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133af0fe-3561-40c7-ab2a-8cc43336c34c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:41.479733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133af0fe-3561-40c7-ab2a-8cc43336c34c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:41.479733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133af0fe-3561-40c7-ab2a-8cc43336c34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:41.503293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:41.517195 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-133af0fe-3561-40c7-ab2a-8cc43336c34c None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:41.520370 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-133af0fe-3561-40c7-ab2a-8cc43336c34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:41.642949 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 999/1976] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:41.655048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bf93c-71ca-480d-b7a0-05f197aa28d4 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:41.657152 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-479bf93c-71ca-480d-b7a0-05f197aa28d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:41.749968 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bf93c-71ca-480d-b7a0-05f197aa28d4 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:41.757933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771236bc-a84b-478f-82a4-a33f5f0d38fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:41.758729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771236bc-a84b-478f-82a4-a33f5f0d38fd service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:41.768138 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771236bc-a84b-478f-82a4-a33f5f0d38fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:41.768138 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771236bc-a84b-478f-82a4-a33f5f0d38fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:41.771112 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771236bc-a84b-478f-82a4-a33f5f0d38fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:41.772645 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771236bc-a84b-478f-82a4-a33f5f0d38fd service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:41.790104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 978/1977] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:42.487483 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133af0fe-3561-40c7-ab2a-8cc43336c34c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:42.490150 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-133af0fe-3561-40c7-ab2a-8cc43336c34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:42.513238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133af0fe-3561-40c7-ab2a-8cc43336c34c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:42.519809 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1179bd4-c992-44b0-af6f-51782c7250ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:42.520680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1179bd4-c992-44b0-af6f-51782c7250ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:42.521353 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1179bd4-c992-44b0-af6f-51782c7250ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:42.521779 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1179bd4-c992-44b0-af6f-51782c7250ae admin admin] PATH_INFO: `/v3/projects/229b90e114e44c889f9c37fe1eaa9b68` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:42.524319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1179bd4-c992-44b0-af6f-51782c7250ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=229b90e114e44c889f9c37fe1eaa9b68)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:42.527656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1179bd4-c992-44b0-af6f-51782c7250ae admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:42.683828 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b1179bd4-c992-44b0-af6f-51782c7250ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '229b90e114e44c889f9c37fe1eaa9b68', 'request_id': 'req-b1179bd4-c992-44b0-af6f-51782c7250ae'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:42.709757 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b1179bd4-c992-44b0-af6f-51782c7250ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '229b90e114e44c889f9c37fe1eaa9b68', 'request_id': 'req-b1179bd4-c992-44b0-af6f-51782c7250ae'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:42.820100 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b1179bd4-c992-44b0-af6f-51782c7250ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '229b90e114e44c889f9c37fe1eaa9b68', 'request_id': 'req-b1179bd4-c992-44b0-af6f-51782c7250ae'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:42.837537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b1179bd4-c992-44b0-af6f-51782c7250ae admin admin] The token cache is being invalidate because project 229b90e114e44c889f9c37fe1eaa9b68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:42.837939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b1179bd4-c992-44b0-af6f-51782c7250ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:42.838669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b1179bd4-c992-44b0-af6f-51782c7250ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:42.841432 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1000/1978] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:42 2022] DELETE /identity/v3/projects/229b90e114e44c889f9c37fe1eaa9b68 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:42.845654 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771236bc-a84b-478f-82a4-a33f5f0d38fd service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:42.860812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771236bc-a84b-478f-82a4-a33f5f0d38fd service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:42.931833 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f68720-1d97-47e8-aec4-56012e8a4d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:42.933048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f68720-1d97-47e8-aec4-56012e8a4d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:42.933697 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f68720-1d97-47e8-aec4-56012e8a4d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:42.934194 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f68720-1d97-47e8-aec4-56012e8a4d0c admin admin] PATH_INFO: `/v3/users/ce0d642a02994a08ade655d4f3f7ac78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:42.935816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f68720-1d97-47e8-aec4-56012e8a4d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce0d642a02994a08ade655d4f3f7ac78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:42.938423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f68720-1d97-47e8-aec4-56012e8a4d0c admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:42.958892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1179bd4-c992-44b0-af6f-51782c7250ae admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:42.960977 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b1179bd4-c992-44b0-af6f-51782c7250ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:42.977182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1179bd4-c992-44b0-af6f-51782c7250ae admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:42.987613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3475e8-4e4d-4614-be37-eef0adcc0ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:42.988272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3475e8-4e4d-4614-be37-eef0adcc0ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:42.988628 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3475e8-4e4d-4614-be37-eef0adcc0ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:42.988931 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3475e8-4e4d-4614-be37-eef0adcc0ee1 admin admin] PATH_INFO: `/v3/users/0a7cc1e865244f8b9523814a84978215` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:42.990223 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3475e8-4e4d-4614-be37-eef0adcc0ee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a7cc1e865244f8b9523814a84978215)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:42.992180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3475e8-4e4d-4614-be37-eef0adcc0ee1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:43.167434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d2f68720-1d97-47e8-aec4-56012e8a4d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce0d642a02994a08ade655d4f3f7ac78'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:43.168088 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d2f68720-1d97-47e8-aec4-56012e8a4d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce0d642a02994a08ade655d4f3f7ac78'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:43.180486 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d2f68720-1d97-47e8-aec4-56012e8a4d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce0d642a02994a08ade655d4f3f7ac78'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:43.234570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2f3475e8-4e4d-4614-be37-eef0adcc0ee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a7cc1e865244f8b9523814a84978215'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:43.235304 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2f3475e8-4e4d-4614-be37-eef0adcc0ee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a7cc1e865244f8b9523814a84978215'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:43.243916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d2f68720-1d97-47e8-aec4-56012e8a4d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce0d642a02994a08ade655d4f3f7ac78'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:43.248279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2f3475e8-4e4d-4614-be37-eef0adcc0ee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a7cc1e865244f8b9523814a84978215'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:43.254243 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d2f68720-1d97-47e8-aec4-56012e8a4d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce0d642a02994a08ade655d4f3f7ac78'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:43.272937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 979/1979] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:42 2022] DELETE /identity/v3/users/ce0d642a02994a08ade655d4f3f7ac78 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:43.339945 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2f3475e8-4e4d-4614-be37-eef0adcc0ee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a7cc1e865244f8b9523814a84978215'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:43.340680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2f3475e8-4e4d-4614-be37-eef0adcc0ee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a7cc1e865244f8b9523814a84978215'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:43.365936 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1001/1980] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:42 2022] DELETE /identity/v3/users/0a7cc1e865244f8b9523814a84978215 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:37:43.372941 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:43.382961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b92ed-a80e-4ee3-8622-16489a1a27bb None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:43.383440 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b92ed-a80e-4ee3-8622-16489a1a27bb None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:43.383731 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b92ed-a80e-4ee3-8622-16489a1a27bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:43.418354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-d92b92ed-a80e-4ee3-8622-16489a1a27bb None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:43.421784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-d92b92ed-a80e-4ee3-8622-16489a1a27bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:43.499407 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:43.503499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 980/1981] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:43.521731 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3475e8-4e4d-4614-be37-eef0adcc0ee1 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:43.523117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2f3475e8-4e4d-4614-be37-eef0adcc0ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:43.585696 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3475e8-4e4d-4614-be37-eef0adcc0ee1 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:43.589691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02a682-94a4-40cd-b00d-ee3cf9a24a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:43.590641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02a682-94a4-40cd-b00d-ee3cf9a24a63 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:43.591171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02a682-94a4-40cd-b00d-ee3cf9a24a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:43.591646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02a682-94a4-40cd-b00d-ee3cf9a24a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:43.602976 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02a682-94a4-40cd-b00d-ee3cf9a24a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:43.604825 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02a682-94a4-40cd-b00d-ee3cf9a24a63 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:43.616804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1002/1982] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:37:43.746980 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b92ed-a80e-4ee3-8622-16489a1a27bb None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:43.748464 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-d92b92ed-a80e-4ee3-8622-16489a1a27bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:43.769324 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b92ed-a80e-4ee3-8622-16489a1a27bb None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:43.777349 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe79d0-2d5c-40b8-94ca-d637d110cc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:43.777349 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe79d0-2d5c-40b8-94ca-d637d110cc61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:43.777349 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe79d0-2d5c-40b8-94ca-d637d110cc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:43.777349 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe79d0-2d5c-40b8-94ca-d637d110cc61 admin admin] PATH_INFO: `/v3/projects/81e72fd2323846f996703cf53c136aeb` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:43.777892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe79d0-2d5c-40b8-94ca-d637d110cc61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81e72fd2323846f996703cf53c136aeb)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:43.778856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe79d0-2d5c-40b8-94ca-d637d110cc61 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:43.929241 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-acbe79d0-2d5c-40b8-94ca-d637d110cc61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81e72fd2323846f996703cf53c136aeb', 'request_id': 'req-acbe79d0-2d5c-40b8-94ca-d637d110cc61'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:43.936293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-acbe79d0-2d5c-40b8-94ca-d637d110cc61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81e72fd2323846f996703cf53c136aeb', 'request_id': 'req-acbe79d0-2d5c-40b8-94ca-d637d110cc61'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:44.043217 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-acbe79d0-2d5c-40b8-94ca-d637d110cc61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81e72fd2323846f996703cf53c136aeb', 'request_id': 'req-acbe79d0-2d5c-40b8-94ca-d637d110cc61'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:44.054988 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-acbe79d0-2d5c-40b8-94ca-d637d110cc61 admin admin] The token cache is being invalidate because project 81e72fd2323846f996703cf53c136aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:44.055381 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-acbe79d0-2d5c-40b8-94ca-d637d110cc61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:44.056093 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-acbe79d0-2d5c-40b8-94ca-d637d110cc61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:44.057715 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 981/1983] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:43 2022] DELETE /identity/v3/projects/81e72fd2323846f996703cf53c136aeb => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:44.062685 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576d794-ffbf-4075-b07c-21574fed3557 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:44.063549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576d794-ffbf-4075-b07c-21574fed3557 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:44.063833 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576d794-ffbf-4075-b07c-21574fed3557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:44.083265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-2576d794-ffbf-4075-b07c-21574fed3557 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:44.088484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2576d794-ffbf-4075-b07c-21574fed3557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:44.147499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1003/1984] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:44.155535 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f6510-4d21-41a9-8499-d29376746928 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:44.155821 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f6510-4d21-41a9-8499-d29376746928 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:44.156099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f6510-4d21-41a9-8499-d29376746928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:44.177906 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576d794-ffbf-4075-b07c-21574fed3557 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:44.179806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2576d794-ffbf-4075-b07c-21574fed3557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:44.180996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-454f6510-4d21-41a9-8499-d29376746928 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:44.183789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-454f6510-4d21-41a9-8499-d29376746928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:44.196767 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 982/1985] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:44.206656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f6510-4d21-41a9-8499-d29376746928 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:44.216441 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576d794-ffbf-4075-b07c-21574fed3557 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:44.217315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f6510-4d21-41a9-8499-d29376746928 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:44.222751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2626a0-aec9-466f-a0db-2e0326961757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:44.223416 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2626a0-aec9-466f-a0db-2e0326961757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:44.223742 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2626a0-aec9-466f-a0db-2e0326961757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:44.223896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee83ea0-fbf3-4127-b2bf-d0b3a3a4cbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:44.224050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2626a0-aec9-466f-a0db-2e0326961757 admin admin] PATH_INFO: `/v3/projects/cb18be5bee4240e085384917fec81274` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:44.224638 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee83ea0-fbf3-4127-b2bf-d0b3a3a4cbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:44.225099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee83ea0-fbf3-4127-b2bf-d0b3a3a4cbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:44.225218 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2626a0-aec9-466f-a0db-2e0326961757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb18be5bee4240e085384917fec81274)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:44.225624 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee83ea0-fbf3-4127-b2bf-d0b3a3a4cbb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:44.226337 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee83ea0-fbf3-4127-b2bf-d0b3a3a4cbb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:37:44.227237 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2626a0-aec9-466f-a0db-2e0326961757 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:44.227366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee83ea0-fbf3-4127-b2bf-d0b3a3a4cbb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:44.228827 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee83ea0-fbf3-4127-b2bf-d0b3a3a4cbb1 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:44.246219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 983/1986] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:37:44.250008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee83ea0-fbf3-4127-b2bf-d0b3a3a4cbb1 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:44.263835 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee83ea0-fbf3-4127-b2bf-d0b3a3a4cbb1 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:44.269061 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3427aa-33d3-4aa4-8971-e3766602946f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:44.269834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3427aa-33d3-4aa4-8971-e3766602946f admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:44.270102 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3427aa-33d3-4aa4-8971-e3766602946f admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:44.270373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3427aa-33d3-4aa4-8971-e3766602946f admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:44.271145 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3427aa-33d3-4aa4-8971-e3766602946f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:44.274448 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3427aa-33d3-4aa4-8971-e3766602946f admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:44.323205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0b2626a0-aec9-466f-a0db-2e0326961757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb18be5bee4240e085384917fec81274', 'request_id': 'req-0b2626a0-aec9-466f-a0db-2e0326961757'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:44.329620 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0b2626a0-aec9-466f-a0db-2e0326961757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb18be5bee4240e085384917fec81274', 'request_id': 'req-0b2626a0-aec9-466f-a0db-2e0326961757'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:44.362926 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 984/1987] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:44 2022] POST /identity/v3/projects => generated 361 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:44.364539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3427aa-33d3-4aa4-8971-e3766602946f admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:44.397824 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0b2626a0-aec9-466f-a0db-2e0326961757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb18be5bee4240e085384917fec81274', 'request_id': 'req-0b2626a0-aec9-466f-a0db-2e0326961757'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:44.410391 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0b2626a0-aec9-466f-a0db-2e0326961757 admin admin] The token cache is being invalidate because project cb18be5bee4240e085384917fec81274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:44.410788 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0b2626a0-aec9-466f-a0db-2e0326961757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:44.411697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0b2626a0-aec9-466f-a0db-2e0326961757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:44.413479 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1004/1988] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:44 2022] DELETE /identity/v3/projects/cb18be5bee4240e085384917fec81274 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:44.425634 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2626a0-aec9-466f-a0db-2e0326961757 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:44.425634 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0b2626a0-aec9-466f-a0db-2e0326961757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:44.432396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3427aa-33d3-4aa4-8971-e3766602946f admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:44.437548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a71d4-5ebe-4c9c-a8a3-2b5e5a9d57dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:44.438193 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a71d4-5ebe-4c9c-a8a3-2b5e5a9d57dc admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:44.438470 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a71d4-5ebe-4c9c-a8a3-2b5e5a9d57dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:44.438740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a71d4-5ebe-4c9c-a8a3-2b5e5a9d57dc admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:44.439383 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a71d4-5ebe-4c9c-a8a3-2b5e5a9d57dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:44.441591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a71d4-5ebe-4c9c-a8a3-2b5e5a9d57dc admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:44.460809 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:44.491634 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2626a0-aec9-466f-a0db-2e0326961757 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:44.496313 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadb9f8-64ba-41c6-b1c5-8b13ad842523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:44.496991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadb9f8-64ba-41c6-b1c5-8b13ad842523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:44.497241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadb9f8-64ba-41c6-b1c5-8b13ad842523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:44.497508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadb9f8-64ba-41c6-b1c5-8b13ad842523 admin admin] PATH_INFO: `/v3/users/1484f9610670477bbf70d3f54be98033` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:44.498626 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadb9f8-64ba-41c6-b1c5-8b13ad842523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1484f9610670477bbf70d3f54be98033)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:44.500859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadb9f8-64ba-41c6-b1c5-8b13ad842523 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:44.544039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 985/1989] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:44 2022] POST /identity/v3/users => generated 281 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:37:44.546225 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a71d4-5ebe-4c9c-a8a3-2b5e5a9d57dc admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:44.550060 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-062a71d4-5ebe-4c9c-a8a3-2b5e5a9d57dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:44.563745 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a71d4-5ebe-4c9c-a8a3-2b5e5a9d57dc admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:44.568628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17bba6-313d-4a8a-a1f8-6dfc5a0378a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:44.569233 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17bba6-313d-4a8a-a1f8-6dfc5a0378a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:44.569564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17bba6-313d-4a8a-a1f8-6dfc5a0378a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:44.569851 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17bba6-313d-4a8a-a1f8-6dfc5a0378a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:44.570501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17bba6-313d-4a8a-a1f8-6dfc5a0378a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:44.572095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17bba6-313d-4a8a-a1f8-6dfc5a0378a5 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:44.583545 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 986/1990] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:44.587732 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17bba6-313d-4a8a-a1f8-6dfc5a0378a5 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:44.599348 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17bba6-313d-4a8a-a1f8-6dfc5a0378a5 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:44.604572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3767c-69fc-4e62-af01-424064b671a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:44.609970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3767c-69fc-4e62-af01-424064b671a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:44.609970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3767c-69fc-4e62-af01-424064b671a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:44.609970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3767c-69fc-4e62-af01-424064b671a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:44.609970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3767c-69fc-4e62-af01-424064b671a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:44.609970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3767c-69fc-4e62-af01-424064b671a9 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:44.624400 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 987/1991] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:37:44.625345 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3767c-69fc-4e62-af01-424064b671a9 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:44.635663 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3767c-69fc-4e62-af01-424064b671a9 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:44.640588 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759cd93-a1fc-49f3-b3df-ca7748c2c823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:44.641903 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759cd93-a1fc-49f3-b3df-ca7748c2c823 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:44.642181 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759cd93-a1fc-49f3-b3df-ca7748c2c823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:44.642455 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759cd93-a1fc-49f3-b3df-ca7748c2c823 admin admin] PATH_INFO: `/v3/projects/2641e2cf978640389e2862cceff2d877/users/c748c658b52e4cb79b0e712c0c358625/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:44.658493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759cd93-a1fc-49f3-b3df-ca7748c2c823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2641e2cf978640389e2862cceff2d877, user_id=c748c658b52e4cb79b0e712c0c358625, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:44.661236 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759cd93-a1fc-49f3-b3df-ca7748c2c823 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:44.689963 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8fadb9f8-64ba-41c6-b1c5-8b13ad842523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1484f9610670477bbf70d3f54be98033'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:44.690826 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8fadb9f8-64ba-41c6-b1c5-8b13ad842523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1484f9610670477bbf70d3f54be98033'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:44.703221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8fadb9f8-64ba-41c6-b1c5-8b13ad842523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1484f9610670477bbf70d3f54be98033'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:44.736018 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 988/1992] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:44 2022] PUT /identity/v3/projects/2641e2cf978640389e2862cceff2d877/users/c748c658b52e4cb79b0e712c0c358625/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:44.750385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c916082-93d4-4382-a356-5896b5a7768d None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:44.750672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c916082-93d4-4382-a356-5896b5a7768d None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:44.750942 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c916082-93d4-4382-a356-5896b5a7768d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:44.785862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8fadb9f8-64ba-41c6-b1c5-8b13ad842523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1484f9610670477bbf70d3f54be98033'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:44.786809 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8fadb9f8-64ba-41c6-b1c5-8b13ad842523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1484f9610670477bbf70d3f54be98033'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:44.796720 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-6c916082-93d4-4382-a356-5896b5a7768d None None] MFA Rules not processed for user `c748c658b52e4cb79b0e712c0c358625`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:44.799122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6c916082-93d4-4382-a356-5896b5a7768d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:44.807528 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:44.824616 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1005/1993] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:44 2022] DELETE /identity/v3/users/1484f9610670477bbf70d3f54be98033 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:37:44.909571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 989/1994] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:45.146538 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadb9f8-64ba-41c6-b1c5-8b13ad842523 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:45.147217 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8fadb9f8-64ba-41c6-b1c5-8b13ad842523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:45.148682 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c916082-93d4-4382-a356-5896b5a7768d None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:45.150214 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6c916082-93d4-4382-a356-5896b5a7768d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:45.240128 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadb9f8-64ba-41c6-b1c5-8b13ad842523 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:45.242126 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c916082-93d4-4382-a356-5896b5a7768d None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:45.244934 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aabd3b-d17b-468d-9f7f-3e0d39dc3b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:45.245611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aabd3b-d17b-468d-9f7f-3e0d39dc3b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:45.245947 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aabd3b-d17b-468d-9f7f-3e0d39dc3b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:45.246225 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aabd3b-d17b-468d-9f7f-3e0d39dc3b58 admin admin] PATH_INFO: `/v3/users/e77fe72284974702a6a63d9c374b562d` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:45.247740 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aabd3b-d17b-468d-9f7f-3e0d39dc3b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e77fe72284974702a6a63d9c374b562d)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:45.249676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aabd3b-d17b-468d-9f7f-3e0d39dc3b58 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:45.292224 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c6cd4-6c13-49e4-b42b-c27565a90f5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:45.292904 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c6cd4-6c13-49e4-b42b-c27565a90f5c service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:45.293200 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c6cd4-6c13-49e4-b42b-c27565a90f5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:45.293521 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c6cd4-6c13-49e4-b42b-c27565a90f5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:45.358304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c6cd4-6c13-49e4-b42b-c27565a90f5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:45.360397 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c6cd4-6c13-49e4-b42b-c27565a90f5c service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:45.377094 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 990/1995] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:37:45.381269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c6cd4-6c13-49e4-b42b-c27565a90f5c service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:45.382926 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-fd8c6cd4-6c13-49e4-b42b-c27565a90f5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:45.397613 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c6cd4-6c13-49e4-b42b-c27565a90f5c service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:45.402467 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c5134-a9cc-45c9-8e6d-c50dcb73ce1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:45.402906 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c5134-a9cc-45c9-8e6d-c50dcb73ce1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:45.403189 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c5134-a9cc-45c9-8e6d-c50dcb73ce1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:45.403468 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c5134-a9cc-45c9-8e6d-c50dcb73ce1e admin admin] PATH_INFO: `/v3/users/4b50b87183af477d93b6bed36f3537f4` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:45.404667 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c5134-a9cc-45c9-8e6d-c50dcb73ce1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b50b87183af477d93b6bed36f3537f4)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:45.406666 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c5134-a9cc-45c9-8e6d-c50dcb73ce1e admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:45.591383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c7aabd3b-d17b-468d-9f7f-3e0d39dc3b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e77fe72284974702a6a63d9c374b562d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:45.591383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c7aabd3b-d17b-468d-9f7f-3e0d39dc3b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e77fe72284974702a6a63d9c374b562d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:45.604115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c7aabd3b-d17b-468d-9f7f-3e0d39dc3b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e77fe72284974702a6a63d9c374b562d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:46.192248 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:46.193437 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c7aabd3b-d17b-468d-9f7f-3e0d39dc3b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e77fe72284974702a6a63d9c374b562d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:46.194912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c7aabd3b-d17b-468d-9f7f-3e0d39dc3b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e77fe72284974702a6a63d9c374b562d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:46.211976 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ea3c5134-a9cc-45c9-8e6d-c50dcb73ce1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b50b87183af477d93b6bed36f3537f4'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:46.212521 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1006/1996] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:45 2022] DELETE /identity/v3/users/e77fe72284974702a6a63d9c374b562d => generated 0 bytes in 1065 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:46.212521 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aabd3b-d17b-468d-9f7f-3e0d39dc3b58 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:46.212521 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c7aabd3b-d17b-468d-9f7f-3e0d39dc3b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:46.213342 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ea3c5134-a9cc-45c9-8e6d-c50dcb73ce1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b50b87183af477d93b6bed36f3537f4'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:46.231412 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ea3c5134-a9cc-45c9-8e6d-c50dcb73ce1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b50b87183af477d93b6bed36f3537f4'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:46.298616 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aabd3b-d17b-468d-9f7f-3e0d39dc3b58 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:46.305336 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256464c-2e94-4a07-9ef5-b333e9294dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:46.306026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256464c-2e94-4a07-9ef5-b333e9294dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:46.306430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256464c-2e94-4a07-9ef5-b333e9294dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:46.306866 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256464c-2e94-4a07-9ef5-b333e9294dc4 admin admin] PATH_INFO: `/v3/projects/fe0289e461fe4e3c8050914137c1fe01` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:46.308325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256464c-2e94-4a07-9ef5-b333e9294dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe0289e461fe4e3c8050914137c1fe01)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:46.310679 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256464c-2e94-4a07-9ef5-b333e9294dc4 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:46.323174 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ea3c5134-a9cc-45c9-8e6d-c50dcb73ce1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b50b87183af477d93b6bed36f3537f4'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:46.323914 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ea3c5134-a9cc-45c9-8e6d-c50dcb73ce1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b50b87183af477d93b6bed36f3537f4'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:46.339001 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 991/1997] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:45 2022] DELETE /identity/v3/users/4b50b87183af477d93b6bed36f3537f4 => generated 0 bytes in 960 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:46.340009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c5134-a9cc-45c9-8e6d-c50dcb73ce1e admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:46.341660 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ea3c5134-a9cc-45c9-8e6d-c50dcb73ce1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:46.420511 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c5134-a9cc-45c9-8e6d-c50dcb73ce1e admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:46.435224 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7256464c-2e94-4a07-9ef5-b333e9294dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe0289e461fe4e3c8050914137c1fe01', 'request_id': 'req-7256464c-2e94-4a07-9ef5-b333e9294dc4'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:46.445228 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7256464c-2e94-4a07-9ef5-b333e9294dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe0289e461fe4e3c8050914137c1fe01', 'request_id': 'req-7256464c-2e94-4a07-9ef5-b333e9294dc4'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:46.485371 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc33486-c623-4c02-b807-ebb509d79b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:46.486022 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc33486-c623-4c02-b807-ebb509d79b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:46.486298 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc33486-c623-4c02-b807-ebb509d79b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:46.486572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc33486-c623-4c02-b807-ebb509d79b96 admin admin] PATH_INFO: `/v3/users/c748c658b52e4cb79b0e712c0c358625` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:46.487723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc33486-c623-4c02-b807-ebb509d79b96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c748c658b52e4cb79b0e712c0c358625)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:46.489847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc33486-c623-4c02-b807-ebb509d79b96 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:46.510629 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7256464c-2e94-4a07-9ef5-b333e9294dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe0289e461fe4e3c8050914137c1fe01', 'request_id': 'req-7256464c-2e94-4a07-9ef5-b333e9294dc4'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:46.524904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7256464c-2e94-4a07-9ef5-b333e9294dc4 admin admin] The token cache is being invalidate because project fe0289e461fe4e3c8050914137c1fe01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:46.527502 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7256464c-2e94-4a07-9ef5-b333e9294dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:46.527502 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7256464c-2e94-4a07-9ef5-b333e9294dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:46.531433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1007/1998] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:46 2022] DELETE /identity/v3/projects/fe0289e461fe4e3c8050914137c1fe01 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:46.531433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ed652-c102-423d-9809-dbac4508873c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:46.531433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ed652-c102-423d-9809-dbac4508873c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:46.531433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ed652-c102-423d-9809-dbac4508873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:46.549880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d00ed652-c102-423d-9809-dbac4508873c None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:46.551111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d00ed652-c102-423d-9809-dbac4508873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:46.559626 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1008/1999] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:46.560845 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b1a61-ffe2-45de-bef8-c9db23c9c1b2 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:46.561130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b1a61-ffe2-45de-bef8-c9db23c9c1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:46.561406 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b1a61-ffe2-45de-bef8-c9db23c9c1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:46.583186 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c51b1a61-ffe2-45de-bef8-c9db23c9c1b2 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:46.584433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c51b1a61-ffe2-45de-bef8-c9db23c9c1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:46.594486 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1009/2000] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:46.600511 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952f6bc-1cbc-4788-8de2-01563e61adec None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:46.600933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952f6bc-1cbc-4788-8de2-01563e61adec None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:46.601335 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952f6bc-1cbc-4788-8de2-01563e61adec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:46.622749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c952f6bc-1cbc-4788-8de2-01563e61adec None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:46.623984 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c952f6bc-1cbc-4788-8de2-01563e61adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:46.643971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1010/2001] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:46.643971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952f6bc-1cbc-4788-8de2-01563e61adec None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:46.643971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c952f6bc-1cbc-4788-8de2-01563e61adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:46.703449 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952f6bc-1cbc-4788-8de2-01563e61adec None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:46.707989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f28c86-4929-4980-a418-1c82f3c71467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:46.709040 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f28c86-4929-4980-a418-1c82f3c71467 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:46.709331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f28c86-4929-4980-a418-1c82f3c71467 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:46.709610 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f28c86-4929-4980-a418-1c82f3c71467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:46.719747 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f28c86-4929-4980-a418-1c82f3c71467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:46.721278 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f28c86-4929-4980-a418-1c82f3c71467 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:46.723311 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-9dc33486-c623-4c02-b807-ebb509d79b96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c748c658b52e4cb79b0e712c0c358625'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:46.724160 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-9dc33486-c623-4c02-b807-ebb509d79b96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c748c658b52e4cb79b0e712c0c358625'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:46.734021 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1011/2002] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:46.734743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f28c86-4929-4980-a418-1c82f3c71467 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:46.736647 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f7f28c86-4929-4980-a418-1c82f3c71467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:46.737864 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-9dc33486-c623-4c02-b807-ebb509d79b96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c748c658b52e4cb79b0e712c0c358625'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:46.746981 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f28c86-4929-4980-a418-1c82f3c71467 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:46.751299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c3712-a052-4973-8cda-790d9b4c28fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:46.752004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c3712-a052-4973-8cda-790d9b4c28fa service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:46.752275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c3712-a052-4973-8cda-790d9b4c28fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:46.752578 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c3712-a052-4973-8cda-790d9b4c28fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:46.754770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-108c3712-a052-4973-8cda-790d9b4c28fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:46.771417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c3712-a052-4973-8cda-790d9b4c28fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:46.771417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c3712-a052-4973-8cda-790d9b4c28fa service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:46.780417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1012/2003] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:46.782158 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acbb22-8c7f-4647-88ea-0c5e1fafd622 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:46.782607 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acbb22-8c7f-4647-88ea-0c5e1fafd622 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:46.783033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acbb22-8c7f-4647-88ea-0c5e1fafd622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:46.806448 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a9acbb22-8c7f-4647-88ea-0c5e1fafd622 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:46.811006 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a9acbb22-8c7f-4647-88ea-0c5e1fafd622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:46.818641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1013/2004] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:46.823803 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acbb22-8c7f-4647-88ea-0c5e1fafd622 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:46.833566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-9dc33486-c623-4c02-b807-ebb509d79b96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c748c658b52e4cb79b0e712c0c358625'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:46.834339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-9dc33486-c623-4c02-b807-ebb509d79b96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c748c658b52e4cb79b0e712c0c358625'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:46.852025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 992/2005] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:46 2022] DELETE /identity/v3/users/c748c658b52e4cb79b0e712c0c358625 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:46.852944 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acbb22-8c7f-4647-88ea-0c5e1fafd622 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:46.857437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b968b-6d8c-4edc-994b-c9b44b7ac0ca None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:46.858844 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b968b-6d8c-4edc-994b-c9b44b7ac0ca None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:46.859492 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b968b-6d8c-4edc-994b-c9b44b7ac0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:46.884564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-126b968b-6d8c-4edc-994b-c9b44b7ac0ca None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:46.885882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-126b968b-6d8c-4edc-994b-c9b44b7ac0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:46.948837 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becf1b4-f049-4267-acfd-5c09be084760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:46.953688 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becf1b4-f049-4267-acfd-5c09be084760 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:46.953688 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becf1b4-f049-4267-acfd-5c09be084760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:46.953688 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becf1b4-f049-4267-acfd-5c09be084760 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:46.953688 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becf1b4-f049-4267-acfd-5c09be084760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:37:46.953688 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becf1b4-f049-4267-acfd-5c09be084760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:46.953688 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becf1b4-f049-4267-acfd-5c09be084760 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:46.962175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 993/2006] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:46.965370 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1014/2007] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:37:46.969587 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b968b-6d8c-4edc-994b-c9b44b7ac0ca None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:46.975509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becf1b4-f049-4267-acfd-5c09be084760 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:46.977840 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5becf1b4-f049-4267-acfd-5c09be084760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:46.983307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:46.983307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b968b-6d8c-4edc-994b-c9b44b7ac0ca None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:46.989838 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef2aae-ea1e-4ae9-aa2c-2e9437ed2c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:46.990357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef2aae-ea1e-4ae9-aa2c-2e9437ed2c7e admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:46.990638 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef2aae-ea1e-4ae9-aa2c-2e9437ed2c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:46.991356 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef2aae-ea1e-4ae9-aa2c-2e9437ed2c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:46.992299 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef2aae-ea1e-4ae9-aa2c-2e9437ed2c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:47.001627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef2aae-ea1e-4ae9-aa2c-2e9437ed2c7e admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:47.048351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becf1b4-f049-4267-acfd-5c09be084760 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:47.052094 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039abce7-005a-43a2-8fe5-bc2bc6a2f72e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:47.052763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039abce7-005a-43a2-8fe5-bc2bc6a2f72e service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:47.053051 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039abce7-005a-43a2-8fe5-bc2bc6a2f72e service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:47.053324 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039abce7-005a-43a2-8fe5-bc2bc6a2f72e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:47.065204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039abce7-005a-43a2-8fe5-bc2bc6a2f72e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:47.066727 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039abce7-005a-43a2-8fe5-bc2bc6a2f72e service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:47.078026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1015/2008] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:37:47.090552 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:47.097217 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 994/2009] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:46 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:47.101258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039abce7-005a-43a2-8fe5-bc2bc6a2f72e service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:47.113383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039abce7-005a-43a2-8fe5-bc2bc6a2f72e service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:47.189699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435254a8-309c-442c-af23-5c1e6173acb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:47.196766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435254a8-309c-442c-af23-5c1e6173acb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:47.196766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435254a8-309c-442c-af23-5c1e6173acb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:47.196766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435254a8-309c-442c-af23-5c1e6173acb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:47.196766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435254a8-309c-442c-af23-5c1e6173acb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:47.196766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435254a8-309c-442c-af23-5c1e6173acb9 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:47.302661 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1016/2010] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:47 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:37:47.307772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef2aae-ea1e-4ae9-aa2c-2e9437ed2c7e admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:47.318512 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef2aae-ea1e-4ae9-aa2c-2e9437ed2c7e admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:47.323267 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ae3c5-c5c5-4938-b8e2-3d1a0982aed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:47.324206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ae3c5-c5c5-4938-b8e2-3d1a0982aed4 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:47.324808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ae3c5-c5c5-4938-b8e2-3d1a0982aed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:47.325395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ae3c5-c5c5-4938-b8e2-3d1a0982aed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:47.326177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ae3c5-c5c5-4938-b8e2-3d1a0982aed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:47.340627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ae3c5-c5c5-4938-b8e2-3d1a0982aed4 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:47.356084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 995/2011] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:47.360686 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435254a8-309c-442c-af23-5c1e6173acb9 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:47.373182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435254a8-309c-442c-af23-5c1e6173acb9 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:47.386051 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27547d-654a-467e-bd57-f5854e188b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:47.386051 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27547d-654a-467e-bd57-f5854e188b63 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:47.386051 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27547d-654a-467e-bd57-f5854e188b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:47.386051 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27547d-654a-467e-bd57-f5854e188b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:47.386430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27547d-654a-467e-bd57-f5854e188b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:47.386430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27547d-654a-467e-bd57-f5854e188b63 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:47.400123 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1017/2012] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:37:47.401388 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ae3c5-c5c5-4938-b8e2-3d1a0982aed4 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:47.413308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ae3c5-c5c5-4938-b8e2-3d1a0982aed4 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:47.419220 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039530d-d97b-4381-bb04-d1ca344ae009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:47.420163 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039530d-d97b-4381-bb04-d1ca344ae009 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:47.420726 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039530d-d97b-4381-bb04-d1ca344ae009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:47.421101 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039530d-d97b-4381-bb04-d1ca344ae009 admin admin] PATH_INFO: `/v3/projects/f03a864e781c47f495bee44d603db312/users/f77fcd9e99724d33bed6faea8ef597d0/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:47.440054 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039530d-d97b-4381-bb04-d1ca344ae009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03a864e781c47f495bee44d603db312, user_id=f77fcd9e99724d33bed6faea8ef597d0, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:47.443287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039530d-d97b-4381-bb04-d1ca344ae009 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:47.501427 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 996/2013] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:47 2022] PUT /identity/v3/projects/f03a864e781c47f495bee44d603db312/users/f77fcd9e99724d33bed6faea8ef597d0/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:47.512047 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715cd42-336c-4349-a2eb-6c3f23e52457 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:47.512483 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715cd42-336c-4349-a2eb-6c3f23e52457 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:47.512768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715cd42-336c-4349-a2eb-6c3f23e52457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:47.543252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b715cd42-336c-4349-a2eb-6c3f23e52457 None None] MFA Rules not processed for user `f77fcd9e99724d33bed6faea8ef597d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:47.545283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b715cd42-336c-4349-a2eb-6c3f23e52457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:47.627039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1018/2014] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:47.628302 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039530d-d97b-4381-bb04-d1ca344ae009 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:47.630205 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3039530d-d97b-4381-bb04-d1ca344ae009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:47.635888 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715cd42-336c-4349-a2eb-6c3f23e52457 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:47.637655 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b715cd42-336c-4349-a2eb-6c3f23e52457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:47.724244 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715cd42-336c-4349-a2eb-6c3f23e52457 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:47.732781 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039530d-d97b-4381-bb04-d1ca344ae009 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:47.736380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272c253-cf07-4eaa-aa9e-423208fcb12b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:47.737058 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272c253-cf07-4eaa-aa9e-423208fcb12b service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:47.737896 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272c253-cf07-4eaa-aa9e-423208fcb12b service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:47.738185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272c253-cf07-4eaa-aa9e-423208fcb12b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:47.741378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903a1dd-88e7-4ee5-966f-950a9744f972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:47.742834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903a1dd-88e7-4ee5-966f-950a9744f972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:47.743285 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903a1dd-88e7-4ee5-966f-950a9744f972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:47.744537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903a1dd-88e7-4ee5-966f-950a9744f972 admin admin] PATH_INFO: `/v3/projects/bad3345d1827413c95e696df65b9c9d1` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:47.746234 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903a1dd-88e7-4ee5-966f-950a9744f972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bad3345d1827413c95e696df65b9c9d1)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:47.749967 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903a1dd-88e7-4ee5-966f-950a9744f972 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:47.758148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272c253-cf07-4eaa-aa9e-423208fcb12b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:47.759653 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272c253-cf07-4eaa-aa9e-423208fcb12b service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:47.771786 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1019/2015] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:47.773188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272c253-cf07-4eaa-aa9e-423208fcb12b service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:47.774970 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6272c253-cf07-4eaa-aa9e-423208fcb12b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:47.792113 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272c253-cf07-4eaa-aa9e-423208fcb12b service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:47.797643 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861159c-7953-4620-8434-ebddd5cbb82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:47.798321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861159c-7953-4620-8434-ebddd5cbb82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:47.798794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861159c-7953-4620-8434-ebddd5cbb82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:47.799069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861159c-7953-4620-8434-ebddd5cbb82c admin admin] PATH_INFO: `/v3/projects/429b9c8e356d477a9a8e8e1ad8ac16c0` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:47.800211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861159c-7953-4620-8434-ebddd5cbb82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=429b9c8e356d477a9a8e8e1ad8ac16c0)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:47.802347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861159c-7953-4620-8434-ebddd5cbb82c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:47.904487 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6903a1dd-88e7-4ee5-966f-950a9744f972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bad3345d1827413c95e696df65b9c9d1', 'request_id': 'req-6903a1dd-88e7-4ee5-966f-950a9744f972'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:47.913652 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6903a1dd-88e7-4ee5-966f-950a9744f972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bad3345d1827413c95e696df65b9c9d1', 'request_id': 'req-6903a1dd-88e7-4ee5-966f-950a9744f972'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:47.935294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:47.942504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6861159c-7953-4620-8434-ebddd5cbb82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '429b9c8e356d477a9a8e8e1ad8ac16c0', 'request_id': 'req-6861159c-7953-4620-8434-ebddd5cbb82c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:47.954486 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6861159c-7953-4620-8434-ebddd5cbb82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '429b9c8e356d477a9a8e8e1ad8ac16c0', 'request_id': 'req-6861159c-7953-4620-8434-ebddd5cbb82c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.014687 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6903a1dd-88e7-4ee5-966f-950a9744f972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bad3345d1827413c95e696df65b9c9d1', 'request_id': 'req-6903a1dd-88e7-4ee5-966f-950a9744f972'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.041295 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6903a1dd-88e7-4ee5-966f-950a9744f972 admin admin] The token cache is being invalidate because project bad3345d1827413c95e696df65b9c9d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:48.045353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6903a1dd-88e7-4ee5-966f-950a9744f972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.045353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6903a1dd-88e7-4ee5-966f-950a9744f972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.045353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 997/2016] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:47 2022] DELETE /identity/v3/projects/bad3345d1827413c95e696df65b9c9d1 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:37:48.045353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903a1dd-88e7-4ee5-966f-950a9744f972 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:48.046564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6903a1dd-88e7-4ee5-966f-950a9744f972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:48.065973 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6861159c-7953-4620-8434-ebddd5cbb82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '429b9c8e356d477a9a8e8e1ad8ac16c0', 'request_id': 'req-6861159c-7953-4620-8434-ebddd5cbb82c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.078178 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6861159c-7953-4620-8434-ebddd5cbb82c admin admin] The token cache is being invalidate because project 429b9c8e356d477a9a8e8e1ad8ac16c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:48.079134 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6861159c-7953-4620-8434-ebddd5cbb82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.079892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6861159c-7953-4620-8434-ebddd5cbb82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.081898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1020/2017] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:47 2022] DELETE /identity/v3/projects/429b9c8e356d477a9a8e8e1ad8ac16c0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:48.085819 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861159c-7953-4620-8434-ebddd5cbb82c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:48.087489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6861159c-7953-4620-8434-ebddd5cbb82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:48.122622 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903a1dd-88e7-4ee5-966f-950a9744f972 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:48.147308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:48.160219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861159c-7953-4620-8434-ebddd5cbb82c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:48.166701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212d6d8-1e75-44c8-8d1e-9b66a3168121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:48.168774 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212d6d8-1e75-44c8-8d1e-9b66a3168121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:48.173519 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212d6d8-1e75-44c8-8d1e-9b66a3168121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:48.173519 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212d6d8-1e75-44c8-8d1e-9b66a3168121 admin admin] PATH_INFO: `/v3/projects/2641e2cf978640389e2862cceff2d877` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:48.173519 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212d6d8-1e75-44c8-8d1e-9b66a3168121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2641e2cf978640389e2862cceff2d877)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:48.173519 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212d6d8-1e75-44c8-8d1e-9b66a3168121 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:48.186912 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12174435-766d-44b9-aed3-4ceda8cb85ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:48.187726 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12174435-766d-44b9-aed3-4ceda8cb85ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:48.188584 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12174435-766d-44b9-aed3-4ceda8cb85ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:48.188900 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12174435-766d-44b9-aed3-4ceda8cb85ec admin admin] PATH_INFO: `/v3/users/f77fcd9e99724d33bed6faea8ef597d0` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:48.190107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12174435-766d-44b9-aed3-4ceda8cb85ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f77fcd9e99724d33bed6faea8ef597d0)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:48.192116 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12174435-766d-44b9-aed3-4ceda8cb85ec admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:48.292913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d212d6d8-1e75-44c8-8d1e-9b66a3168121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2641e2cf978640389e2862cceff2d877', 'request_id': 'req-d212d6d8-1e75-44c8-8d1e-9b66a3168121'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.300080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d212d6d8-1e75-44c8-8d1e-9b66a3168121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2641e2cf978640389e2862cceff2d877', 'request_id': 'req-d212d6d8-1e75-44c8-8d1e-9b66a3168121'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.420077 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d212d6d8-1e75-44c8-8d1e-9b66a3168121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2641e2cf978640389e2862cceff2d877', 'request_id': 'req-d212d6d8-1e75-44c8-8d1e-9b66a3168121'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.432312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d212d6d8-1e75-44c8-8d1e-9b66a3168121 admin admin] The token cache is being invalidate because project 2641e2cf978640389e2862cceff2d877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:48.432752 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d212d6d8-1e75-44c8-8d1e-9b66a3168121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.433467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d212d6d8-1e75-44c8-8d1e-9b66a3168121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.435104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1021/2018] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:48 2022] DELETE /identity/v3/projects/2641e2cf978640389e2862cceff2d877 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:48.435981 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212d6d8-1e75-44c8-8d1e-9b66a3168121 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:48.437389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d212d6d8-1e75-44c8-8d1e-9b66a3168121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:48.437922 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-12174435-766d-44b9-aed3-4ceda8cb85ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f77fcd9e99724d33bed6faea8ef597d0'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.440646 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-12174435-766d-44b9-aed3-4ceda8cb85ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f77fcd9e99724d33bed6faea8ef597d0'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.459946 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-12174435-766d-44b9-aed3-4ceda8cb85ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f77fcd9e99724d33bed6faea8ef597d0'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.519776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212d6d8-1e75-44c8-8d1e-9b66a3168121 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:48.524482 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fbed2-bff9-4e0d-b574-84de4d4b313a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:48.525118 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fbed2-bff9-4e0d-b574-84de4d4b313a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:48.525391 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fbed2-bff9-4e0d-b574-84de4d4b313a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:48.525656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fbed2-bff9-4e0d-b574-84de4d4b313a admin admin] PATH_INFO: `/v3/users/1e00020069d246d2b8ac9cb11f0d3e39` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:48.526784 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fbed2-bff9-4e0d-b574-84de4d4b313a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e00020069d246d2b8ac9cb11f0d3e39)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:48.528850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fbed2-bff9-4e0d-b574-84de4d4b313a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:48.546146 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-12174435-766d-44b9-aed3-4ceda8cb85ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f77fcd9e99724d33bed6faea8ef597d0'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.546705 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-12174435-766d-44b9-aed3-4ceda8cb85ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f77fcd9e99724d33bed6faea8ef597d0'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.561541 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 998/2019] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:48 2022] DELETE /identity/v3/users/f77fcd9e99724d33bed6faea8ef597d0 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:48.562453 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12174435-766d-44b9-aed3-4ceda8cb85ec admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:48.564574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-12174435-766d-44b9-aed3-4ceda8cb85ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:48.644926 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12174435-766d-44b9-aed3-4ceda8cb85ec admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:48.649620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfb244-883e-4cfe-b10b-7a8e07f97230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:48.650257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfb244-883e-4cfe-b10b-7a8e07f97230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:48.650533 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfb244-883e-4cfe-b10b-7a8e07f97230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:48.650805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfb244-883e-4cfe-b10b-7a8e07f97230 admin admin] PATH_INFO: `/v3/users/4030e92eb47b45599b31afe235bc9a1b` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:48.651936 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfb244-883e-4cfe-b10b-7a8e07f97230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4030e92eb47b45599b31afe235bc9a1b)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:48.653948 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfb244-883e-4cfe-b10b-7a8e07f97230 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:48.774199 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-305fbed2-bff9-4e0d-b574-84de4d4b313a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e00020069d246d2b8ac9cb11f0d3e39'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.775036 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-305fbed2-bff9-4e0d-b574-84de4d4b313a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e00020069d246d2b8ac9cb11f0d3e39'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.797171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-305fbed2-bff9-4e0d-b574-84de4d4b313a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e00020069d246d2b8ac9cb11f0d3e39'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.837666 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:48.857201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-305fbed2-bff9-4e0d-b574-84de4d4b313a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e00020069d246d2b8ac9cb11f0d3e39'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.862037 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-305fbed2-bff9-4e0d-b574-84de4d4b313a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e00020069d246d2b8ac9cb11f0d3e39'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.874993 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f9cfb244-883e-4cfe-b10b-7a8e07f97230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4030e92eb47b45599b31afe235bc9a1b'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.876705 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f9cfb244-883e-4cfe-b10b-7a8e07f97230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4030e92eb47b45599b31afe235bc9a1b'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.887718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1022/2020] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:48 2022] DELETE /identity/v3/users/1e00020069d246d2b8ac9cb11f0d3e39 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:48.889050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9a448-92c4-44fe-9308-b675b90983b6 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:48.889334 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9a448-92c4-44fe-9308-b675b90983b6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:48.889611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9a448-92c4-44fe-9308-b675b90983b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:48.900982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f9cfb244-883e-4cfe-b10b-7a8e07f97230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4030e92eb47b45599b31afe235bc9a1b'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.917728 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:48.924099 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4dc9a448-92c4-44fe-9308-b675b90983b6 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:48.925383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4dc9a448-92c4-44fe-9308-b675b90983b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:48.969702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f9cfb244-883e-4cfe-b10b-7a8e07f97230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4030e92eb47b45599b31afe235bc9a1b'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.970750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f9cfb244-883e-4cfe-b10b-7a8e07f97230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4030e92eb47b45599b31afe235bc9a1b'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:48.993290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 999/2021] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:48 2022] DELETE /identity/v3/users/4030e92eb47b45599b31afe235bc9a1b => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:48.995636 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2d10e-c161-4324-a627-90c73441965a None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:48.999653 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2d10e-c161-4324-a627-90c73441965a None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:49.000700 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2d10e-c161-4324-a627-90c73441965a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:49.024393 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-7af2d10e-c161-4324-a627-90c73441965a None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:49.026171 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-7af2d10e-c161-4324-a627-90c73441965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:49.031064 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1023/2022] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:49.041824 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dec11c-6f5d-4cb9-8796-d1038f529af6 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:49.042108 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dec11c-6f5d-4cb9-8796-d1038f529af6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:49.042388 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dec11c-6f5d-4cb9-8796-d1038f529af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:49.077894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-45dec11c-6f5d-4cb9-8796-d1038f529af6 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:49.080299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-45dec11c-6f5d-4cb9-8796-d1038f529af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:49.148809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1000/2023] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:49.175899 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2d10e-c161-4324-a627-90c73441965a None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:49.176854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1024/2024] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:49.188387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2d10e-c161-4324-a627-90c73441965a None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:49.193497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56de198-8608-4264-9974-bcb7a5638e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:49.196036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56de198-8608-4264-9974-bcb7a5638e19 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:49.196036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56de198-8608-4264-9974-bcb7a5638e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:49.196036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56de198-8608-4264-9974-bcb7a5638e19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:49.196036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56de198-8608-4264-9974-bcb7a5638e19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:37:49.197300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dec11c-6f5d-4cb9-8796-d1038f529af6 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:49.197931 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56de198-8608-4264-9974-bcb7a5638e19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:49.199589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56de198-8608-4264-9974-bcb7a5638e19 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:49.201491 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-45dec11c-6f5d-4cb9-8796-d1038f529af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:49.214577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1001/2025] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:37:49.218729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56de198-8608-4264-9974-bcb7a5638e19 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:49.232932 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56de198-8608-4264-9974-bcb7a5638e19 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:49.239329 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a4bca-0d22-4af9-9a01-2e92c02d8e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:49.240084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a4bca-0d22-4af9-9a01-2e92c02d8e10 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:49.240538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a4bca-0d22-4af9-9a01-2e92c02d8e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:49.240953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a4bca-0d22-4af9-9a01-2e92c02d8e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:49.241765 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a4bca-0d22-4af9-9a01-2e92c02d8e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:49.244574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a4bca-0d22-4af9-9a01-2e92c02d8e10 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:49.293173 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dec11c-6f5d-4cb9-8796-d1038f529af6 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:49.296907 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a5e02-6c73-4257-8d3f-e1118eb851d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:49.297546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a5e02-6c73-4257-8d3f-e1118eb851d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:49.297822 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a5e02-6c73-4257-8d3f-e1118eb851d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:49.298094 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a5e02-6c73-4257-8d3f-e1118eb851d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:49.312506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a5e02-6c73-4257-8d3f-e1118eb851d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:49.312506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a5e02-6c73-4257-8d3f-e1118eb851d3 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:49.315953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1002/2026] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:49 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:49.320588 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a4bca-0d22-4af9-9a01-2e92c02d8e10 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:49.325251 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1025/2027] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:49.399745 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a4bca-0d22-4af9-9a01-2e92c02d8e10 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:49.404686 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26276629-87be-41d2-95b5-db0fb47379de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:49.405302 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26276629-87be-41d2-95b5-db0fb47379de admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:49.405583 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26276629-87be-41d2-95b5-db0fb47379de admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:49.405856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26276629-87be-41d2-95b5-db0fb47379de admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:49.406491 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26276629-87be-41d2-95b5-db0fb47379de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:49.408569 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26276629-87be-41d2-95b5-db0fb47379de admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:49.531222 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1003/2028] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:49 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:37:49.532313 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a5e02-6c73-4257-8d3f-e1118eb851d3 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:49.554367 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a5e02-6c73-4257-8d3f-e1118eb851d3 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:49.576089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59be6f-fb91-4fd0-adf6-cef1974770f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:49.576939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59be6f-fb91-4fd0-adf6-cef1974770f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:49.577209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59be6f-fb91-4fd0-adf6-cef1974770f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:49.577556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59be6f-fb91-4fd0-adf6-cef1974770f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:49.578398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59be6f-fb91-4fd0-adf6-cef1974770f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:49.581195 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59be6f-fb91-4fd0-adf6-cef1974770f0 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:49.592589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1026/2029] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:49.598950 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26276629-87be-41d2-95b5-db0fb47379de admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:49.616210 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26276629-87be-41d2-95b5-db0fb47379de admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:49.627669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2b2e8-52d1-4e7e-8f3d-33580384c847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:49.635363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2b2e8-52d1-4e7e-8f3d-33580384c847 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:49.635363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2b2e8-52d1-4e7e-8f3d-33580384c847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:49.635363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2b2e8-52d1-4e7e-8f3d-33580384c847 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:49.635363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2b2e8-52d1-4e7e-8f3d-33580384c847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:49.635363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2b2e8-52d1-4e7e-8f3d-33580384c847 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:49.651659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1004/2030] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:49.656768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59be6f-fb91-4fd0-adf6-cef1974770f0 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:49.670051 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59be6f-fb91-4fd0-adf6-cef1974770f0 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:49.683126 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f40f7a-cd7a-432f-a576-e07f6c3ecf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:49.683820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f40f7a-cd7a-432f-a576-e07f6c3ecf9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:49.684153 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f40f7a-cd7a-432f-a576-e07f6c3ecf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:49.684732 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f40f7a-cd7a-432f-a576-e07f6c3ecf9b admin admin] PATH_INFO: `/v3/projects/4af51cd2d3054cc5a94e5965a65d0dc7/users/23ac6bcd7c0a49799498d83986191155/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:49.705244 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:49.708867 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2b2e8-52d1-4e7e-8f3d-33580384c847 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:49.711274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-63c2b2e8-52d1-4e7e-8f3d-33580384c847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:49.718788 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f40f7a-cd7a-432f-a576-e07f6c3ecf9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4af51cd2d3054cc5a94e5965a65d0dc7, user_id=23ac6bcd7c0a49799498d83986191155, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:49.728036 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f40f7a-cd7a-432f-a576-e07f6c3ecf9b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:49.735183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2b2e8-52d1-4e7e-8f3d-33580384c847 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:49.742101 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51776d-9edd-4b52-aab2-7d68d03a2adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:49.742881 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51776d-9edd-4b52-aab2-7d68d03a2adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:49.743415 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51776d-9edd-4b52-aab2-7d68d03a2adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:49.743788 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51776d-9edd-4b52-aab2-7d68d03a2adf admin admin] PATH_INFO: `/v3/projects/3f1b11982b8c4b82950bb39413c42bb0` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:49.745218 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51776d-9edd-4b52-aab2-7d68d03a2adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f1b11982b8c4b82950bb39413c42bb0)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:49.747651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51776d-9edd-4b52-aab2-7d68d03a2adf admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:49.776027 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:49.837980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1027/2031] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:49 2022] PUT /identity/v3/projects/4af51cd2d3054cc5a94e5965a65d0dc7/users/23ac6bcd7c0a49799498d83986191155/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:49.848484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86ad5e-bf47-4914-b220-0d237c3238d9 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:49.848875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86ad5e-bf47-4914-b220-0d237c3238d9 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:49.849213 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86ad5e-bf47-4914-b220-0d237c3238d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:49.888574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3f86ad5e-bf47-4914-b220-0d237c3238d9 None None] MFA Rules not processed for user `23ac6bcd7c0a49799498d83986191155`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:49.889564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3f86ad5e-bf47-4914-b220-0d237c3238d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:49.893789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-bf51776d-9edd-4b52-aab2-7d68d03a2adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f1b11982b8c4b82950bb39413c42bb0', 'request_id': 'req-bf51776d-9edd-4b52-aab2-7d68d03a2adf'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:49.902186 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-bf51776d-9edd-4b52-aab2-7d68d03a2adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f1b11982b8c4b82950bb39413c42bb0', 'request_id': 'req-bf51776d-9edd-4b52-aab2-7d68d03a2adf'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:49.951468 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-bf51776d-9edd-4b52-aab2-7d68d03a2adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f1b11982b8c4b82950bb39413c42bb0', 'request_id': 'req-bf51776d-9edd-4b52-aab2-7d68d03a2adf'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:49.963666 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-bf51776d-9edd-4b52-aab2-7d68d03a2adf admin admin] The token cache is being invalidate because project 3f1b11982b8c4b82950bb39413c42bb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:49.964376 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-bf51776d-9edd-4b52-aab2-7d68d03a2adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:49.965176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-bf51776d-9edd-4b52-aab2-7d68d03a2adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:49.965413 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1028/2032] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:49.965784 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86ad5e-bf47-4914-b220-0d237c3238d9 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:49.966997 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1005/2033] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:49 2022] DELETE /identity/v3/projects/3f1b11982b8c4b82950bb39413c42bb0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:49.967350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3f86ad5e-bf47-4914-b220-0d237c3238d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:49.971378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51776d-9edd-4b52-aab2-7d68d03a2adf admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:49.972656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-bf51776d-9edd-4b52-aab2-7d68d03a2adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:50.045923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86ad5e-bf47-4914-b220-0d237c3238d9 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:50.051367 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ef099-f8cc-4ac2-b4e7-5df973c922de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:50.052018 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ef099-f8cc-4ac2-b4e7-5df973c922de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:50.052299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ef099-f8cc-4ac2-b4e7-5df973c922de admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:50.052636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ef099-f8cc-4ac2-b4e7-5df973c922de admin admin] PATH_INFO: `/v3/projects/5d84da2b67d14cd6b0052dd969e24bbc` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:50.054405 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ef099-f8cc-4ac2-b4e7-5df973c922de admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d84da2b67d14cd6b0052dd969e24bbc)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:50.057366 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ef099-f8cc-4ac2-b4e7-5df973c922de admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:50.059640 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51776d-9edd-4b52-aab2-7d68d03a2adf admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:50.069400 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70418516-201d-4023-85e6-711b761d13d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:50.070064 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70418516-201d-4023-85e6-711b761d13d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:50.070342 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70418516-201d-4023-85e6-711b761d13d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:50.070628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70418516-201d-4023-85e6-711b761d13d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:50.071264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70418516-201d-4023-85e6-711b761d13d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:50.073353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70418516-201d-4023-85e6-711b761d13d6 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:50.179353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1006/2034] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:49 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:50.181045 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da15a25-91ac-411d-8d3f-021937c0e355 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:50.181348 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da15a25-91ac-411d-8d3f-021937c0e355 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:50.181630 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da15a25-91ac-411d-8d3f-021937c0e355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:50.198017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2c6ef099-f8cc-4ac2-b4e7-5df973c922de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d84da2b67d14cd6b0052dd969e24bbc', 'request_id': 'req-2c6ef099-f8cc-4ac2-b4e7-5df973c922de'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:50.204759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-9da15a25-91ac-411d-8d3f-021937c0e355 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:50.205555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2c6ef099-f8cc-4ac2-b4e7-5df973c922de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d84da2b67d14cd6b0052dd969e24bbc', 'request_id': 'req-2c6ef099-f8cc-4ac2-b4e7-5df973c922de'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:50.206009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-9da15a25-91ac-411d-8d3f-021937c0e355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:50.254625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2c6ef099-f8cc-4ac2-b4e7-5df973c922de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d84da2b67d14cd6b0052dd969e24bbc', 'request_id': 'req-2c6ef099-f8cc-4ac2-b4e7-5df973c922de'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:50.275339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2c6ef099-f8cc-4ac2-b4e7-5df973c922de admin admin] The token cache is being invalidate because project 5d84da2b67d14cd6b0052dd969e24bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:50.275863 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2c6ef099-f8cc-4ac2-b4e7-5df973c922de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:50.276708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2c6ef099-f8cc-4ac2-b4e7-5df973c922de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:50.283981 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1007/2035] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:50.283981 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da15a25-91ac-411d-8d3f-021937c0e355 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:50.283981 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-9da15a25-91ac-411d-8d3f-021937c0e355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:50.285625 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1029/2036] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:49 2022] DELETE /identity/v3/projects/5d84da2b67d14cd6b0052dd969e24bbc => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:50.286601 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ef099-f8cc-4ac2-b4e7-5df973c922de admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:50.288146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2c6ef099-f8cc-4ac2-b4e7-5df973c922de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:50.294171 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da15a25-91ac-411d-8d3f-021937c0e355 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:50.298023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:50.302858 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14c832-44c6-43c5-ab66-ecaa459d7794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:50.303962 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14c832-44c6-43c5-ab66-ecaa459d7794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:50.305530 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14c832-44c6-43c5-ab66-ecaa459d7794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:50.305530 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14c832-44c6-43c5-ab66-ecaa459d7794 admin admin] PATH_INFO: `/v3/projects/f03a864e781c47f495bee44d603db312` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:50.306456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14c832-44c6-43c5-ab66-ecaa459d7794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f03a864e781c47f495bee44d603db312)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:50.308843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14c832-44c6-43c5-ab66-ecaa459d7794 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:50.376508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ef099-f8cc-4ac2-b4e7-5df973c922de admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:50.382873 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433a699-168b-40c3-bd5f-7cc1a184eaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:50.383513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433a699-168b-40c3-bd5f-7cc1a184eaea admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:50.383796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433a699-168b-40c3-bd5f-7cc1a184eaea admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:50.384502 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433a699-168b-40c3-bd5f-7cc1a184eaea admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:50.385217 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433a699-168b-40c3-bd5f-7cc1a184eaea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:50.387258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:50.394137 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433a699-168b-40c3-bd5f-7cc1a184eaea admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:50.409401 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-fd14c832-44c6-43c5-ab66-ecaa459d7794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f03a864e781c47f495bee44d603db312', 'request_id': 'req-fd14c832-44c6-43c5-ab66-ecaa459d7794'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:50.415921 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-fd14c832-44c6-43c5-ab66-ecaa459d7794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f03a864e781c47f495bee44d603db312', 'request_id': 'req-fd14c832-44c6-43c5-ab66-ecaa459d7794'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:50.459483 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:50.510565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-fd14c832-44c6-43c5-ab66-ecaa459d7794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f03a864e781c47f495bee44d603db312', 'request_id': 'req-fd14c832-44c6-43c5-ab66-ecaa459d7794'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:50.517300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1030/2037] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:50 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:50.518640 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e85206-e80c-4c5e-8ac2-fff75d59d7bb None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:50.518997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e85206-e80c-4c5e-8ac2-fff75d59d7bb None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:50.519345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e85206-e80c-4c5e-8ac2-fff75d59d7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:50.525249 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-fd14c832-44c6-43c5-ab66-ecaa459d7794 admin admin] The token cache is being invalidate because project f03a864e781c47f495bee44d603db312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:50.525548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-fd14c832-44c6-43c5-ab66-ecaa459d7794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:50.526206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-fd14c832-44c6-43c5-ab66-ecaa459d7794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:50.527902 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1008/2038] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:50 2022] DELETE /identity/v3/projects/f03a864e781c47f495bee44d603db312 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:50.529355 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587429e1-b441-4ecf-bd8d-8fad6a53adf6 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:50.529642 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587429e1-b441-4ecf-bd8d-8fad6a53adf6 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:50.529918 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587429e1-b441-4ecf-bd8d-8fad6a53adf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:50.541385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-68e85206-e80c-4c5e-8ac2-fff75d59d7bb None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:50.549631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-68e85206-e80c-4c5e-8ac2-fff75d59d7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:50.551845 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-587429e1-b441-4ecf-bd8d-8fad6a53adf6 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:50.553413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-587429e1-b441-4ecf-bd8d-8fad6a53adf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:50.644498 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1009/2039] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:50.649717 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587429e1-b441-4ecf-bd8d-8fad6a53adf6 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:50.651406 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-587429e1-b441-4ecf-bd8d-8fad6a53adf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:50.660210 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1031/2040] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:50.661622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d9d80-b6db-45c0-9145-86e33d8f1450 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:50.662493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d9d80-b6db-45c0-9145-86e33d8f1450 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:50.662925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d9d80-b6db-45c0-9145-86e33d8f1450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:50.675098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587429e1-b441-4ecf-bd8d-8fad6a53adf6 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:50.680706 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309e2cd-4acf-4746-be0b-cfd0a91ad359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:50.681414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309e2cd-4acf-4746-be0b-cfd0a91ad359 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:50.681771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309e2cd-4acf-4746-be0b-cfd0a91ad359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:50.682107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309e2cd-4acf-4746-be0b-cfd0a91ad359 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:50.682978 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309e2cd-4acf-4746-be0b-cfd0a91ad359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:50.688411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-070d9d80-b6db-45c0-9145-86e33d8f1450 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:50.689903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-070d9d80-b6db-45c0-9145-86e33d8f1450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:50.694953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309e2cd-4acf-4746-be0b-cfd0a91ad359 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:50.699636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1032/2041] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:50.701201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9e2c6-36d4-4a7f-a0ff-a3c4c905fbc8 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:50.701562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9e2c6-36d4-4a7f-a0ff-a3c4c905fbc8 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:50.701905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9e2c6-36d4-4a7f-a0ff-a3c4c905fbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:50.717322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1010/2042] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:50.718097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309e2cd-4acf-4746-be0b-cfd0a91ad359 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:50.726043 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-11f9e2c6-36d4-4a7f-a0ff-a3c4c905fbc8 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:50.727527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-11f9e2c6-36d4-4a7f-a0ff-a3c4c905fbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:50.728825 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309e2cd-4acf-4746-be0b-cfd0a91ad359 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:50.736254 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ef7f3-0088-44a6-9b3e-d1d0d1e810f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:50.737099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ef7f3-0088-44a6-9b3e-d1d0d1e810f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:50.737346 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ef7f3-0088-44a6-9b3e-d1d0d1e810f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:50.737626 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ef7f3-0088-44a6-9b3e-d1d0d1e810f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:50.738138 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1033/2043] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:50.742676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ef7f3-0088-44a6-9b3e-d1d0d1e810f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:37:50.742676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ef7f3-0088-44a6-9b3e-d1d0d1e810f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:50.742676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ef7f3-0088-44a6-9b3e-d1d0d1e810f3 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:50.745938 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ac647-ee4c-42d3-a4f5-5cdcd6864295 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:50.746524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ac647-ee4c-42d3-a4f5-5cdcd6864295 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:50.747484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ac647-ee4c-42d3-a4f5-5cdcd6864295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:50.760881 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1011/2044] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:37:50.761733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ef7f3-0088-44a6-9b3e-d1d0d1e810f3 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:50.771039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ef8ac647-ee4c-42d3-a4f5-5cdcd6864295 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:50.772263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ef7f3-0088-44a6-9b3e-d1d0d1e810f3 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:50.777491 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ef8ac647-ee4c-42d3-a4f5-5cdcd6864295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:50.779056 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7250c06-928f-423b-a54c-8272f3f5daff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:50.779738 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7250c06-928f-423b-a54c-8272f3f5daff admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:50.780018 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7250c06-928f-423b-a54c-8272f3f5daff admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:50.780295 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7250c06-928f-423b-a54c-8272f3f5daff admin admin] PATH_INFO: `/v3/projects/9e5fabfb769349c8a04301dc174ca0b3/users/225686b27cbe449a881f71b328a832d8/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:50.807308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7250c06-928f-423b-a54c-8272f3f5daff admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e5fabfb769349c8a04301dc174ca0b3, user_id=225686b27cbe449a881f71b328a832d8, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:50.811629 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1034/2045] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:50.811629 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ac647-ee4c-42d3-a4f5-5cdcd6864295 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:50.811887 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7250c06-928f-423b-a54c-8272f3f5daff admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:50.827183 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ac647-ee4c-42d3-a4f5-5cdcd6864295 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:50.833637 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58b8c0-ffe3-4d63-a5c5-66dbf7c381fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:50.834257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58b8c0-ffe3-4d63-a5c5-66dbf7c381fb admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:50.834537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58b8c0-ffe3-4d63-a5c5-66dbf7c381fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:50.835155 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58b8c0-ffe3-4d63-a5c5-66dbf7c381fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:50.835514 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58b8c0-ffe3-4d63-a5c5-66dbf7c381fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:37:50.835822 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58b8c0-ffe3-4d63-a5c5-66dbf7c381fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:50.837560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58b8c0-ffe3-4d63-a5c5-66dbf7c381fb admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:50.854047 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1035/2046] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:37:50.854047 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58b8c0-ffe3-4d63-a5c5-66dbf7c381fb admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:50.865837 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58b8c0-ffe3-4d63-a5c5-66dbf7c381fb admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:50.872373 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1c028-0db2-4bb7-87a8-752f8c5d368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:50.872834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1c028-0db2-4bb7-87a8-752f8c5d368a admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:50.873214 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1c028-0db2-4bb7-87a8-752f8c5d368a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:50.873585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1c028-0db2-4bb7-87a8-752f8c5d368a admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:50.874311 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b1c028-0db2-4bb7-87a8-752f8c5d368a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:50.877572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b1c028-0db2-4bb7-87a8-752f8c5d368a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:50.892401 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1012/2047] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:50 2022] PUT /identity/v3/projects/9e5fabfb769349c8a04301dc174ca0b3/users/225686b27cbe449a881f71b328a832d8/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:50.893469 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7250c06-928f-423b-a54c-8272f3f5daff admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:50.966780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7250c06-928f-423b-a54c-8272f3f5daff admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:50.971396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8985e1f-6dff-49cd-a171-d4eed3a22a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:50.971975 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8985e1f-6dff-49cd-a171-d4eed3a22a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:50.972253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8985e1f-6dff-49cd-a171-d4eed3a22a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:50.972575 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8985e1f-6dff-49cd-a171-d4eed3a22a8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:50.973211 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8985e1f-6dff-49cd-a171-d4eed3a22a8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:37:50.973513 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8985e1f-6dff-49cd-a171-d4eed3a22a8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:50.977369 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8985e1f-6dff-49cd-a171-d4eed3a22a8b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:50.990421 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1013/2048] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:37:50.990421 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8985e1f-6dff-49cd-a171-d4eed3a22a8b admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:51.000201 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8985e1f-6dff-49cd-a171-d4eed3a22a8b admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:51.005929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0560934-7b81-4d38-9fc8-eeace182f568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:51.006873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0560934-7b81-4d38-9fc8-eeace182f568 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:51.006990 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0560934-7b81-4d38-9fc8-eeace182f568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:51.007475 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0560934-7b81-4d38-9fc8-eeace182f568 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:51.008383 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0560934-7b81-4d38-9fc8-eeace182f568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:51.010076 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0560934-7b81-4d38-9fc8-eeace182f568 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:51.035481 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:51.067924 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1036/2049] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:50 2022] POST /identity/v3/projects => generated 389 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:51.069017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1c028-0db2-4bb7-87a8-752f8c5d368a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:51.131397 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1014/2050] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:50 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:51.132488 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0560934-7b81-4d38-9fc8-eeace182f568 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:51.136901 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1c028-0db2-4bb7-87a8-752f8c5d368a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:51.164872 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:51.231452 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad9385-fcb5-4212-b542-b1d129cb9500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:51.232425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad9385-fcb5-4212-b542-b1d129cb9500 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:51.232870 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad9385-fcb5-4212-b542-b1d129cb9500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:51.233330 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad9385-fcb5-4212-b542-b1d129cb9500 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:51.234243 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad9385-fcb5-4212-b542-b1d129cb9500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:51.236141 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad9385-fcb5-4212-b542-b1d129cb9500 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:51.237791 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0560934-7b81-4d38-9fc8-eeace182f568 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:51.243486 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe6e2b-3e5d-4ada-b927-9eccd6cf946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:51.244106 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe6e2b-3e5d-4ada-b927-9eccd6cf946c admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:51.244748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe6e2b-3e5d-4ada-b927-9eccd6cf946c admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:51.244869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe6e2b-3e5d-4ada-b927-9eccd6cf946c admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:51.245527 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe6e2b-3e5d-4ada-b927-9eccd6cf946c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:51.247539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe6e2b-3e5d-4ada-b927-9eccd6cf946c admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:51.251430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1037/2051] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:51.251430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad9385-fcb5-4212-b542-b1d129cb9500 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:51.261680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad9385-fcb5-4212-b542-b1d129cb9500 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:51.266537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2855af6-c8c9-4506-93f6-56a7f36a4dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:51.267139 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2855af6-c8c9-4506-93f6-56a7f36a4dba admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:51.267417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2855af6-c8c9-4506-93f6-56a7f36a4dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:51.267697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2855af6-c8c9-4506-93f6-56a7f36a4dba admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:51.268466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2855af6-c8c9-4506-93f6-56a7f36a4dba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:51.270313 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2855af6-c8c9-4506-93f6-56a7f36a4dba admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:51.369546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1038/2052] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:51 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:51.370369 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2855af6-c8c9-4506-93f6-56a7f36a4dba admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:51.380689 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1015/2053] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:51 2022] POST /identity/v3/projects => generated 373 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:51.380689 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe6e2b-3e5d-4ada-b927-9eccd6cf946c admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:51.384021 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2855af6-c8c9-4506-93f6-56a7f36a4dba admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:51.447408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa190d9-a733-4ce5-b3a9-2c93809e1b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:51.448001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa190d9-a733-4ce5-b3a9-2c93809e1b61 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:51.448286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa190d9-a733-4ce5-b3a9-2c93809e1b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:51.448598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa190d9-a733-4ce5-b3a9-2c93809e1b61 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:51.449236 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa190d9-a733-4ce5-b3a9-2c93809e1b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:51.451289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa190d9-a733-4ce5-b3a9-2c93809e1b61 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:51.451880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe6e2b-3e5d-4ada-b927-9eccd6cf946c admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:51.456625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344c667-d7fa-4594-b266-6679a6f1099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:51.457301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344c667-d7fa-4594-b266-6679a6f1099a admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:51.457648 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344c667-d7fa-4594-b266-6679a6f1099a admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:51.457917 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344c667-d7fa-4594-b266-6679a6f1099a admin admin] PATH_INFO: `/v3/projects/9e5fabfb769349c8a04301dc174ca0b3/users/225686b27cbe449a881f71b328a832d8/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:51.459801 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344c667-d7fa-4594-b266-6679a6f1099a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e5fabfb769349c8a04301dc174ca0b3, user_id=225686b27cbe449a881f71b328a832d8, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:51.462563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344c667-d7fa-4594-b266-6679a6f1099a admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:51.474564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1016/2054] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:51 2022] PUT /identity/v3/projects/9e5fabfb769349c8a04301dc174ca0b3/users/225686b27cbe449a881f71b328a832d8/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:51.475415 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344c667-d7fa-4594-b266-6679a6f1099a admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:51.546436 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1039/2055] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:51 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:51.548096 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344c667-d7fa-4594-b266-6679a6f1099a admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:51.548283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa190d9-a733-4ce5-b3a9-2c93809e1b61 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:51.554381 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658ff2c-1259-44f7-8328-c66a7f692978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:51.554947 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658ff2c-1259-44f7-8328-c66a7f692978 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:51.555230 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658ff2c-1259-44f7-8328-c66a7f692978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:51.555502 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658ff2c-1259-44f7-8328-c66a7f692978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:51.556144 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658ff2c-1259-44f7-8328-c66a7f692978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:51.557797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658ff2c-1259-44f7-8328-c66a7f692978 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:51.558837 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa190d9-a733-4ce5-b3a9-2c93809e1b61 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:51.564632 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02295c-95db-4d85-81bd-74f82436f540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:51.565734 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02295c-95db-4d85-81bd-74f82436f540 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:51.565734 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02295c-95db-4d85-81bd-74f82436f540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:51.565932 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02295c-95db-4d85-81bd-74f82436f540 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:51.566482 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02295c-95db-4d85-81bd-74f82436f540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:51.568514 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02295c-95db-4d85-81bd-74f82436f540 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:51.572389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1017/2056] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:51.572389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a64d1-d62b-4288-be99-b37a7d7f8b4b None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:51.572389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a64d1-d62b-4288-be99-b37a7d7f8b4b None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:51.572389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a64d1-d62b-4288-be99-b37a7d7f8b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:51.597933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-dc7a64d1-d62b-4288-be99-b37a7d7f8b4b None None] MFA Rules not processed for user `225686b27cbe449a881f71b328a832d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:51.599162 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-dc7a64d1-d62b-4288-be99-b37a7d7f8b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:51.657973 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1040/2057] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:51 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:51.660488 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02295c-95db-4d85-81bd-74f82436f540 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:51.661871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ae02295c-95db-4d85-81bd-74f82436f540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:51.675875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02295c-95db-4d85-81bd-74f82436f540 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:51.678270 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1018/2058] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:51.679412 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a64d1-d62b-4288-be99-b37a7d7f8b4b None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:51.682290 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c95b9-80d6-4076-9609-b7314c7f0756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:51.683271 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c95b9-80d6-4076-9609-b7314c7f0756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:51.683271 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c95b9-80d6-4076-9609-b7314c7f0756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:51.683446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c95b9-80d6-4076-9609-b7314c7f0756 admin admin] PATH_INFO: `/v3/users/603658cfa91440faa2584d8647aebd77` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:51.691291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a64d1-d62b-4288-be99-b37a7d7f8b4b None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:51.692540 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c95b9-80d6-4076-9609-b7314c7f0756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=603658cfa91440faa2584d8647aebd77)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:51.694661 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c95b9-80d6-4076-9609-b7314c7f0756 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:51.697645 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf77c6-ce7b-41d5-9fa6-7cb2ea39b236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:51.697645 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf77c6-ce7b-41d5-9fa6-7cb2ea39b236 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:51.697871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf77c6-ce7b-41d5-9fa6-7cb2ea39b236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:51.697971 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf77c6-ce7b-41d5-9fa6-7cb2ea39b236 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:51.698596 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf77c6-ce7b-41d5-9fa6-7cb2ea39b236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:51.700676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf77c6-ce7b-41d5-9fa6-7cb2ea39b236 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:51.711255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1019/2059] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:51.715091 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf77c6-ce7b-41d5-9fa6-7cb2ea39b236 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:51.725910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf77c6-ce7b-41d5-9fa6-7cb2ea39b236 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:51.731552 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec3e2b-454f-4329-b2cc-4b954dd5ac8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:51.732175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec3e2b-454f-4329-b2cc-4b954dd5ac8c admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:51.732489 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec3e2b-454f-4329-b2cc-4b954dd5ac8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:51.732763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec3e2b-454f-4329-b2cc-4b954dd5ac8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:51.733404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec3e2b-454f-4329-b2cc-4b954dd5ac8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:51.735603 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec3e2b-454f-4329-b2cc-4b954dd5ac8c admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:51.749440 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1020/2060] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:51.749440 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec3e2b-454f-4329-b2cc-4b954dd5ac8c admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:51.757751 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec3e2b-454f-4329-b2cc-4b954dd5ac8c admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:51.764998 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf2b27-7f38-4ece-b3fb-c9adffff68f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:51.765629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf2b27-7f38-4ece-b3fb-c9adffff68f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:51.765909 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf2b27-7f38-4ece-b3fb-c9adffff68f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:51.766059 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:51.767549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf2b27-7f38-4ece-b3fb-c9adffff68f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:51.767859 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf2b27-7f38-4ece-b3fb-c9adffff68f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:51.769564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf2b27-7f38-4ece-b3fb-c9adffff68f3 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:51.785958 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1021/2061] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:51.785958 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf2b27-7f38-4ece-b3fb-c9adffff68f3 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:51.794245 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-35bf2b27-7f38-4ece-b3fb-c9adffff68f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:51.838455 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:51.843436 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e58c95b9-80d6-4076-9609-b7314c7f0756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '603658cfa91440faa2584d8647aebd77'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:51.844824 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e58c95b9-80d6-4076-9609-b7314c7f0756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '603658cfa91440faa2584d8647aebd77'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:51.858269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e58c95b9-80d6-4076-9609-b7314c7f0756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '603658cfa91440faa2584d8647aebd77'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:51.863633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf2b27-7f38-4ece-b3fb-c9adffff68f3 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:51.867571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f6883-c3d6-480f-85f8-22cf46d318e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:51.868253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f6883-c3d6-480f-85f8-22cf46d318e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:51.868558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f6883-c3d6-480f-85f8-22cf46d318e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:51.868828 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f6883-c3d6-480f-85f8-22cf46d318e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:51.870586 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a89f6883-c3d6-480f-85f8-22cf46d318e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:51.929383 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f6883-c3d6-480f-85f8-22cf46d318e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:51.931374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f6883-c3d6-480f-85f8-22cf46d318e9 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:51.940801 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1022/2062] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:51.941231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e58c95b9-80d6-4076-9609-b7314c7f0756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '603658cfa91440faa2584d8647aebd77'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:51.942041 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e58c95b9-80d6-4076-9609-b7314c7f0756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '603658cfa91440faa2584d8647aebd77'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:51.943523 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f6883-c3d6-480f-85f8-22cf46d318e9 service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:51.944891 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a89f6883-c3d6-480f-85f8-22cf46d318e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:51.957890 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1041/2063] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:51 2022] DELETE /identity/v3/users/603658cfa91440faa2584d8647aebd77 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:51.959047 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c95b9-80d6-4076-9609-b7314c7f0756 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:51.959159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f6883-c3d6-480f-85f8-22cf46d318e9 service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:51.961128 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e58c95b9-80d6-4076-9609-b7314c7f0756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:52.027586 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:52.076437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a64fb-3526-4758-9844-a3d2dff596b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:52.077284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a64fb-3526-4758-9844-a3d2dff596b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:52.077715 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a64fb-3526-4758-9844-a3d2dff596b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:52.078170 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a64fb-3526-4758-9844-a3d2dff596b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:52.079555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a64fb-3526-4758-9844-a3d2dff596b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:52.079689 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c95b9-80d6-4076-9609-b7314c7f0756 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:52.086278 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeba602-36c6-499f-9fb2-cea53898eb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:52.087203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeba602-36c6-499f-9fb2-cea53898eb6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:52.087488 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeba602-36c6-499f-9fb2-cea53898eb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:52.087768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeba602-36c6-499f-9fb2-cea53898eb6b admin admin] PATH_INFO: `/v3/projects/1c4677f9c6bf4cf48399b2ea43b241d0/users/2d5a86c2b54648b196c3dc76bca761cc/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:52.088720 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a64fb-3526-4758-9844-a3d2dff596b3 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:52.108486 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1023/2064] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:52.109859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeba602-36c6-499f-9fb2-cea53898eb6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4677f9c6bf4cf48399b2ea43b241d0, user_id=2d5a86c2b54648b196c3dc76bca761cc, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:52.111572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a64fb-3526-4758-9844-a3d2dff596b3 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:52.113803 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeba602-36c6-499f-9fb2-cea53898eb6b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:52.116560 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-883a64fb-3526-4758-9844-a3d2dff596b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:52.135914 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a64fb-3526-4758-9844-a3d2dff596b3 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:52.141787 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98969853-1900-4dff-87b0-2c436c0bcf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:52.142456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98969853-1900-4dff-87b0-2c436c0bcf44 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:52.142736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98969853-1900-4dff-87b0-2c436c0bcf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:52.143013 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98969853-1900-4dff-87b0-2c436c0bcf44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:52.143661 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98969853-1900-4dff-87b0-2c436c0bcf44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:52.145694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98969853-1900-4dff-87b0-2c436c0bcf44 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:52.155756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1024/2065] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:52.157499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98969853-1900-4dff-87b0-2c436c0bcf44 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:52.168159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98969853-1900-4dff-87b0-2c436c0bcf44 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:52.176493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8320fca-9a73-4952-9ef2-9e6fe205245b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:52.182671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8320fca-9a73-4952-9ef2-9e6fe205245b admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:52.182671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8320fca-9a73-4952-9ef2-9e6fe205245b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:52.182671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8320fca-9a73-4952-9ef2-9e6fe205245b admin admin] PATH_INFO: `/v3/projects/7b42262e9e2e47aea5cf8ba46bdbf465/users/e2183f644359472eb40c54684e486aa7/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:52.193339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8320fca-9a73-4952-9ef2-9e6fe205245b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b42262e9e2e47aea5cf8ba46bdbf465, user_id=e2183f644359472eb40c54684e486aa7, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:52.196017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8320fca-9a73-4952-9ef2-9e6fe205245b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:52.204755 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1042/2066] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:51 2022] PUT /identity/v3/projects/1c4677f9c6bf4cf48399b2ea43b241d0/users/2d5a86c2b54648b196c3dc76bca761cc/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:52.205568 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeba602-36c6-499f-9fb2-cea53898eb6b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:52.220505 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:52.272425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeba602-36c6-499f-9fb2-cea53898eb6b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:52.277406 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a0101-a1ad-424a-b84b-9f671623be23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:52.278101 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a0101-a1ad-424a-b84b-9f671623be23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:52.278390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a0101-a1ad-424a-b84b-9f671623be23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:52.278666 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a0101-a1ad-424a-b84b-9f671623be23 admin admin] PATH_INFO: `/v3/projects/49652cfbaac5480e9406598d39984e47/users/350c036bd5b84948976326f1f31c0d85/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:52.295503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:52.300718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a0101-a1ad-424a-b84b-9f671623be23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49652cfbaac5480e9406598d39984e47, user_id=350c036bd5b84948976326f1f31c0d85, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:52.301916 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a0101-a1ad-424a-b84b-9f671623be23 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:52.314485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1025/2067] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:52 2022] PUT /identity/v3/projects/7b42262e9e2e47aea5cf8ba46bdbf465/users/e2183f644359472eb40c54684e486aa7/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:52.316063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e42052-bc11-4e6a-aef1-83c541b3d04c None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:52.316304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e42052-bc11-4e6a-aef1-83c541b3d04c None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:52.316639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e42052-bc11-4e6a-aef1-83c541b3d04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:52.345781 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-16e42052-bc11-4e6a-aef1-83c541b3d04c None None] MFA Rules not processed for user `2d5a86c2b54648b196c3dc76bca761cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:52.347002 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-16e42052-bc11-4e6a-aef1-83c541b3d04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:52.415025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1026/2069] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:52.415025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e42052-bc11-4e6a-aef1-83c541b3d04c None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:52.415025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-16e42052-bc11-4e6a-aef1-83c541b3d04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:52.420107 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1043/2069] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:52 2022] PUT /identity/v3/projects/49652cfbaac5480e9406598d39984e47/users/350c036bd5b84948976326f1f31c0d85/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:52.421301 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653d6b6-d4b6-404b-8c41-41a1efe2b020 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:52.421896 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653d6b6-d4b6-404b-8c41-41a1efe2b020 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:52.422178 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653d6b6-d4b6-404b-8c41-41a1efe2b020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:52.453341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a653d6b6-d4b6-404b-8c41-41a1efe2b020 None None] MFA Rules not processed for user `e2183f644359472eb40c54684e486aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:52.455252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a653d6b6-d4b6-404b-8c41-41a1efe2b020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:52.486722 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e42052-bc11-4e6a-aef1-83c541b3d04c None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:52.522864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1044/2070] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:52.523494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653d6b6-d4b6-404b-8c41-41a1efe2b020 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:52.545407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2f898-3141-4918-8909-ac30ace1709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:52.546090 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2f898-3141-4918-8909-ac30ace1709f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:52.546368 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2f898-3141-4918-8909-ac30ace1709f admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:52.546667 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2f898-3141-4918-8909-ac30ace1709f admin admin] PATH_INFO: `/v3/projects/f4b659f693a44a93a9cdc4815bf72a67` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:52.547808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2f898-3141-4918-8909-ac30ace1709f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b659f693a44a93a9cdc4815bf72a67)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:52.549853 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2f898-3141-4918-8909-ac30ace1709f admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:52.587767 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653d6b6-d4b6-404b-8c41-41a1efe2b020 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:52.592566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68b637-9599-456e-ae2a-6a21d39fce63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:52.595997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68b637-9599-456e-ae2a-6a21d39fce63 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:52.595997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68b637-9599-456e-ae2a-6a21d39fce63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:52.595997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68b637-9599-456e-ae2a-6a21d39fce63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:52.595997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68b637-9599-456e-ae2a-6a21d39fce63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:52.596399 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68b637-9599-456e-ae2a-6a21d39fce63 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:52.712191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1045/2071] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:52 2022] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:52.712191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee5007-e278-48ce-84e0-f25f074ef1d5 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:52.712191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee5007-e278-48ce-84e0-f25f074ef1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:52.712677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee5007-e278-48ce-84e0-f25f074ef1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:52.717062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:52.720815 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-03d2f898-3141-4918-8909-ac30ace1709f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b659f693a44a93a9cdc4815bf72a67', 'request_id': 'req-03d2f898-3141-4918-8909-ac30ace1709f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:52.727630 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-03d2f898-3141-4918-8909-ac30ace1709f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b659f693a44a93a9cdc4815bf72a67', 'request_id': 'req-03d2f898-3141-4918-8909-ac30ace1709f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:52.745852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c0ee5007-e278-48ce-84e0-f25f074ef1d5 None None] MFA Rules not processed for user `350c036bd5b84948976326f1f31c0d85`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:52.747240 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c0ee5007-e278-48ce-84e0-f25f074ef1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:52.814964 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-03d2f898-3141-4918-8909-ac30ace1709f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b659f693a44a93a9cdc4815bf72a67', 'request_id': 'req-03d2f898-3141-4918-8909-ac30ace1709f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:52.816831 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1046/2072] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:52.817642 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee5007-e278-48ce-84e0-f25f074ef1d5 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:52.832073 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-03d2f898-3141-4918-8909-ac30ace1709f admin admin] The token cache is being invalidate because project f4b659f693a44a93a9cdc4815bf72a67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:52.832073 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-03d2f898-3141-4918-8909-ac30ace1709f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:52.832073 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-03d2f898-3141-4918-8909-ac30ace1709f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:52.832073 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1027/2073] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:52 2022] DELETE /identity/v3/projects/f4b659f693a44a93a9cdc4815bf72a67 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:52.832073 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2f898-3141-4918-8909-ac30ace1709f admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:52.832929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-03d2f898-3141-4918-8909-ac30ace1709f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:52.853002 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:52.889580 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee5007-e278-48ce-84e0-f25f074ef1d5 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:52.894227 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21634f5-bf8e-4f27-b989-237be060dcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:52.894855 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21634f5-bf8e-4f27-b989-237be060dcdd admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:52.895167 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21634f5-bf8e-4f27-b989-237be060dcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:52.895437 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21634f5-bf8e-4f27-b989-237be060dcdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:52.896067 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21634f5-bf8e-4f27-b989-237be060dcdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:52.898005 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21634f5-bf8e-4f27-b989-237be060dcdd admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:52.901135 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2f898-3141-4918-8909-ac30ace1709f admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:52.905838 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb693a2e-810a-45a2-be0d-ad7ee0140fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:52.906442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb693a2e-810a-45a2-be0d-ad7ee0140fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:52.906738 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb693a2e-810a-45a2-be0d-ad7ee0140fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:52.907021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb693a2e-810a-45a2-be0d-ad7ee0140fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:52.907649 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb693a2e-810a-45a2-be0d-ad7ee0140fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:52.909606 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb693a2e-810a-45a2-be0d-ad7ee0140fb5 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:52.963795 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1047/2074] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:52 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:52.965376 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21634f5-bf8e-4f27-b989-237be060dcdd admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:52.967149 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e21634f5-bf8e-4f27-b989-237be060dcdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:52.986709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1028/2075] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:52 2022] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:52.987955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f47ed2-8e52-40fb-9704-109bf664e7a4 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:52.988244 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f47ed2-8e52-40fb-9704-109bf664e7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:52.988548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f47ed2-8e52-40fb-9704-109bf664e7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:53.009336 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-49f47ed2-8e52-40fb-9704-109bf664e7a4 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:53.010562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-49f47ed2-8e52-40fb-9704-109bf664e7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:53.024994 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21634f5-bf8e-4f27-b989-237be060dcdd admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:53.028982 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f92b6-dd1e-4cf7-b359-7f12ac5135fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:53.029429 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:53.029588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f92b6-dd1e-4cf7-b359-7f12ac5135fd service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:53.029901 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f92b6-dd1e-4cf7-b359-7f12ac5135fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:53.030145 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f92b6-dd1e-4cf7-b359-7f12ac5135fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:53.031879 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c07f92b6-dd1e-4cf7-b359-7f12ac5135fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:53.043731 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:53.072739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1029/2076] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:53.073659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f47ed2-8e52-40fb-9704-109bf664e7a4 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:53.075465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-49f47ed2-8e52-40fb-9704-109bf664e7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:53.087202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f47ed2-8e52-40fb-9704-109bf664e7a4 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:53.092097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c210aff-3c73-40b7-967b-52a307937a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:53.092724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c210aff-3c73-40b7-967b-52a307937a1c admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:53.093085 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c210aff-3c73-40b7-967b-52a307937a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:53.093370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c210aff-3c73-40b7-967b-52a307937a1c admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:53.094007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c210aff-3c73-40b7-967b-52a307937a1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:53.095313 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f92b6-dd1e-4cf7-b359-7f12ac5135fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:53.096026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c210aff-3c73-40b7-967b-52a307937a1c admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:53.097357 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f92b6-dd1e-4cf7-b359-7f12ac5135fd service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:53.101463 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:53.108858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1048/2077] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:53.109622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f92b6-dd1e-4cf7-b359-7f12ac5135fd service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:53.120175 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f92b6-dd1e-4cf7-b359-7f12ac5135fd service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:53.125472 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe944a8-97b2-414b-82a4-02e3f2816ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:53.126636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe944a8-97b2-414b-82a4-02e3f2816ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:53.127108 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe944a8-97b2-414b-82a4-02e3f2816ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:53.127237 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe944a8-97b2-414b-82a4-02e3f2816ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:53.127911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe944a8-97b2-414b-82a4-02e3f2816ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:53.129498 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe944a8-97b2-414b-82a4-02e3f2816ac2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:53.139381 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1049/2078] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:53.140546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53df5a-1b04-45d6-aa1c-f8c19abc590d None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:53.140848 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53df5a-1b04-45d6-aa1c-f8c19abc590d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:53.141098 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53df5a-1b04-45d6-aa1c-f8c19abc590d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:53.160643 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3a53df5a-1b04-45d6-aa1c-f8c19abc590d None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:53.161846 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3a53df5a-1b04-45d6-aa1c-f8c19abc590d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:53.169996 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1050/2079] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:53.170743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53df5a-1b04-45d6-aa1c-f8c19abc590d None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:53.180898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53df5a-1b04-45d6-aa1c-f8c19abc590d None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:53.186156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cf14c-0e0b-4bc9-ac8a-6d1ba5fce277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:53.186882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cf14c-0e0b-4bc9-ac8a-6d1ba5fce277 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:53.187735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cf14c-0e0b-4bc9-ac8a-6d1ba5fce277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:53.187735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cf14c-0e0b-4bc9-ac8a-6d1ba5fce277 admin admin] PATH_INFO: `/v3/projects/51337c52b0834af886661bec64d74e04/users/87cd76d93a5940abba2d6dd1c3252954/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:53.205585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cf14c-0e0b-4bc9-ac8a-6d1ba5fce277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51337c52b0834af886661bec64d74e04, user_id=87cd76d93a5940abba2d6dd1c3252954, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:53.207534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cf14c-0e0b-4bc9-ac8a-6d1ba5fce277 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:53.209636 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1030/2080] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:53 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:53.210542 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c210aff-3c73-40b7-967b-52a307937a1c admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:53.222931 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c210aff-3c73-40b7-967b-52a307937a1c admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:53.229101 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856117c3-8b99-461e-a052-f414f55af6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:53.229744 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856117c3-8b99-461e-a052-f414f55af6cf admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:53.230276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856117c3-8b99-461e-a052-f414f55af6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:53.230579 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856117c3-8b99-461e-a052-f414f55af6cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:53.231245 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856117c3-8b99-461e-a052-f414f55af6cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:37:53.231532 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856117c3-8b99-461e-a052-f414f55af6cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:53.233340 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856117c3-8b99-461e-a052-f414f55af6cf admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:53.246628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1031/2081] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:37:53.247670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856117c3-8b99-461e-a052-f414f55af6cf admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:53.258544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856117c3-8b99-461e-a052-f414f55af6cf admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:53.263551 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbfd19-da0d-4e48-9f42-1be874c805c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:53.264264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbfd19-da0d-4e48-9f42-1be874c805c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:53.264671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbfd19-da0d-4e48-9f42-1be874c805c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:53.265062 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbfd19-da0d-4e48-9f42-1be874c805c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:53.265808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbfd19-da0d-4e48-9f42-1be874c805c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:53.267542 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbfd19-da0d-4e48-9f42-1be874c805c4 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:53.278029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1032/2082] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:53.279031 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbfd19-da0d-4e48-9f42-1be874c805c4 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:53.289499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbfd19-da0d-4e48-9f42-1be874c805c4 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:53.294321 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bad81c-2f0f-44a0-95a1-f67ee2d2eaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:53.294913 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bad81c-2f0f-44a0-95a1-f67ee2d2eaa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:53.295187 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bad81c-2f0f-44a0-95a1-f67ee2d2eaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:53.295292 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:53.295452 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bad81c-2f0f-44a0-95a1-f67ee2d2eaa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:53.296068 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bad81c-2f0f-44a0-95a1-f67ee2d2eaa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:53.298600 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bad81c-2f0f-44a0-95a1-f67ee2d2eaa3 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:53.323681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1051/2083] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:53 2022] PUT /identity/v3/projects/51337c52b0834af886661bec64d74e04/users/87cd76d93a5940abba2d6dd1c3252954/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:53.324562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cf14c-0e0b-4bc9-ac8a-6d1ba5fce277 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:53.388986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cf14c-0e0b-4bc9-ac8a-6d1ba5fce277 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:53.393860 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d430bf1-222c-453c-9ee1-118a12fccbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:53.394408 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1033/2084] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:53 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:53.394542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d430bf1-222c-453c-9ee1-118a12fccbca admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:53.394879 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d430bf1-222c-453c-9ee1-118a12fccbca admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:53.395168 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d430bf1-222c-453c-9ee1-118a12fccbca admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:53.395258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bad81c-2f0f-44a0-95a1-f67ee2d2eaa3 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:53.395949 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d430bf1-222c-453c-9ee1-118a12fccbca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:53.397696 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d430bf1-222c-453c-9ee1-118a12fccbca admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:53.408643 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1052/2085] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:53.409522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d430bf1-222c-453c-9ee1-118a12fccbca admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:53.420695 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d430bf1-222c-453c-9ee1-118a12fccbca admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:53.433974 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:53.466466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bad81c-2f0f-44a0-95a1-f67ee2d2eaa3 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:53.471968 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd48f7-e374-4304-85db-9f8ec1de5ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:53.472615 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd48f7-e374-4304-85db-9f8ec1de5ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:53.472905 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd48f7-e374-4304-85db-9f8ec1de5ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:53.473166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd48f7-e374-4304-85db-9f8ec1de5ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:53.473799 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd48f7-e374-4304-85db-9f8ec1de5ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:53.475479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd48f7-e374-4304-85db-9f8ec1de5ed3 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:53.481232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803320e-3fbd-4d32-8bea-c7fa4aa16b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:53.481925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803320e-3fbd-4d32-8bea-c7fa4aa16b95 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:53.482146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803320e-3fbd-4d32-8bea-c7fa4aa16b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:53.482421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803320e-3fbd-4d32-8bea-c7fa4aa16b95 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:53.483057 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803320e-3fbd-4d32-8bea-c7fa4aa16b95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:53.485551 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803320e-3fbd-4d32-8bea-c7fa4aa16b95 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:53.486147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1034/2086] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:53.487136 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd48f7-e374-4304-85db-9f8ec1de5ed3 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:53.497744 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd48f7-e374-4304-85db-9f8ec1de5ed3 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:53.503271 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718667b-04ff-40d5-9b98-87e9c2669609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:53.503983 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718667b-04ff-40d5-9b98-87e9c2669609 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:53.504272 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718667b-04ff-40d5-9b98-87e9c2669609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:53.504590 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718667b-04ff-40d5-9b98-87e9c2669609 admin admin] PATH_INFO: `/v3/projects/d05c13274af443918db0e44148464e32/users/53a66212f9e84eac9e1e306415dd6249/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:53.520366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718667b-04ff-40d5-9b98-87e9c2669609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d05c13274af443918db0e44148464e32, user_id=53a66212f9e84eac9e1e306415dd6249, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:53.523080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718667b-04ff-40d5-9b98-87e9c2669609 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:53.563475 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1053/2087] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:53 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:53.564379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803320e-3fbd-4d32-8bea-c7fa4aa16b95 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:53.574286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803320e-3fbd-4d32-8bea-c7fa4aa16b95 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:53.579608 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18660105-e0e2-4c98-8403-06c2b5d35296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:53.580214 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18660105-e0e2-4c98-8403-06c2b5d35296 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:53.580530 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18660105-e0e2-4c98-8403-06c2b5d35296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:53.580806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18660105-e0e2-4c98-8403-06c2b5d35296 admin admin] PATH_INFO: `/v3/projects/51337c52b0834af886661bec64d74e04/users/87cd76d93a5940abba2d6dd1c3252954/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:53.582705 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18660105-e0e2-4c98-8403-06c2b5d35296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51337c52b0834af886661bec64d74e04, user_id=87cd76d93a5940abba2d6dd1c3252954, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:53.585374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18660105-e0e2-4c98-8403-06c2b5d35296 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:53.594070 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1035/2088] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:53 2022] PUT /identity/v3/projects/d05c13274af443918db0e44148464e32/users/53a66212f9e84eac9e1e306415dd6249/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:53.595644 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718667b-04ff-40d5-9b98-87e9c2669609 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:53.597902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1054/2089] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:53 2022] PUT /identity/v3/projects/51337c52b0834af886661bec64d74e04/users/87cd76d93a5940abba2d6dd1c3252954/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:53.607744 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfdee1-0b9b-4bac-924f-8da0795b0007 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:53.608007 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfdee1-0b9b-4bac-924f-8da0795b0007 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:53.608285 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfdee1-0b9b-4bac-924f-8da0795b0007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:53.635622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-48bfdee1-0b9b-4bac-924f-8da0795b0007 None None] MFA Rules not processed for user `53a66212f9e84eac9e1e306415dd6249`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:53.636815 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-48bfdee1-0b9b-4bac-924f-8da0795b0007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:53.660709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718667b-04ff-40d5-9b98-87e9c2669609 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:53.730069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1055/2090] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:53.734401 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa625be-1e05-4652-af34-b570fbce4da4 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:53.734693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa625be-1e05-4652-af34-b570fbce4da4 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:53.735219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa625be-1e05-4652-af34-b570fbce4da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:53.758251 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283727c1-da35-4b3e-855c-5e9c9f5d452c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:53.758958 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283727c1-da35-4b3e-855c-5e9c9f5d452c admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:53.759309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283727c1-da35-4b3e-855c-5e9c9f5d452c admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:53.759650 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283727c1-da35-4b3e-855c-5e9c9f5d452c admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:53.760396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283727c1-da35-4b3e-855c-5e9c9f5d452c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:53.762113 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283727c1-da35-4b3e-855c-5e9c9f5d452c admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:53.764637 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-efa625be-1e05-4652-af34-b570fbce4da4 None None] MFA Rules not processed for user `87cd76d93a5940abba2d6dd1c3252954`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:53.765626 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-efa625be-1e05-4652-af34-b570fbce4da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:53.777550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1036/2091] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:53.778595 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283727c1-da35-4b3e-855c-5e9c9f5d452c admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:53.791544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283727c1-da35-4b3e-855c-5e9c9f5d452c admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:53.805057 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a580e9c-dae7-407c-9fa7-c6f0a2fd108e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:53.805729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a580e9c-dae7-407c-9fa7-c6f0a2fd108e admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:53.806018 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a580e9c-dae7-407c-9fa7-c6f0a2fd108e admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:53.806296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a580e9c-dae7-407c-9fa7-c6f0a2fd108e admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:53.807114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a580e9c-dae7-407c-9fa7-c6f0a2fd108e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:53.811101 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a580e9c-dae7-407c-9fa7-c6f0a2fd108e admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:53.856883 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1056/2092] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:53.857788 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa625be-1e05-4652-af34-b570fbce4da4 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:53.872799 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa625be-1e05-4652-af34-b570fbce4da4 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:53.874006 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82328753-cb40-4739-a10e-a1ee30fe5875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:53.874621 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82328753-cb40-4739-a10e-a1ee30fe5875 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:53.874905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82328753-cb40-4739-a10e-a1ee30fe5875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:53.875174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82328753-cb40-4739-a10e-a1ee30fe5875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:53.876494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82328753-cb40-4739-a10e-a1ee30fe5875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:53.878911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82328753-cb40-4739-a10e-a1ee30fe5875 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:53.895211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1057/2093] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:53.895211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82328753-cb40-4739-a10e-a1ee30fe5875 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:53.895211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-82328753-cb40-4739-a10e-a1ee30fe5875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:53.942515 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1037/2094] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:53 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:53.943702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a580e9c-dae7-407c-9fa7-c6f0a2fd108e admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:53.952451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82328753-cb40-4739-a10e-a1ee30fe5875 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:54.000138 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fe80e-a5dd-436e-8f5b-065d2e6c7bcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:54.001287 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fe80e-a5dd-436e-8f5b-065d2e6c7bcd service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:54.001564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fe80e-a5dd-436e-8f5b-065d2e6c7bcd service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:54.001890 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fe80e-a5dd-436e-8f5b-065d2e6c7bcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:54.004518 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a580e9c-dae7-407c-9fa7-c6f0a2fd108e admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:54.009867 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72118f9b-c3f0-402d-b2c9-af4536cdbe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:54.012228 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72118f9b-c3f0-402d-b2c9-af4536cdbe43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:54.012228 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72118f9b-c3f0-402d-b2c9-af4536cdbe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:54.012228 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72118f9b-c3f0-402d-b2c9-af4536cdbe43 admin admin] PATH_INFO: `/v3/projects/b9b23b92fe4a4510be8a7c4921e0fc6b/users/a6507ed9a47848c29d72fd9af71e2cbc/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:54.028639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72118f9b-c3f0-402d-b2c9-af4536cdbe43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b23b92fe4a4510be8a7c4921e0fc6b, user_id=a6507ed9a47848c29d72fd9af71e2cbc, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:54.031600 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72118f9b-c3f0-402d-b2c9-af4536cdbe43 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:54.032593 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:54.065505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78fe80e-a5dd-436e-8f5b-065d2e6c7bcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:54.066929 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78fe80e-a5dd-436e-8f5b-065d2e6c7bcd service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:54.076511 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1058/2095] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:54.077266 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fe80e-a5dd-436e-8f5b-065d2e6c7bcd service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:54.088435 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fe80e-a5dd-436e-8f5b-065d2e6c7bcd service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:54.093510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033414c3-5dc1-4e92-9360-4de8ac00b5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:54.101656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033414c3-5dc1-4e92-9360-4de8ac00b5ca admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:54.101656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033414c3-5dc1-4e92-9360-4de8ac00b5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:54.101656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033414c3-5dc1-4e92-9360-4de8ac00b5ca admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:54.101656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033414c3-5dc1-4e92-9360-4de8ac00b5ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:54.101656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033414c3-5dc1-4e92-9360-4de8ac00b5ca admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:54.120092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1038/2096] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:53 2022] PUT /identity/v3/projects/b9b23b92fe4a4510be8a7c4921e0fc6b/users/a6507ed9a47848c29d72fd9af71e2cbc/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:54.125043 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ad0fd-5462-4a64-baf7-ef7961b3f8b1 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:54.125483 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ad0fd-5462-4a64-baf7-ef7961b3f8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:54.126379 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ad0fd-5462-4a64-baf7-ef7961b3f8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:54.150136 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-6f3ad0fd-5462-4a64-baf7-ef7961b3f8b1 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:54.152827 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:54.153749 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6f3ad0fd-5462-4a64-baf7-ef7961b3f8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:54.186763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1059/2097] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:54 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:54.189382 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033414c3-5dc1-4e92-9360-4de8ac00b5ca admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:54.201083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033414c3-5dc1-4e92-9360-4de8ac00b5ca admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:54.231142 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1039/2098] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:54.236732 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ad0fd-5462-4a64-baf7-ef7961b3f8b1 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:54.246505 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ad0fd-5462-4a64-baf7-ef7961b3f8b1 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:54.252012 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e928f-ccd7-4f85-a53a-96701a72acbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:54.252658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e928f-ccd7-4f85-a53a-96701a72acbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:54.259544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e928f-ccd7-4f85-a53a-96701a72acbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:54.259544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e928f-ccd7-4f85-a53a-96701a72acbf admin admin] PATH_INFO: `/v3/users/2d5a86c2b54648b196c3dc76bca761cc` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:54.259544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e928f-ccd7-4f85-a53a-96701a72acbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d5a86c2b54648b196c3dc76bca761cc)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:54.259544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e928f-ccd7-4f85-a53a-96701a72acbf admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:54.266977 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf238c30-a207-4a2e-8ce3-c960ac9b724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:54.267581 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf238c30-a207-4a2e-8ce3-c960ac9b724f admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:54.267856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf238c30-a207-4a2e-8ce3-c960ac9b724f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:54.268129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf238c30-a207-4a2e-8ce3-c960ac9b724f admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:54.268797 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf238c30-a207-4a2e-8ce3-c960ac9b724f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:54.270371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf238c30-a207-4a2e-8ce3-c960ac9b724f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:54.280386 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1060/2099] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:54.281213 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf238c30-a207-4a2e-8ce3-c960ac9b724f admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:54.282955 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-cf238c30-a207-4a2e-8ce3-c960ac9b724f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:54.339652 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf238c30-a207-4a2e-8ce3-c960ac9b724f admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:54.343651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0013c-bc08-4909-8083-3b9d0eece3d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:54.344269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0013c-bc08-4909-8083-3b9d0eece3d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:54.344587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0013c-bc08-4909-8083-3b9d0eece3d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:54.344863 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0013c-bc08-4909-8083-3b9d0eece3d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:54.354079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0013c-bc08-4909-8083-3b9d0eece3d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:54.355554 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0013c-bc08-4909-8083-3b9d0eece3d4 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:54.365989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1061/2100] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:54.366838 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0013c-bc08-4909-8083-3b9d0eece3d4 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:54.376471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0013c-bc08-4909-8083-3b9d0eece3d4 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:54.385196 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd5022-94af-4e1d-89a9-0188f55ce6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:54.386399 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd5022-94af-4e1d-89a9-0188f55ce6ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:54.386755 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd5022-94af-4e1d-89a9-0188f55ce6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:54.387109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd5022-94af-4e1d-89a9-0188f55ce6ba admin admin] PATH_INFO: `/v3/projects/3158dcfc832b4774912045bc8bb640b3/users/dd9dfe3ee8a44491af9f9aa0c1c666ac/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:54.402389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd5022-94af-4e1d-89a9-0188f55ce6ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3158dcfc832b4774912045bc8bb640b3, user_id=dd9dfe3ee8a44491af9f9aa0c1c666ac, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:54.405086 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd5022-94af-4e1d-89a9-0188f55ce6ba admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:54.468696 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-692e928f-ccd7-4f85-a53a-96701a72acbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d5a86c2b54648b196c3dc76bca761cc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:54.469463 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-692e928f-ccd7-4f85-a53a-96701a72acbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d5a86c2b54648b196c3dc76bca761cc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:54.481745 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-692e928f-ccd7-4f85-a53a-96701a72acbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d5a86c2b54648b196c3dc76bca761cc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:54.497429 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1062/2101] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:54 2022] PUT /identity/v3/projects/3158dcfc832b4774912045bc8bb640b3/users/dd9dfe3ee8a44491af9f9aa0c1c666ac/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:54.502067 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd5022-94af-4e1d-89a9-0188f55ce6ba admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:54.503820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-51fd5022-94af-4e1d-89a9-0188f55ce6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:54.565369 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:54.584464 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd5022-94af-4e1d-89a9-0188f55ce6ba admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:54.585317 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-692e928f-ccd7-4f85-a53a-96701a72acbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d5a86c2b54648b196c3dc76bca761cc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:54.585958 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-692e928f-ccd7-4f85-a53a-96701a72acbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d5a86c2b54648b196c3dc76bca761cc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:54.589674 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7380cfe-7df7-4f67-bf1e-c1b6ebbe58e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:54.592455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7380cfe-7df7-4f67-bf1e-c1b6ebbe58e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:54.592455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7380cfe-7df7-4f67-bf1e-c1b6ebbe58e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:54.592455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7380cfe-7df7-4f67-bf1e-c1b6ebbe58e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:54.592455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7380cfe-7df7-4f67-bf1e-c1b6ebbe58e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:54.593195 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7380cfe-7df7-4f67-bf1e-c1b6ebbe58e9 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:54.599433 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1040/2102] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:54 2022] DELETE /identity/v3/users/2d5a86c2b54648b196c3dc76bca761cc => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:37:54.603831 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b95f2-cb17-40e2-9f86-1a692cb9a49f None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:54.604122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b95f2-cb17-40e2-9f86-1a692cb9a49f None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:54.604432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b95f2-cb17-40e2-9f86-1a692cb9a49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:54.604613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1063/2103] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:37:54.608290 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7380cfe-7df7-4f67-bf1e-c1b6ebbe58e9 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:54.618678 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7380cfe-7df7-4f67-bf1e-c1b6ebbe58e9 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:54.624949 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-de8b95f2-cb17-40e2-9f86-1a692cb9a49f None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:54.626835 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-de8b95f2-cb17-40e2-9f86-1a692cb9a49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:54.638018 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:54.681675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82309c3b-7253-4478-9b20-442197d68134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:54.682333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82309c3b-7253-4478-9b20-442197d68134 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:54.682998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82309c3b-7253-4478-9b20-442197d68134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:54.682998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82309c3b-7253-4478-9b20-442197d68134 admin admin] PATH_INFO: `/v3/projects/3158dcfc832b4774912045bc8bb640b3/users/dd9dfe3ee8a44491af9f9aa0c1c666ac/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:54.684861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82309c3b-7253-4478-9b20-442197d68134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3158dcfc832b4774912045bc8bb640b3, user_id=dd9dfe3ee8a44491af9f9aa0c1c666ac, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:54.688802 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82309c3b-7253-4478-9b20-442197d68134 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:54.694892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1041/2104] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:54.704360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b95f2-cb17-40e2-9f86-1a692cb9a49f None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:54.705872 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-de8b95f2-cb17-40e2-9f86-1a692cb9a49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:54.710873 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1064/2105] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:54 2022] PUT /identity/v3/projects/3158dcfc832b4774912045bc8bb640b3/users/dd9dfe3ee8a44491af9f9aa0c1c666ac/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:37:54.720993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788bcbf-1334-442f-9964-a7ca3f102fb3 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:54.721403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788bcbf-1334-442f-9964-a7ca3f102fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:54.721800 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788bcbf-1334-442f-9964-a7ca3f102fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:54.756032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6788bcbf-1334-442f-9964-a7ca3f102fb3 None None] MFA Rules not processed for user `dd9dfe3ee8a44491af9f9aa0c1c666ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:54.757502 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6788bcbf-1334-442f-9964-a7ca3f102fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:54.785185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b95f2-cb17-40e2-9f86-1a692cb9a49f None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:54.854542 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374127dd-ba9a-4248-9bf5-0698f060e135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:54.855202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374127dd-ba9a-4248-9bf5-0698f060e135 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:54.855477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374127dd-ba9a-4248-9bf5-0698f060e135 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:54.855746 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374127dd-ba9a-4248-9bf5-0698f060e135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:54.870951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1065/2106] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:54.879392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788bcbf-1334-442f-9964-a7ca3f102fb3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:54.882940 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6788bcbf-1334-442f-9964-a7ca3f102fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:54.950837 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374127dd-ba9a-4248-9bf5-0698f060e135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:54.952442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374127dd-ba9a-4248-9bf5-0698f060e135 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:54.963547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1042/2107] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:54.968173 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788bcbf-1334-442f-9964-a7ca3f102fb3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:54.972369 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96625b64-7b56-4f6c-bf6b-5bb72f40adb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:54.972993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625b64-7b56-4f6c-bf6b-5bb72f40adb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:54.973273 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625b64-7b56-4f6c-bf6b-5bb72f40adb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:54.973544 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625b64-7b56-4f6c-bf6b-5bb72f40adb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:54.982143 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-96625b64-7b56-4f6c-bf6b-5bb72f40adb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:55.070511 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96625b64-7b56-4f6c-bf6b-5bb72f40adb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:55.071950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96625b64-7b56-4f6c-bf6b-5bb72f40adb2 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:55.080891 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1066/2108] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:37:55.181280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374127dd-ba9a-4248-9bf5-0698f060e135 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:55.181280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-374127dd-ba9a-4248-9bf5-0698f060e135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:55.209862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374127dd-ba9a-4248-9bf5-0698f060e135 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:55.219525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0057652-56a0-4569-87eb-3e46b4775189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:55.220415 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0057652-56a0-4569-87eb-3e46b4775189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:55.220808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0057652-56a0-4569-87eb-3e46b4775189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:55.221189 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0057652-56a0-4569-87eb-3e46b4775189 admin admin] PATH_INFO: `/v3/users/23ac6bcd7c0a49799498d83986191155` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:55.222486 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0057652-56a0-4569-87eb-3e46b4775189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ac6bcd7c0a49799498d83986191155)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:55.224692 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0057652-56a0-4569-87eb-3e46b4775189 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:55.323954 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:55.378056 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a0057652-56a0-4569-87eb-3e46b4775189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ac6bcd7c0a49799498d83986191155'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:55.378965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a0057652-56a0-4569-87eb-3e46b4775189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ac6bcd7c0a49799498d83986191155'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:55.388789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:55.393054 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a0057652-56a0-4569-87eb-3e46b4775189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ac6bcd7c0a49799498d83986191155'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:55.529175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a0057652-56a0-4569-87eb-3e46b4775189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ac6bcd7c0a49799498d83986191155'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:55.529933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a0057652-56a0-4569-87eb-3e46b4775189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ac6bcd7c0a49799498d83986191155'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:55.542276 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96625b64-7b56-4f6c-bf6b-5bb72f40adb2 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:55.544371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-96625b64-7b56-4f6c-bf6b-5bb72f40adb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:55.568251 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1043/2109] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:55 2022] DELETE /identity/v3/users/23ac6bcd7c0a49799498d83986191155 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:55.568622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96625b64-7b56-4f6c-bf6b-5bb72f40adb2 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:55.570537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd7594-6c36-4ec2-a317-dcd5377143b8 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:55.571372 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd7594-6c36-4ec2-a317-dcd5377143b8 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:55.571511 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd7594-6c36-4ec2-a317-dcd5377143b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:55.596867 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-1dcd7594-6c36-4ec2-a317-dcd5377143b8 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:55.611731 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-1dcd7594-6c36-4ec2-a317-dcd5377143b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:55.641409 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c73a53-6fc7-421f-a7d7-1036d2bd5f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:55.643102 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c73a53-6fc7-421f-a7d7-1036d2bd5f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:55.643534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c73a53-6fc7-421f-a7d7-1036d2bd5f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:55.643951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c73a53-6fc7-421f-a7d7-1036d2bd5f21 admin admin] PATH_INFO: `/v3/projects/1c4677f9c6bf4cf48399b2ea43b241d0` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:55.645286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c73a53-6fc7-421f-a7d7-1036d2bd5f21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c4677f9c6bf4cf48399b2ea43b241d0)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:55.647560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c73a53-6fc7-421f-a7d7-1036d2bd5f21 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:55.662893 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1044/2110] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:55.676392 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd7594-6c36-4ec2-a317-dcd5377143b8 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:55.677908 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-1dcd7594-6c36-4ec2-a317-dcd5377143b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:55.737873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd7594-6c36-4ec2-a317-dcd5377143b8 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:55.742079 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d7431-ddd7-4060-b5a4-936016b8ffd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:55.742688 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d7431-ddd7-4060-b5a4-936016b8ffd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:55.742997 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d7431-ddd7-4060-b5a4-936016b8ffd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:55.743268 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d7431-ddd7-4060-b5a4-936016b8ffd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:55.754013 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d7431-ddd7-4060-b5a4-936016b8ffd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:55.755692 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d7431-ddd7-4060-b5a4-936016b8ffd6 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:55.764557 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d4c73a53-6fc7-421f-a7d7-1036d2bd5f21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c4677f9c6bf4cf48399b2ea43b241d0', 'request_id': 'req-d4c73a53-6fc7-421f-a7d7-1036d2bd5f21'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:55.765411 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1045/2111] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:55.772106 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d4c73a53-6fc7-421f-a7d7-1036d2bd5f21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c4677f9c6bf4cf48399b2ea43b241d0', 'request_id': 'req-d4c73a53-6fc7-421f-a7d7-1036d2bd5f21'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:55.860927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d4c73a53-6fc7-421f-a7d7-1036d2bd5f21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c4677f9c6bf4cf48399b2ea43b241d0', 'request_id': 'req-d4c73a53-6fc7-421f-a7d7-1036d2bd5f21'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:55.872890 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d4c73a53-6fc7-421f-a7d7-1036d2bd5f21 admin admin] The token cache is being invalidate because project 1c4677f9c6bf4cf48399b2ea43b241d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:55.873307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d4c73a53-6fc7-421f-a7d7-1036d2bd5f21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:55.874072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d4c73a53-6fc7-421f-a7d7-1036d2bd5f21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:55.875722 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1067/2112] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:55 2022] DELETE /identity/v3/projects/1c4677f9c6bf4cf48399b2ea43b241d0 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:55.893493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d7431-ddd7-4060-b5a4-936016b8ffd6 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:55.893493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-d88d7431-ddd7-4060-b5a4-936016b8ffd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:55.909195 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d7431-ddd7-4060-b5a4-936016b8ffd6 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:55.970136 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:55.994423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b3aa2-9c16-419f-af34-7e63267f1dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:56.004744 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b3aa2-9c16-419f-af34-7e63267f1dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:56.004744 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b3aa2-9c16-419f-af34-7e63267f1dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:56.004744 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b3aa2-9c16-419f-af34-7e63267f1dec admin admin] PATH_INFO: `/v3/users/87cd76d93a5940abba2d6dd1c3252954` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:56.004744 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b3aa2-9c16-419f-af34-7e63267f1dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=87cd76d93a5940abba2d6dd1c3252954)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:56.004744 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b3aa2-9c16-419f-af34-7e63267f1dec admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:56.168443 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-071b3aa2-9c16-419f-af34-7e63267f1dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87cd76d93a5940abba2d6dd1c3252954'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:56.169132 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-071b3aa2-9c16-419f-af34-7e63267f1dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87cd76d93a5940abba2d6dd1c3252954'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:56.182830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-071b3aa2-9c16-419f-af34-7e63267f1dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87cd76d93a5940abba2d6dd1c3252954'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:56.203765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:56.254940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-071b3aa2-9c16-419f-af34-7e63267f1dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87cd76d93a5940abba2d6dd1c3252954'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:56.255675 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-071b3aa2-9c16-419f-af34-7e63267f1dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87cd76d93a5940abba2d6dd1c3252954'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:56.269057 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1046/2113] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:55 2022] DELETE /identity/v3/users/87cd76d93a5940abba2d6dd1c3252954 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:56.454411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c73a53-6fc7-421f-a7d7-1036d2bd5f21 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:56.456606 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d4c73a53-6fc7-421f-a7d7-1036d2bd5f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:56.473710 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c73a53-6fc7-421f-a7d7-1036d2bd5f21 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:56.572601 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fae54-f567-4fcf-ab6e-8aac4f96cbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:56.574512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fae54-f567-4fcf-ab6e-8aac4f96cbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:56.574512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fae54-f567-4fcf-ab6e-8aac4f96cbda admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:56.574512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fae54-f567-4fcf-ab6e-8aac4f96cbda admin admin] PATH_INFO: `/v3/projects/4af51cd2d3054cc5a94e5965a65d0dc7` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:56.576616 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fae54-f567-4fcf-ab6e-8aac4f96cbda admin admin] RBAC: Authorizing `identity:delete_project(project_id=4af51cd2d3054cc5a94e5965a65d0dc7)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:56.579347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fae54-f567-4fcf-ab6e-8aac4f96cbda admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:56.761963 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-182fae54-f567-4fcf-ab6e-8aac4f96cbda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4af51cd2d3054cc5a94e5965a65d0dc7', 'request_id': 'req-182fae54-f567-4fcf-ab6e-8aac4f96cbda'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:56.771879 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-182fae54-f567-4fcf-ab6e-8aac4f96cbda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4af51cd2d3054cc5a94e5965a65d0dc7', 'request_id': 'req-182fae54-f567-4fcf-ab6e-8aac4f96cbda'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:56.801455 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b3aa2-9c16-419f-af34-7e63267f1dec admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:56.803332 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-071b3aa2-9c16-419f-af34-7e63267f1dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:56.818395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b3aa2-9c16-419f-af34-7e63267f1dec admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:56.889606 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-182fae54-f567-4fcf-ab6e-8aac4f96cbda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4af51cd2d3054cc5a94e5965a65d0dc7', 'request_id': 'req-182fae54-f567-4fcf-ab6e-8aac4f96cbda'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:56.907928 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-182fae54-f567-4fcf-ab6e-8aac4f96cbda admin admin] The token cache is being invalidate because project 4af51cd2d3054cc5a94e5965a65d0dc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:56.908650 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-182fae54-f567-4fcf-ab6e-8aac4f96cbda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:56.910389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-182fae54-f567-4fcf-ab6e-8aac4f96cbda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:56.912993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1068/2114] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:56 2022] DELETE /identity/v3/projects/4af51cd2d3054cc5a94e5965a65d0dc7 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:37:56.916840 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fae54-f567-4fcf-ab6e-8aac4f96cbda admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:56.918487 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-182fae54-f567-4fcf-ab6e-8aac4f96cbda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:56.933259 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2ffa3-10c9-4b84-a689-7e2c61f5708f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:56.934152 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2ffa3-10c9-4b84-a689-7e2c61f5708f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:56.934441 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2ffa3-10c9-4b84-a689-7e2c61f5708f admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:56.934786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2ffa3-10c9-4b84-a689-7e2c61f5708f admin admin] PATH_INFO: `/v3/projects/51337c52b0834af886661bec64d74e04` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:56.939142 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2ffa3-10c9-4b84-a689-7e2c61f5708f admin admin] RBAC: Authorizing `identity:delete_project(project_id=51337c52b0834af886661bec64d74e04)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:56.940760 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2ffa3-10c9-4b84-a689-7e2c61f5708f admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:56.947715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fae54-f567-4fcf-ab6e-8aac4f96cbda admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:56.961430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dcc67-a22c-4c27-9d19-0728efcbdbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:56.968931 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dcc67-a22c-4c27-9d19-0728efcbdbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:56.968931 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dcc67-a22c-4c27-9d19-0728efcbdbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:56.968931 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dcc67-a22c-4c27-9d19-0728efcbdbb5 admin admin] PATH_INFO: `/v3/users/225686b27cbe449a881f71b328a832d8` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:56.968931 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dcc67-a22c-4c27-9d19-0728efcbdbb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=225686b27cbe449a881f71b328a832d8)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:56.968931 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dcc67-a22c-4c27-9d19-0728efcbdbb5 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:57.157979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:57.185502 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4cc2ffa3-10c9-4b84-a689-7e2c61f5708f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51337c52b0834af886661bec64d74e04', 'request_id': 'req-4cc2ffa3-10c9-4b84-a689-7e2c61f5708f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:57.187482 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0a3dcc67-a22c-4c27-9d19-0728efcbdbb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225686b27cbe449a881f71b328a832d8'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:57.195938 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4cc2ffa3-10c9-4b84-a689-7e2c61f5708f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51337c52b0834af886661bec64d74e04', 'request_id': 'req-4cc2ffa3-10c9-4b84-a689-7e2c61f5708f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:57.196155 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0a3dcc67-a22c-4c27-9d19-0728efcbdbb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225686b27cbe449a881f71b328a832d8'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:57.209782 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0a3dcc67-a22c-4c27-9d19-0728efcbdbb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225686b27cbe449a881f71b328a832d8'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:57.316786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4cc2ffa3-10c9-4b84-a689-7e2c61f5708f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51337c52b0834af886661bec64d74e04', 'request_id': 'req-4cc2ffa3-10c9-4b84-a689-7e2c61f5708f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:57.331764 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4cc2ffa3-10c9-4b84-a689-7e2c61f5708f admin admin] The token cache is being invalidate because project 51337c52b0834af886661bec64d74e04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:57.331764 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4cc2ffa3-10c9-4b84-a689-7e2c61f5708f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:57.332986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4cc2ffa3-10c9-4b84-a689-7e2c61f5708f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:57.341444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1047/2115] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:56 2022] DELETE /identity/v3/projects/51337c52b0834af886661bec64d74e04 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:57.351483 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2ffa3-10c9-4b84-a689-7e2c61f5708f admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:57.354327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4cc2ffa3-10c9-4b84-a689-7e2c61f5708f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:57.420974 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2ffa3-10c9-4b84-a689-7e2c61f5708f admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:57.425345 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc735ad-99f9-4e9c-9d17-c7ea2d2285fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:57.425960 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc735ad-99f9-4e9c-9d17-c7ea2d2285fc service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:57.426238 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc735ad-99f9-4e9c-9d17-c7ea2d2285fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:57.426511 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc735ad-99f9-4e9c-9d17-c7ea2d2285fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:57.428230 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-2dc735ad-99f9-4e9c-9d17-c7ea2d2285fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:57.455188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0a3dcc67-a22c-4c27-9d19-0728efcbdbb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225686b27cbe449a881f71b328a832d8'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:57.455925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0a3dcc67-a22c-4c27-9d19-0728efcbdbb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225686b27cbe449a881f71b328a832d8'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:57.472171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1069/2116] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:56 2022] DELETE /identity/v3/users/225686b27cbe449a881f71b328a832d8 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:57.473568 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea48ad-e885-44d6-9af3-cc6bb18439e4 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:57.474269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea48ad-e885-44d6-9af3-cc6bb18439e4 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:57.474269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea48ad-e885-44d6-9af3-cc6bb18439e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:57.504173 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-83ea48ad-e885-44d6-9af3-cc6bb18439e4 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:57.505434 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-83ea48ad-e885-44d6-9af3-cc6bb18439e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:57.507189 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc735ad-99f9-4e9c-9d17-c7ea2d2285fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:57.509173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc735ad-99f9-4e9c-9d17-c7ea2d2285fc service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:57.521734 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1048/2117] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:37:57.595562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1070/2118] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:57.602750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc99d7-a644-4390-adb8-6426aad385de None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:57.604150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc99d7-a644-4390-adb8-6426aad385de None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:57.604150 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc99d7-a644-4390-adb8-6426aad385de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:57.644463 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-65fc99d7-a644-4390-adb8-6426aad385de None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:57.645999 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-65fc99d7-a644-4390-adb8-6426aad385de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:57.668878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1049/2119] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:57.671292 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea48ad-e885-44d6-9af3-cc6bb18439e4 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:57.682565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:57.684821 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea48ad-e885-44d6-9af3-cc6bb18439e4 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:57.690218 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f8948-608c-4c57-92ef-303d97b66e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:57.690951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f8948-608c-4c57-92ef-303d97b66e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:57.691307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f8948-608c-4c57-92ef-303d97b66e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:57.691587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f8948-608c-4c57-92ef-303d97b66e05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:57.692296 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f8948-608c-4c57-92ef-303d97b66e05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:37:57.692649 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f8948-608c-4c57-92ef-303d97b66e05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:57.694284 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f8948-608c-4c57-92ef-303d97b66e05 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:57.713364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1071/2120] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:37:57.714810 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc99d7-a644-4390-adb8-6426aad385de None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:57.727938 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc99d7-a644-4390-adb8-6426aad385de None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:57.733999 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81cbef-0254-4a73-95f6-af7f510a85b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:57.735948 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81cbef-0254-4a73-95f6-af7f510a85b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:57.736237 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81cbef-0254-4a73-95f6-af7f510a85b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:57.736555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81cbef-0254-4a73-95f6-af7f510a85b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:57.737208 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81cbef-0254-4a73-95f6-af7f510a85b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:57.741315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81cbef-0254-4a73-95f6-af7f510a85b3 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:57.858869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1050/2121] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:57 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:57.863857 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f8948-608c-4c57-92ef-303d97b66e05 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:57.878589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f8948-608c-4c57-92ef-303d97b66e05 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:58.003346 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33febea8-f82a-4a47-b2f8-559ab81dd4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:58.004085 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33febea8-f82a-4a47-b2f8-559ab81dd4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:58.004507 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33febea8-f82a-4a47-b2f8-559ab81dd4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:58.004877 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33febea8-f82a-4a47-b2f8-559ab81dd4b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:58.005582 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33febea8-f82a-4a47-b2f8-559ab81dd4b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:58.007662 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33febea8-f82a-4a47-b2f8-559ab81dd4b3 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:58.105303 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1072/2122] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:57 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:58.105823 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81cbef-0254-4a73-95f6-af7f510a85b3 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:58.120886 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81cbef-0254-4a73-95f6-af7f510a85b3 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:58.128240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780cb31-2a95-45d4-a6f0-4a735f3748f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:58.129312 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780cb31-2a95-45d4-a6f0-4a735f3748f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:58.129779 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780cb31-2a95-45d4-a6f0-4a735f3748f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:58.131220 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780cb31-2a95-45d4-a6f0-4a735f3748f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:58.132082 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780cb31-2a95-45d4-a6f0-4a735f3748f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:58.135599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780cb31-2a95-45d4-a6f0-4a735f3748f7 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:58.148234 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1051/2123] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:37:58.153577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33febea8-f82a-4a47-b2f8-559ab81dd4b3 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:58.168293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780cb31-2a95-45d4-a6f0-4a735f3748f7 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:58.175036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-d780cb31-2a95-45d4-a6f0-4a735f3748f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:58.185302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33febea8-f82a-4a47-b2f8-559ab81dd4b3 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:58.192266 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780cb31-2a95-45d4-a6f0-4a735f3748f7 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:58.197064 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1568d-99de-43e3-bd31-6f507abe90f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:58.199306 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eaabdc-0ecc-4828-9257-ab8d6b3cbe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:58.199306 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaabdc-0ecc-4828-9257-ab8d6b3cbe3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:58.199306 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaabdc-0ecc-4828-9257-ab8d6b3cbe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:58.199591 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1568d-99de-43e3-bd31-6f507abe90f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:58.199668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaabdc-0ecc-4828-9257-ab8d6b3cbe3f admin admin] PATH_INFO: `/v3/projects/9e5fabfb769349c8a04301dc174ca0b3` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:58.199740 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1568d-99de-43e3-bd31-6f507abe90f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:58.200077 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1568d-99de-43e3-bd31-6f507abe90f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:58.200255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eaabdc-0ecc-4828-9257-ab8d6b3cbe3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e5fabfb769349c8a04301dc174ca0b3)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:58.201326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1568d-99de-43e3-bd31-6f507abe90f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:58.202409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eaabdc-0ecc-4828-9257-ab8d6b3cbe3f admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:58.205559 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1568d-99de-43e3-bd31-6f507abe90f7 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:58.237367 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1073/2124] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:58.239078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1568d-99de-43e3-bd31-6f507abe90f7 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:58.249757 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1568d-99de-43e3-bd31-6f507abe90f7 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:58.262659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501c0b4-0e5d-4ba8-95f4-268196f4fc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:58.268146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501c0b4-0e5d-4ba8-95f4-268196f4fc8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:58.268544 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501c0b4-0e5d-4ba8-95f4-268196f4fc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:58.268906 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501c0b4-0e5d-4ba8-95f4-268196f4fc8d admin admin] PATH_INFO: `/v3/projects/41c823a459994fac90a074f57fd511ff/users/523b74a471d34d34bb8693e63074085d/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:58.291642 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501c0b4-0e5d-4ba8-95f4-268196f4fc8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c823a459994fac90a074f57fd511ff, user_id=523b74a471d34d34bb8693e63074085d, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:58.295208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501c0b4-0e5d-4ba8-95f4-268196f4fc8d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:58.453279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1074/2125] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:58 2022] PUT /identity/v3/projects/41c823a459994fac90a074f57fd511ff/users/523b74a471d34d34bb8693e63074085d/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:58.465126 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d06b89-7603-426b-bc29-8319083c9a56 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:58.465313 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d06b89-7603-426b-bc29-8319083c9a56 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:58.466161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d06b89-7603-426b-bc29-8319083c9a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:58.469286 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-88eaabdc-0ecc-4828-9257-ab8d6b3cbe3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e5fabfb769349c8a04301dc174ca0b3', 'request_id': 'req-88eaabdc-0ecc-4828-9257-ab8d6b3cbe3f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:58.476630 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-88eaabdc-0ecc-4828-9257-ab8d6b3cbe3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e5fabfb769349c8a04301dc174ca0b3', 'request_id': 'req-88eaabdc-0ecc-4828-9257-ab8d6b3cbe3f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:58.496532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-25d06b89-7603-426b-bc29-8319083c9a56 None None] MFA Rules not processed for user `523b74a471d34d34bb8693e63074085d`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:58.497876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-25d06b89-7603-426b-bc29-8319083c9a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:58.546749 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-88eaabdc-0ecc-4828-9257-ab8d6b3cbe3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e5fabfb769349c8a04301dc174ca0b3', 'request_id': 'req-88eaabdc-0ecc-4828-9257-ab8d6b3cbe3f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:58.562458 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-88eaabdc-0ecc-4828-9257-ab8d6b3cbe3f admin admin] The token cache is being invalidate because project 9e5fabfb769349c8a04301dc174ca0b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:37:58.562749 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-88eaabdc-0ecc-4828-9257-ab8d6b3cbe3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:58.563941 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-88eaabdc-0ecc-4828-9257-ab8d6b3cbe3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:58.566050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1052/2126] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:37:58 2022] DELETE /identity/v3/projects/9e5fabfb769349c8a04301dc174ca0b3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:58.570978 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8bc4e-490a-46e1-8f1b-b64cb329f285 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:58.571252 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8bc4e-490a-46e1-8f1b-b64cb329f285 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:58.573097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8bc4e-490a-46e1-8f1b-b64cb329f285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:58.598016 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-95e8bc4e-490a-46e1-8f1b-b64cb329f285 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:58.599229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-95e8bc4e-490a-46e1-8f1b-b64cb329f285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:58.613176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1075/2127] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:58.623837 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d06b89-7603-426b-bc29-8319083c9a56 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:58.627441 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-25d06b89-7603-426b-bc29-8319083c9a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:58.665441 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1053/2128] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:58.672988 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe5d82-4481-428e-9ee6-27ed7a28e314 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:58.673271 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe5d82-4481-428e-9ee6-27ed7a28e314 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:58.673547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe5d82-4481-428e-9ee6-27ed7a28e314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:58.690149 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d06b89-7603-426b-bc29-8319083c9a56 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:58.694076 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcaf31-fa5d-4a56-9105-abd756ed4bc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:58.694783 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcaf31-fa5d-4a56-9105-abd756ed4bc4 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:58.695125 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcaf31-fa5d-4a56-9105-abd756ed4bc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:58.695470 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcaf31-fa5d-4a56-9105-abd756ed4bc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:58.696953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-8afe5d82-4481-428e-9ee6-27ed7a28e314 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:58.698626 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-8afe5d82-4481-428e-9ee6-27ed7a28e314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:58.707249 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcaf31-fa5d-4a56-9105-abd756ed4bc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:58.709025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcaf31-fa5d-4a56-9105-abd756ed4bc4 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:58.718980 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1054/2130] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:37:58.719153 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1076/2130] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:37:58.722797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe5d82-4481-428e-9ee6-27ed7a28e314 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:58.732631 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe5d82-4481-428e-9ee6-27ed7a28e314 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:58.738288 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e134c9-3797-4644-af8b-6ec9373d7fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:58.738896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e134c9-3797-4644-af8b-6ec9373d7fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:58.741416 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e134c9-3797-4644-af8b-6ec9373d7fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:58.741416 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e134c9-3797-4644-af8b-6ec9373d7fe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:58.741416 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e134c9-3797-4644-af8b-6ec9373d7fe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:37:58.741416 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e134c9-3797-4644-af8b-6ec9373d7fe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:58.742245 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e134c9-3797-4644-af8b-6ec9373d7fe2 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:58.756046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1055/2131] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:37:58.760208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcaf31-fa5d-4a56-9105-abd756ed4bc4 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:58.772057 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcaf31-fa5d-4a56-9105-abd756ed4bc4 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:58.777137 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd765539-55f5-47ac-a3e4-fb7059fac381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:58.777842 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd765539-55f5-47ac-a3e4-fb7059fac381 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:58.778227 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd765539-55f5-47ac-a3e4-fb7059fac381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:58.778604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd765539-55f5-47ac-a3e4-fb7059fac381 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:58.779344 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd765539-55f5-47ac-a3e4-fb7059fac381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:58.781549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd765539-55f5-47ac-a3e4-fb7059fac381 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:58.818244 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e134c9-3797-4644-af8b-6ec9373d7fe2 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:58.820000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-47e134c9-3797-4644-af8b-6ec9373d7fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:58.843932 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e134c9-3797-4644-af8b-6ec9373d7fe2 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:58.851189 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d437e0e-d5ef-4e51-bd98-1c4ef232d519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:58.851926 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d437e0e-d5ef-4e51-bd98-1c4ef232d519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:58.852302 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d437e0e-d5ef-4e51-bd98-1c4ef232d519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:58.852702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d437e0e-d5ef-4e51-bd98-1c4ef232d519 admin admin] PATH_INFO: `/v3/users/350c036bd5b84948976326f1f31c0d85` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:58.854131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d437e0e-d5ef-4e51-bd98-1c4ef232d519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=350c036bd5b84948976326f1f31c0d85)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:58.856486 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d437e0e-d5ef-4e51-bd98-1c4ef232d519 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:58.870997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1077/2132] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:37:58 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:37:58.874998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd765539-55f5-47ac-a3e4-fb7059fac381 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:58.978589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd765539-55f5-47ac-a3e4-fb7059fac381 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:58.983765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078cd35-74ee-4bdc-8fe6-410d8f706196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:58.984353 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078cd35-74ee-4bdc-8fe6-410d8f706196 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:58.984671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078cd35-74ee-4bdc-8fe6-410d8f706196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:58.984942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078cd35-74ee-4bdc-8fe6-410d8f706196 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:58.986229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078cd35-74ee-4bdc-8fe6-410d8f706196 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:58.988244 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078cd35-74ee-4bdc-8fe6-410d8f706196 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:59.060034 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-8d437e0e-d5ef-4e51-bd98-1c4ef232d519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '350c036bd5b84948976326f1f31c0d85'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:59.061316 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-8d437e0e-d5ef-4e51-bd98-1c4ef232d519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '350c036bd5b84948976326f1f31c0d85'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:59.078736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1078/2133] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:37:58 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:37:59.083501 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078cd35-74ee-4bdc-8fe6-410d8f706196 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:59.084987 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5078cd35-74ee-4bdc-8fe6-410d8f706196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:59.092752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-8d437e0e-d5ef-4e51-bd98-1c4ef232d519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '350c036bd5b84948976326f1f31c0d85'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:59.112604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078cd35-74ee-4bdc-8fe6-410d8f706196 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:59.117356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f8fe9-2a1a-48a0-ba6b-818f34f2dfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:59.117991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f8fe9-2a1a-48a0-ba6b-818f34f2dfc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:59.118271 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f8fe9-2a1a-48a0-ba6b-818f34f2dfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:59.118545 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f8fe9-2a1a-48a0-ba6b-818f34f2dfc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:59.119192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f8fe9-2a1a-48a0-ba6b-818f34f2dfc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:59.120942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f8fe9-2a1a-48a0-ba6b-818f34f2dfc7 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:59.132514 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1079/2134] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:37:59.136483 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f8fe9-2a1a-48a0-ba6b-818f34f2dfc7 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:59.148549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f8fe9-2a1a-48a0-ba6b-818f34f2dfc7 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:59.154699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab8a46-2c0f-49ba-aef8-11ee2d028861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:59.155383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab8a46-2c0f-49ba-aef8-11ee2d028861 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:59.155760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab8a46-2c0f-49ba-aef8-11ee2d028861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:59.156155 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab8a46-2c0f-49ba-aef8-11ee2d028861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:59.157604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab8a46-2c0f-49ba-aef8-11ee2d028861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:59.159282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab8a46-2c0f-49ba-aef8-11ee2d028861 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:59.170628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-8d437e0e-d5ef-4e51-bd98-1c4ef232d519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '350c036bd5b84948976326f1f31c0d85'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:59.172138 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-8d437e0e-d5ef-4e51-bd98-1c4ef232d519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '350c036bd5b84948976326f1f31c0d85'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:37:59.194227 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1080/2135] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:37:59.195793 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab8a46-2c0f-49ba-aef8-11ee2d028861 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:59.207062 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1056/2136] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:37:58 2022] DELETE /identity/v3/users/350c036bd5b84948976326f1f31c0d85 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:59.208685 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30801342-db0a-4fef-868b-30cc0b59d476 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:59.210287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30801342-db0a-4fef-868b-30cc0b59d476 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:59.210646 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30801342-db0a-4fef-868b-30cc0b59d476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:59.218924 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab8a46-2c0f-49ba-aef8-11ee2d028861 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:59.268978 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-30801342-db0a-4fef-868b-30cc0b59d476 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:59.268978 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-30801342-db0a-4fef-868b-30cc0b59d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:59.291511 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:59.401163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994dde3-f4e0-4001-87fa-b7d0a47b414e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:59.401857 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994dde3-f4e0-4001-87fa-b7d0a47b414e admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:59.402144 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994dde3-f4e0-4001-87fa-b7d0a47b414e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:59.402492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994dde3-f4e0-4001-87fa-b7d0a47b414e admin admin] PATH_INFO: `/v3/projects/63a2ffbe172944a3bfa066f473a1f8da/users/e44163744d2b432e847517c746e3a7a1/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:59.420047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1057/2137] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:59.424433 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30801342-db0a-4fef-868b-30cc0b59d476 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:59.424433 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-30801342-db0a-4fef-868b-30cc0b59d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:59.431699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994dde3-f4e0-4001-87fa-b7d0a47b414e admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a2ffbe172944a3bfa066f473a1f8da, user_id=e44163744d2b432e847517c746e3a7a1, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:59.434420 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994dde3-f4e0-4001-87fa-b7d0a47b414e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:59.502608 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30801342-db0a-4fef-868b-30cc0b59d476 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:59.515439 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1081/2138] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:37:59 2022] PUT /identity/v3/projects/63a2ffbe172944a3bfa066f473a1f8da/users/e44163744d2b432e847517c746e3a7a1/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:37:59.525102 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994dde3-f4e0-4001-87fa-b7d0a47b414e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:59.526755 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6994dde3-f4e0-4001-87fa-b7d0a47b414e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:59.579914 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:59.593188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe507f22-a36c-4d5a-85b7-0230e6e1f3e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:59.593817 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe507f22-a36c-4d5a-85b7-0230e6e1f3e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:59.594112 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe507f22-a36c-4d5a-85b7-0230e6e1f3e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:59.594369 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe507f22-a36c-4d5a-85b7-0230e6e1f3e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:59.596264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-fe507f22-a36c-4d5a-85b7-0230e6e1f3e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:59.682676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe507f22-a36c-4d5a-85b7-0230e6e1f3e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:59.685648 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe507f22-a36c-4d5a-85b7-0230e6e1f3e4 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:59.693959 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994dde3-f4e0-4001-87fa-b7d0a47b414e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:59.707131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7140bfa-60d9-4592-a0b0-f094b9eb77fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:59.707765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7140bfa-60d9-4592-a0b0-f094b9eb77fe service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:59.708045 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7140bfa-60d9-4592-a0b0-f094b9eb77fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:59.708319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7140bfa-60d9-4592-a0b0-f094b9eb77fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:59.711033 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1058/2139] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:59.713209 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778d42b-471e-40c2-9a7c-e65122a34b02 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:59.715399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778d42b-471e-40c2-9a7c-e65122a34b02 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:59.716178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778d42b-471e-40c2-9a7c-e65122a34b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:59.788939 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-b778d42b-471e-40c2-9a7c-e65122a34b02 None None] MFA Rules not processed for user `e44163744d2b432e847517c746e3a7a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:37:59.794535 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b778d42b-471e-40c2-9a7c-e65122a34b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:59.854914 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7140bfa-60d9-4592-a0b0-f094b9eb77fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:59.860832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7140bfa-60d9-4592-a0b0-f094b9eb77fe service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:59.898590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1082/2140] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:37:59.900258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1059/2141] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:37:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:37:59.912903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7140bfa-60d9-4592-a0b0-f094b9eb77fe service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:37:59.914569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b7140bfa-60d9-4592-a0b0-f094b9eb77fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:37:59.933867 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7140bfa-60d9-4592-a0b0-f094b9eb77fe service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:37:59.939009 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646bc6be-bdb4-4b52-9c33-6eb7f78122b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:37:59.946631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bc6be-bdb4-4b52-9c33-6eb7f78122b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:37:59.946631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bc6be-bdb4-4b52-9c33-6eb7f78122b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:37:59.946631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bc6be-bdb4-4b52-9c33-6eb7f78122b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:37:59.953187 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646bc6be-bdb4-4b52-9c33-6eb7f78122b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:37:59.955027 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646bc6be-bdb4-4b52-9c33-6eb7f78122b6 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:37:59.968961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1083/2142] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:37:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:38:00.503125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778d42b-471e-40c2-9a7c-e65122a34b02 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:00.504851 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b778d42b-471e-40c2-9a7c-e65122a34b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:00.524485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778d42b-471e-40c2-9a7c-e65122a34b02 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:00.529873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28866f7a-684b-4799-9e21-57099b301119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:00.532699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28866f7a-684b-4799-9e21-57099b301119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:00.532699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28866f7a-684b-4799-9e21-57099b301119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:00.532699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28866f7a-684b-4799-9e21-57099b301119 admin admin] PATH_INFO: `/v3/projects/49652cfbaac5480e9406598d39984e47` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:00.533166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28866f7a-684b-4799-9e21-57099b301119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49652cfbaac5480e9406598d39984e47)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:00.535115 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28866f7a-684b-4799-9e21-57099b301119 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:00.758782 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-28866f7a-684b-4799-9e21-57099b301119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49652cfbaac5480e9406598d39984e47', 'request_id': 'req-28866f7a-684b-4799-9e21-57099b301119'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:00.765669 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-28866f7a-684b-4799-9e21-57099b301119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49652cfbaac5480e9406598d39984e47', 'request_id': 'req-28866f7a-684b-4799-9e21-57099b301119'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:00.907541 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-28866f7a-684b-4799-9e21-57099b301119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49652cfbaac5480e9406598d39984e47', 'request_id': 'req-28866f7a-684b-4799-9e21-57099b301119'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:00.923916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-28866f7a-684b-4799-9e21-57099b301119 admin admin] The token cache is being invalidate because project 49652cfbaac5480e9406598d39984e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:38:00.924260 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-28866f7a-684b-4799-9e21-57099b301119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:00.925043 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-28866f7a-684b-4799-9e21-57099b301119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:00.926692 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1060/2143] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:38:00 2022] DELETE /identity/v3/projects/49652cfbaac5480e9406598d39984e47 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:00.932142 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67645635-05ae-426e-86a2-e714140c25af None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:00.932660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67645635-05ae-426e-86a2-e714140c25af None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:00.932967 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67645635-05ae-426e-86a2-e714140c25af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:00.958402 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-67645635-05ae-426e-86a2-e714140c25af None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:00.959853 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-67645635-05ae-426e-86a2-e714140c25af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:01.077768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1084/2144] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:01.094561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239667bb-f569-4813-86a7-82314f29e499 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:01.095261 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239667bb-f569-4813-86a7-82314f29e499 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:01.095742 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239667bb-f569-4813-86a7-82314f29e499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:01.170612 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-239667bb-f569-4813-86a7-82314f29e499 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:01.173102 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-239667bb-f569-4813-86a7-82314f29e499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:01.190587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67645635-05ae-426e-86a2-e714140c25af None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:01.195766 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1061/2145] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:01.202311 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67645635-05ae-426e-86a2-e714140c25af None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:01.212480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4b719-be91-4226-9b06-8284bbec9f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:01.213216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4b719-be91-4226-9b06-8284bbec9f0d admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:01.213510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4b719-be91-4226-9b06-8284bbec9f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:01.213799 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4b719-be91-4226-9b06-8284bbec9f0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:01.214456 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4b719-be91-4226-9b06-8284bbec9f0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:38:01.214766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4b719-be91-4226-9b06-8284bbec9f0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:01.225398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4b719-be91-4226-9b06-8284bbec9f0d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:01.248777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1085/2146] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:38:01.252947 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239667bb-f569-4813-86a7-82314f29e499 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:01.272899 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:01.281331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239667bb-f569-4813-86a7-82314f29e499 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:01.303127 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d298495-e263-4908-99c4-346955af38d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:01.305386 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d298495-e263-4908-99c4-346955af38d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:01.308580 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d298495-e263-4908-99c4-346955af38d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:01.309007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d298495-e263-4908-99c4-346955af38d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:01.309903 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d298495-e263-4908-99c4-346955af38d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:01.312132 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d298495-e263-4908-99c4-346955af38d6 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:01.425522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c253d-5924-4cf7-b023-1cf58c65530b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:01.425522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c253d-5924-4cf7-b023-1cf58c65530b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:01.425522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c253d-5924-4cf7-b023-1cf58c65530b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:01.430675 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1062/2147] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:38:01 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:38:01.434749 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d298495-e263-4908-99c4-346955af38d6 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:01.480116 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-7f0c253d-5924-4cf7-b023-1cf58c65530b None None] MFA Rules not processed for user `a6507ed9a47848c29d72fd9af71e2cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:01.481413 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7f0c253d-5924-4cf7-b023-1cf58c65530b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:01.509167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d298495-e263-4908-99c4-346955af38d6 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:01.514570 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffca54d-2667-495a-846a-cfdeccd6400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:01.515481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffca54d-2667-495a-846a-cfdeccd6400f admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:01.515863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffca54d-2667-495a-846a-cfdeccd6400f admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:01.516843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffca54d-2667-495a-846a-cfdeccd6400f admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:01.517118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffca54d-2667-495a-846a-cfdeccd6400f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:01.519975 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffca54d-2667-495a-846a-cfdeccd6400f admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:01.557728 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1086/2148] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:01.574578 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:01.574723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c253d-5924-4cf7-b023-1cf58c65530b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:01.574723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7f0c253d-5924-4cf7-b023-1cf58c65530b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:01.615711 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1063/2149] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:38:01 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:38:01.619852 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffca54d-2667-495a-846a-cfdeccd6400f admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:01.630138 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffca54d-2667-495a-846a-cfdeccd6400f admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:01.635105 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1e5fb-f642-4a84-9815-d398c6186db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:01.635722 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1e5fb-f642-4a84-9815-d398c6186db7 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:01.636050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1e5fb-f642-4a84-9815-d398c6186db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:01.636392 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1e5fb-f642-4a84-9815-d398c6186db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:01.639678 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1e5fb-f642-4a84-9815-d398c6186db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:01.641788 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1e5fb-f642-4a84-9815-d398c6186db7 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:01.658795 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1064/2150] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:38:01.661273 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1e5fb-f642-4a84-9815-d398c6186db7 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:01.671978 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1e5fb-f642-4a84-9815-d398c6186db7 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:01.673983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c253d-5924-4cf7-b023-1cf58c65530b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:01.677329 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed15386-1a34-4d56-92eb-c2415d93c9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:01.678168 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed15386-1a34-4d56-92eb-c2415d93c9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:01.689252 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed15386-1a34-4d56-92eb-c2415d93c9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:01.689252 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed15386-1a34-4d56-92eb-c2415d93c9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:01.689252 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed15386-1a34-4d56-92eb-c2415d93c9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:01.689252 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed15386-1a34-4d56-92eb-c2415d93c9a9 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:01.694667 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1065/2151] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:38:01.695598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6308dc-b65c-4d82-8a2b-3cbc3a1ddbd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:01.696506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6308dc-b65c-4d82-8a2b-3cbc3a1ddbd8 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:01.697335 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6308dc-b65c-4d82-8a2b-3cbc3a1ddbd8 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:01.698400 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6308dc-b65c-4d82-8a2b-3cbc3a1ddbd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:01.698886 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed15386-1a34-4d56-92eb-c2415d93c9a9 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:01.709022 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed15386-1a34-4d56-92eb-c2415d93c9a9 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:01.715046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6308dc-b65c-4d82-8a2b-3cbc3a1ddbd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:01.715232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dc79b-d88d-4151-be00-eda6d07e5ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:01.715801 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dc79b-d88d-4151-be00-eda6d07e5ece admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:01.716078 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dc79b-d88d-4151-be00-eda6d07e5ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:01.716364 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dc79b-d88d-4151-be00-eda6d07e5ece admin admin] PATH_INFO: `/v3/projects/fe3d99adaee942b1857efa2c91763a9f/users/e9325124701349bb83178470caf79ea3/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:01.717260 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6308dc-b65c-4d82-8a2b-3cbc3a1ddbd8 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:01.728072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1087/2152] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:38:01.738703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dc79b-d88d-4151-be00-eda6d07e5ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3d99adaee942b1857efa2c91763a9f, user_id=e9325124701349bb83178470caf79ea3, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:01.741502 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dc79b-d88d-4151-be00-eda6d07e5ece admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:01.858876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1066/2153] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:38:01 2022] PUT /identity/v3/projects/fe3d99adaee942b1857efa2c91763a9f/users/e9325124701349bb83178470caf79ea3/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:38:01.875368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addc9f1-80c3-44eb-aedb-0950bc482905 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:01.876421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addc9f1-80c3-44eb-aedb-0950bc482905 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:01.876839 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addc9f1-80c3-44eb-aedb-0950bc482905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:01.921247 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-7addc9f1-80c3-44eb-aedb-0950bc482905 None None] MFA Rules not processed for user `e9325124701349bb83178470caf79ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:01.923074 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7addc9f1-80c3-44eb-aedb-0950bc482905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:02.041027 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1088/2154] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:02.045305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dc79b-d88d-4151-be00-eda6d07e5ece admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:02.129151 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dc79b-d88d-4151-be00-eda6d07e5ece admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:02.133857 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2457af-b6c0-4a27-a969-a287e3c74318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:02.134462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2457af-b6c0-4a27-a969-a287e3c74318 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:02.134741 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2457af-b6c0-4a27-a969-a287e3c74318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:02.135014 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2457af-b6c0-4a27-a969-a287e3c74318 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:02.135671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2457af-b6c0-4a27-a969-a287e3c74318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:02.137595 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2457af-b6c0-4a27-a969-a287e3c74318 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:02.301619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1067/2155] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:38:02 2022] POST /identity/v3/projects => generated 385 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:38:02.302331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addc9f1-80c3-44eb-aedb-0950bc482905 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:02.315877 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addc9f1-80c3-44eb-aedb-0950bc482905 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:02.382910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241669d8-8282-45c5-8250-73e7dcc44419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:02.383517 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241669d8-8282-45c5-8250-73e7dcc44419 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:02.383794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241669d8-8282-45c5-8250-73e7dcc44419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:02.384065 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241669d8-8282-45c5-8250-73e7dcc44419 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:02.384831 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241669d8-8282-45c5-8250-73e7dcc44419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:02.386826 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241669d8-8282-45c5-8250-73e7dcc44419 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:02.511283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1089/2156] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:38:02 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:38:02.515289 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2457af-b6c0-4a27-a969-a287e3c74318 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:02.526039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2457af-b6c0-4a27-a969-a287e3c74318 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:02.531462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ab8c4-6e2e-457d-89f1-569be76e42d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:02.532947 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ab8c4-6e2e-457d-89f1-569be76e42d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:02.533936 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ab8c4-6e2e-457d-89f1-569be76e42d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:02.534427 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ab8c4-6e2e-457d-89f1-569be76e42d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:02.537896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ab8c4-6e2e-457d-89f1-569be76e42d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:02.538468 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ab8c4-6e2e-457d-89f1-569be76e42d3 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:02.553976 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1068/2157] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:38:02.558261 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241669d8-8282-45c5-8250-73e7dcc44419 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:02.568986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241669d8-8282-45c5-8250-73e7dcc44419 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:02.573812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b385d2a-ec14-40ec-9216-81fa89361d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:02.574442 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b385d2a-ec14-40ec-9216-81fa89361d19 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:02.574750 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b385d2a-ec14-40ec-9216-81fa89361d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:02.575024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b385d2a-ec14-40ec-9216-81fa89361d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:02.575664 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b385d2a-ec14-40ec-9216-81fa89361d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:02.577284 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b385d2a-ec14-40ec-9216-81fa89361d19 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:02.587900 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1090/2158] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:38:02.592213 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ab8c4-6e2e-457d-89f1-569be76e42d3 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:02.604480 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ab8c4-6e2e-457d-89f1-569be76e42d3 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:02.609274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f5977-f54d-44f1-845c-86d99fc781b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:02.610050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f5977-f54d-44f1-845c-86d99fc781b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:02.610413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f5977-f54d-44f1-845c-86d99fc781b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:02.610755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f5977-f54d-44f1-845c-86d99fc781b0 admin admin] PATH_INFO: `/v3/projects/f139f12c1496486484815d5471ba5754/users/b02fc332b4114ed6b359018edc2a0250/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:02.627204 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f5977-f54d-44f1-845c-86d99fc781b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f139f12c1496486484815d5471ba5754, user_id=b02fc332b4114ed6b359018edc2a0250, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:02.629916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f5977-f54d-44f1-845c-86d99fc781b0 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:02.725006 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1069/2159] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:38:02 2022] PUT /identity/v3/projects/f139f12c1496486484815d5471ba5754/users/b02fc332b4114ed6b359018edc2a0250/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:02.735918 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05077cd5-084d-480f-b3a2-1c9e3b6beac9 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:02.736208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05077cd5-084d-480f-b3a2-1c9e3b6beac9 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:02.736524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05077cd5-084d-480f-b3a2-1c9e3b6beac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:02.771113 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-05077cd5-084d-480f-b3a2-1c9e3b6beac9 None None] MFA Rules not processed for user `b02fc332b4114ed6b359018edc2a0250`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:02.772380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-05077cd5-084d-480f-b3a2-1c9e3b6beac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:02.871476 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1091/2160] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:38:02.876696 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f5977-f54d-44f1-845c-86d99fc781b0 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:02.938466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f5977-f54d-44f1-845c-86d99fc781b0 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:02.943370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bae2dd-4b36-43e9-aabf-4e63afe83497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:02.944020 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bae2dd-4b36-43e9-aabf-4e63afe83497 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:02.944275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bae2dd-4b36-43e9-aabf-4e63afe83497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:02.944574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bae2dd-4b36-43e9-aabf-4e63afe83497 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:02.945219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bae2dd-4b36-43e9-aabf-4e63afe83497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:02.947132 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bae2dd-4b36-43e9-aabf-4e63afe83497 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:03.072860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1070/2161] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:38:02 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:38:03.073363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05077cd5-084d-480f-b3a2-1c9e3b6beac9 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:03.076547 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05077cd5-084d-480f-b3a2-1c9e3b6beac9 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:03.162165 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faf053-5268-460e-9058-252b829000b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:03.162776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faf053-5268-460e-9058-252b829000b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:03.163048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faf053-5268-460e-9058-252b829000b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:03.163319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faf053-5268-460e-9058-252b829000b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:03.163945 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99faf053-5268-460e-9058-252b829000b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:03.165908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99faf053-5268-460e-9058-252b829000b8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:03.287504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1092/2162] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:38:03 2022] POST /identity/v3/users => generated 299 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:38:03.291723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bae2dd-4b36-43e9-aabf-4e63afe83497 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:03.303248 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bae2dd-4b36-43e9-aabf-4e63afe83497 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:03.309451 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7af94-81a2-4788-92ff-93585c7f4af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:03.310069 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7af94-81a2-4788-92ff-93585c7f4af0 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:03.310347 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7af94-81a2-4788-92ff-93585c7f4af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:03.310618 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7af94-81a2-4788-92ff-93585c7f4af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:03.311344 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7af94-81a2-4788-92ff-93585c7f4af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:03.313016 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7af94-81a2-4788-92ff-93585c7f4af0 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:03.326082 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1071/2163] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:38:03.330737 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faf053-5268-460e-9058-252b829000b8 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:03.342139 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faf053-5268-460e-9058-252b829000b8 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:03.348825 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8a4cf-93ec-4375-ba94-3644b568b6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:03.349969 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8a4cf-93ec-4375-ba94-3644b568b6dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:03.350574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8a4cf-93ec-4375-ba94-3644b568b6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:03.351083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8a4cf-93ec-4375-ba94-3644b568b6dd admin admin] PATH_INFO: `/v3/projects/7cee9d08a76d4944bb22a87b2ec7b22d/users/f881a32a733c4e089f228efcc90c4bff/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:03.371253 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8a4cf-93ec-4375-ba94-3644b568b6dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cee9d08a76d4944bb22a87b2ec7b22d, user_id=f881a32a733c4e089f228efcc90c4bff, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:03.374123 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8a4cf-93ec-4375-ba94-3644b568b6dd admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:03.462000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1093/2164] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:38:03 2022] PUT /identity/v3/projects/7cee9d08a76d4944bb22a87b2ec7b22d/users/f881a32a733c4e089f228efcc90c4bff/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:03.465829 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7af94-81a2-4788-92ff-93585c7f4af0 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:03.480831 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7af94-81a2-4788-92ff-93585c7f4af0 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:03.577569 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fe49b-5442-44a0-9b92-d1ec0d90a8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:03.579658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fe49b-5442-44a0-9b92-d1ec0d90a8bc admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:03.579658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fe49b-5442-44a0-9b92-d1ec0d90a8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:03.579658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fe49b-5442-44a0-9b92-d1ec0d90a8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:03.580051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fe49b-5442-44a0-9b92-d1ec0d90a8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:03.581695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fe49b-5442-44a0-9b92-d1ec0d90a8bc admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:03.592540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1072/2165] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:38:03.597604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8a4cf-93ec-4375-ba94-3644b568b6dd admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:03.611987 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8a4cf-93ec-4375-ba94-3644b568b6dd admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:03.630248 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27b99b-13db-4038-b9a8-3b6d57b20f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:03.631665 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27b99b-13db-4038-b9a8-3b6d57b20f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:03.632006 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27b99b-13db-4038-b9a8-3b6d57b20f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:03.632295 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27b99b-13db-4038-b9a8-3b6d57b20f53 admin admin] PATH_INFO: `/v3/projects/7cee9d08a76d4944bb22a87b2ec7b22d/users/f881a32a733c4e089f228efcc90c4bff/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:03.635218 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27b99b-13db-4038-b9a8-3b6d57b20f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cee9d08a76d4944bb22a87b2ec7b22d, user_id=f881a32a733c4e089f228efcc90c4bff, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:03.643814 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27b99b-13db-4038-b9a8-3b6d57b20f53 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:03.654093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1094/2166] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:38:03 2022] PUT /identity/v3/projects/7cee9d08a76d4944bb22a87b2ec7b22d/users/f881a32a733c4e089f228efcc90c4bff/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:03.664954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1cd0f-c46a-4638-8232-bbb71734404a None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:03.676456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1cd0f-c46a-4638-8232-bbb71734404a None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:03.676456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1cd0f-c46a-4638-8232-bbb71734404a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:03.771380 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-caa1cd0f-c46a-4638-8232-bbb71734404a None None] MFA Rules not processed for user `f881a32a733c4e089f228efcc90c4bff`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:03.775375 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-caa1cd0f-c46a-4638-8232-bbb71734404a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:03.957143 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1073/2167] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:03.958733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:03.970194 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27b99b-13db-4038-b9a8-3b6d57b20f53 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:03.971878 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9c27b99b-13db-4038-b9a8-3b6d57b20f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:04.033949 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27b99b-13db-4038-b9a8-3b6d57b20f53 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:04.037812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ed56d-6aaf-4728-9e1d-658c4d86b602 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:04.038415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ed56d-6aaf-4728-9e1d-658c4d86b602 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:04.038736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ed56d-6aaf-4728-9e1d-658c4d86b602 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:04.039010 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ed56d-6aaf-4728-9e1d-658c4d86b602 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:04.119373 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ed56d-6aaf-4728-9e1d-658c4d86b602 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:04.122278 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ed56d-6aaf-4728-9e1d-658c4d86b602 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:04.138326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1095/2168] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:38:04.340434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:04.750952 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130437b-2001-469a-9992-c91b1a555cc2 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:04.751604 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130437b-2001-469a-9992-c91b1a555cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:04.752160 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130437b-2001-469a-9992-c91b1a555cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:04.813474 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-1130437b-2001-469a-9992-c91b1a555cc2 None None] MFA Rules not processed for user `a6507ed9a47848c29d72fd9af71e2cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:04.815178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-1130437b-2001-469a-9992-c91b1a555cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:04.926167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1074/2169] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:05.064371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ed56d-6aaf-4728-9e1d-658c4d86b602 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:05.066167 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2f5ed56d-6aaf-4728-9e1d-658c4d86b602 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:05.166290 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ed56d-6aaf-4728-9e1d-658c4d86b602 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:05.171612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd84fb-6e3e-4660-bcc3-f4295ca9d142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:05.172257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd84fb-6e3e-4660-bcc3-f4295ca9d142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:05.173279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd84fb-6e3e-4660-bcc3-f4295ca9d142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:05.173618 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd84fb-6e3e-4660-bcc3-f4295ca9d142 admin admin] PATH_INFO: `/v3/users/e2183f644359472eb40c54684e486aa7` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:05.175002 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd84fb-6e3e-4660-bcc3-f4295ca9d142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2183f644359472eb40c54684e486aa7)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:05.177001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd84fb-6e3e-4660-bcc3-f4295ca9d142 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:05.448573 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ecbd84fb-6e3e-4660-bcc3-f4295ca9d142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2183f644359472eb40c54684e486aa7'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:05.452416 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ecbd84fb-6e3e-4660-bcc3-f4295ca9d142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2183f644359472eb40c54684e486aa7'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:05.470480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ecbd84fb-6e3e-4660-bcc3-f4295ca9d142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2183f644359472eb40c54684e486aa7'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:05.589410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ecbd84fb-6e3e-4660-bcc3-f4295ca9d142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2183f644359472eb40c54684e486aa7'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:05.590457 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ecbd84fb-6e3e-4660-bcc3-f4295ca9d142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2183f644359472eb40c54684e486aa7'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:05.605221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1096/2170] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:38:05 2022] DELETE /identity/v3/users/e2183f644359472eb40c54684e486aa7 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:38:05.609638 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2760184-4e2e-424a-96c1-89ac56e20231 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:05.609926 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2760184-4e2e-424a-96c1-89ac56e20231 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:05.610244 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2760184-4e2e-424a-96c1-89ac56e20231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:05.636212 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-c2760184-4e2e-424a-96c1-89ac56e20231 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:05.638752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c2760184-4e2e-424a-96c1-89ac56e20231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:05.726198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1075/2171] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:05.735993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd84fb-6e3e-4660-bcc3-f4295ca9d142 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:05.737680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ecbd84fb-6e3e-4660-bcc3-f4295ca9d142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:05.811252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd84fb-6e3e-4660-bcc3-f4295ca9d142 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:05.815222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7210ce-4e4c-40fc-831c-5e36c68aa7b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:05.815841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7210ce-4e4c-40fc-831c-5e36c68aa7b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:05.816122 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7210ce-4e4c-40fc-831c-5e36c68aa7b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:05.816492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7210ce-4e4c-40fc-831c-5e36c68aa7b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:05.826145 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7210ce-4e4c-40fc-831c-5e36c68aa7b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:05.827612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7210ce-4e4c-40fc-831c-5e36c68aa7b8 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:05.837792 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1097/2172] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:38:06.320739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2760184-4e2e-424a-96c1-89ac56e20231 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:06.322225 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c2760184-4e2e-424a-96c1-89ac56e20231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:06.340968 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2760184-4e2e-424a-96c1-89ac56e20231 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:06.346535 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21b129-1498-40a0-b085-efc8cc6d4918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:06.347275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21b129-1498-40a0-b085-efc8cc6d4918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:06.347553 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21b129-1498-40a0-b085-efc8cc6d4918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:06.348073 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21b129-1498-40a0-b085-efc8cc6d4918 admin admin] PATH_INFO: `/v3/projects/7b42262e9e2e47aea5cf8ba46bdbf465` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:06.349356 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21b129-1498-40a0-b085-efc8cc6d4918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b42262e9e2e47aea5cf8ba46bdbf465)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:06.351352 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21b129-1498-40a0-b085-efc8cc6d4918 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:06.381121 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:INSERT=10,keystone:SELECT=80,keystone:DELETE=10 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:06.442061 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2a21b129-1498-40a0-b085-efc8cc6d4918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b42262e9e2e47aea5cf8ba46bdbf465', 'request_id': 'req-2a21b129-1498-40a0-b085-efc8cc6d4918'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:06.450736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2a21b129-1498-40a0-b085-efc8cc6d4918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b42262e9e2e47aea5cf8ba46bdbf465', 'request_id': 'req-2a21b129-1498-40a0-b085-efc8cc6d4918'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:06.529969 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2a21b129-1498-40a0-b085-efc8cc6d4918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b42262e9e2e47aea5cf8ba46bdbf465', 'request_id': 'req-2a21b129-1498-40a0-b085-efc8cc6d4918'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:06.543070 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2a21b129-1498-40a0-b085-efc8cc6d4918 admin admin] The token cache is being invalidate because project 7b42262e9e2e47aea5cf8ba46bdbf465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:38:06.543367 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2a21b129-1498-40a0-b085-efc8cc6d4918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:06.544146 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2a21b129-1498-40a0-b085-efc8cc6d4918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:06.545847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1076/2173] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:38:06 2022] DELETE /identity/v3/projects/7b42262e9e2e47aea5cf8ba46bdbf465 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:06.550269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7210ce-4e4c-40fc-831c-5e36c68aa7b8 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:06.560505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7210ce-4e4c-40fc-831c-5e36c68aa7b8 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:06.621718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c46ea3-9f17-45fb-bf10-770a2a05665a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:06.622357 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c46ea3-9f17-45fb-bf10-770a2a05665a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:06.622637 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c46ea3-9f17-45fb-bf10-770a2a05665a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:06.622910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c46ea3-9f17-45fb-bf10-770a2a05665a admin admin] PATH_INFO: `/v3/users/53a66212f9e84eac9e1e306415dd6249` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:06.624046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c46ea3-9f17-45fb-bf10-770a2a05665a admin admin] RBAC: Authorizing `identity:delete_user(user_id=53a66212f9e84eac9e1e306415dd6249)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:06.626653 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c46ea3-9f17-45fb-bf10-770a2a05665a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:06.863563 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-69c46ea3-9f17-45fb-bf10-770a2a05665a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53a66212f9e84eac9e1e306415dd6249'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:06.864225 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-69c46ea3-9f17-45fb-bf10-770a2a05665a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53a66212f9e84eac9e1e306415dd6249'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:06.877204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-69c46ea3-9f17-45fb-bf10-770a2a05665a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53a66212f9e84eac9e1e306415dd6249'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:06.969280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-69c46ea3-9f17-45fb-bf10-770a2a05665a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53a66212f9e84eac9e1e306415dd6249'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:06.970666 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-69c46ea3-9f17-45fb-bf10-770a2a05665a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53a66212f9e84eac9e1e306415dd6249'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:06.984696 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1098/2174] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:38:06 2022] DELETE /identity/v3/users/53a66212f9e84eac9e1e306415dd6249 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:07.425532 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21b129-1498-40a0-b085-efc8cc6d4918 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:07.427099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-2a21b129-1498-40a0-b085-efc8cc6d4918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:07.479408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c46ea3-9f17-45fb-bf10-770a2a05665a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:07.482021 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-69c46ea3-9f17-45fb-bf10-770a2a05665a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:07.542032 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21b129-1498-40a0-b085-efc8cc6d4918 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:07.584623 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:07.594822 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c46ea3-9f17-45fb-bf10-770a2a05665a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:07.608856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3d843-732f-4f96-b51e-6138128400ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:07.609513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3d843-732f-4f96-b51e-6138128400ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:07.609793 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3d843-732f-4f96-b51e-6138128400ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:07.610237 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3d843-732f-4f96-b51e-6138128400ea admin admin] PATH_INFO: `/v3/projects/d05c13274af443918db0e44148464e32` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:07.611911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3d843-732f-4f96-b51e-6138128400ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d05c13274af443918db0e44148464e32)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:07.614416 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3d843-732f-4f96-b51e-6138128400ea admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:07.629110 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edffd9-bc76-4723-b716-d8f4923926ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:07.629752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edffd9-bc76-4723-b716-d8f4923926ac service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:07.630031 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edffd9-bc76-4723-b716-d8f4923926ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:07.630307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edffd9-bc76-4723-b716-d8f4923926ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:07.634428 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b1edffd9-bc76-4723-b716-d8f4923926ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:07.717653 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edffd9-bc76-4723-b716-d8f4923926ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:07.719129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edffd9-bc76-4723-b716-d8f4923926ac service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:07.728588 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1077/2175] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:38:07.753320 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b5b3d843-732f-4f96-b51e-6138128400ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd05c13274af443918db0e44148464e32', 'request_id': 'req-b5b3d843-732f-4f96-b51e-6138128400ea'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:07.759658 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b5b3d843-732f-4f96-b51e-6138128400ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd05c13274af443918db0e44148464e32', 'request_id': 'req-b5b3d843-732f-4f96-b51e-6138128400ea'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:07.836638 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b5b3d843-732f-4f96-b51e-6138128400ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd05c13274af443918db0e44148464e32', 'request_id': 'req-b5b3d843-732f-4f96-b51e-6138128400ea'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:07.848456 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b5b3d843-732f-4f96-b51e-6138128400ea admin admin] The token cache is being invalidate because project d05c13274af443918db0e44148464e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:38:07.848799 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b5b3d843-732f-4f96-b51e-6138128400ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:07.849529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b5b3d843-732f-4f96-b51e-6138128400ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:07.851096 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1099/2176] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:38:07 2022] DELETE /identity/v3/projects/d05c13274af443918db0e44148464e32 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:07.855353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edffd9-bc76-4723-b716-d8f4923926ac service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:07.867963 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edffd9-bc76-4723-b716-d8f4923926ac service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:07.936117 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855b9a0-6c96-4ad9-81f8-9ad09458cde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:07.936896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855b9a0-6c96-4ad9-81f8-9ad09458cde3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:07.937176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855b9a0-6c96-4ad9-81f8-9ad09458cde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:07.937445 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855b9a0-6c96-4ad9-81f8-9ad09458cde3 admin admin] PATH_INFO: `/v3/users/dd9dfe3ee8a44491af9f9aa0c1c666ac` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:07.941353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855b9a0-6c96-4ad9-81f8-9ad09458cde3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9dfe3ee8a44491af9f9aa0c1c666ac)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:07.943555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855b9a0-6c96-4ad9-81f8-9ad09458cde3 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:08.193663 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2855b9a0-6c96-4ad9-81f8-9ad09458cde3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9dfe3ee8a44491af9f9aa0c1c666ac'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:08.195182 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2855b9a0-6c96-4ad9-81f8-9ad09458cde3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9dfe3ee8a44491af9f9aa0c1c666ac'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:08.212941 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2855b9a0-6c96-4ad9-81f8-9ad09458cde3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9dfe3ee8a44491af9f9aa0c1c666ac'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:08.300256 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2855b9a0-6c96-4ad9-81f8-9ad09458cde3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9dfe3ee8a44491af9f9aa0c1c666ac'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:08.300828 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2855b9a0-6c96-4ad9-81f8-9ad09458cde3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9dfe3ee8a44491af9f9aa0c1c666ac'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:08.313658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1078/2177] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:38:07 2022] DELETE /identity/v3/users/dd9dfe3ee8a44491af9f9aa0c1c666ac => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:08.734211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:08.891652 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3d843-732f-4f96-b51e-6138128400ea admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:08.893736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b5b3d843-732f-4f96-b51e-6138128400ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:08.906950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3d843-732f-4f96-b51e-6138128400ea admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:08.974030 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8f44a-ac6a-45b4-8999-1a4a0cf54e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:08.974721 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8f44a-ac6a-45b4-8999-1a4a0cf54e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:08.975029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8f44a-ac6a-45b4-8999-1a4a0cf54e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:08.975371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8f44a-ac6a-45b4-8999-1a4a0cf54e9a admin admin] PATH_INFO: `/v3/projects/3158dcfc832b4774912045bc8bb640b3` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:08.976572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8f44a-ac6a-45b4-8999-1a4a0cf54e9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3158dcfc832b4774912045bc8bb640b3)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:08.978595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8f44a-ac6a-45b4-8999-1a4a0cf54e9a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:09.155305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9af8f44a-ac6a-45b4-8999-1a4a0cf54e9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3158dcfc832b4774912045bc8bb640b3', 'request_id': 'req-9af8f44a-ac6a-45b4-8999-1a4a0cf54e9a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:09.166157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9af8f44a-ac6a-45b4-8999-1a4a0cf54e9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3158dcfc832b4774912045bc8bb640b3', 'request_id': 'req-9af8f44a-ac6a-45b4-8999-1a4a0cf54e9a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:09.249798 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9af8f44a-ac6a-45b4-8999-1a4a0cf54e9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3158dcfc832b4774912045bc8bb640b3', 'request_id': 'req-9af8f44a-ac6a-45b4-8999-1a4a0cf54e9a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:09.265053 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9af8f44a-ac6a-45b4-8999-1a4a0cf54e9a admin admin] The token cache is being invalidate because project 3158dcfc832b4774912045bc8bb640b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:38:09.266364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9af8f44a-ac6a-45b4-8999-1a4a0cf54e9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:09.272771 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9af8f44a-ac6a-45b4-8999-1a4a0cf54e9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:09.279143 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1100/2178] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:38:08 2022] DELETE /identity/v3/projects/3158dcfc832b4774912045bc8bb640b3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:09.284100 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dccdc-d936-4601-953b-e86d903e8243 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:09.290036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dccdc-d936-4601-953b-e86d903e8243 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:09.290036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dccdc-d936-4601-953b-e86d903e8243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:09.311077 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-fd6dccdc-d936-4601-953b-e86d903e8243 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:09.314027 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-fd6dccdc-d936-4601-953b-e86d903e8243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:09.412532 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1079/2179] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:09.415013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dca6fc-c5c9-411f-99e9-a893bb2d4b19 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:09.415353 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dca6fc-c5c9-411f-99e9-a893bb2d4b19 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:09.415633 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dca6fc-c5c9-411f-99e9-a893bb2d4b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:09.441323 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-20dca6fc-c5c9-411f-99e9-a893bb2d4b19 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:09.448039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-20dca6fc-c5c9-411f-99e9-a893bb2d4b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:09.467669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1101/2180] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:09.474740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dccdc-d936-4601-953b-e86d903e8243 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:09.486984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dccdc-d936-4601-953b-e86d903e8243 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:09.499206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2309a-a4ba-4267-8cd3-90bbd89b3ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:09.499965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2309a-a4ba-4267-8cd3-90bbd89b3ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:09.500246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2309a-a4ba-4267-8cd3-90bbd89b3ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:09.500554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2309a-a4ba-4267-8cd3-90bbd89b3ed1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:09.501241 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2309a-a4ba-4267-8cd3-90bbd89b3ed1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:38:09.501540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2309a-a4ba-4267-8cd3-90bbd89b3ed1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:09.503144 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2309a-a4ba-4267-8cd3-90bbd89b3ed1 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:09.517607 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1080/2181] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:38:09.525098 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dca6fc-c5c9-411f-99e9-a893bb2d4b19 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:09.535518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dca6fc-c5c9-411f-99e9-a893bb2d4b19 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:09.543395 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e69a20-6a14-419f-b515-49b1d467464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:09.544005 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e69a20-6a14-419f-b515-49b1d467464a admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:09.544570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e69a20-6a14-419f-b515-49b1d467464a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:09.544843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e69a20-6a14-419f-b515-49b1d467464a admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:09.545477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e69a20-6a14-419f-b515-49b1d467464a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:09.547724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e69a20-6a14-419f-b515-49b1d467464a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:09.590687 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2309a-a4ba-4267-8cd3-90bbd89b3ed1 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:09.592488 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-bca2309a-a4ba-4267-8cd3-90bbd89b3ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:09.659330 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1102/2182] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:38:09 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:38:09.665686 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e69a20-6a14-419f-b515-49b1d467464a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:09.669457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2309a-a4ba-4267-8cd3-90bbd89b3ed1 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:09.746805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5278ddd-51a7-4cff-8347-6b3122bc1e4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:09.746805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5278ddd-51a7-4cff-8347-6b3122bc1e4d service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:09.746805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5278ddd-51a7-4cff-8347-6b3122bc1e4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:09.746805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5278ddd-51a7-4cff-8347-6b3122bc1e4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:09.747174 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b5278ddd-51a7-4cff-8347-6b3122bc1e4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:09.760941 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e69a20-6a14-419f-b515-49b1d467464a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:09.769029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d07ae9-6a5a-4165-af21-464bcafb5fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:09.770172 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d07ae9-6a5a-4165-af21-464bcafb5fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:09.770539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d07ae9-6a5a-4165-af21-464bcafb5fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:09.770884 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d07ae9-6a5a-4165-af21-464bcafb5fc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:09.771640 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d07ae9-6a5a-4165-af21-464bcafb5fc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:09.773664 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d07ae9-6a5a-4165-af21-464bcafb5fc7 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:09.843621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5278ddd-51a7-4cff-8347-6b3122bc1e4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:09.845463 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5278ddd-51a7-4cff-8347-6b3122bc1e4d service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:09.856221 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1081/2183] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:38:09.880297 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1103/2184] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:38:09 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:38:09.884777 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5278ddd-51a7-4cff-8347-6b3122bc1e4d service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:09.895624 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:09.899260 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5278ddd-51a7-4cff-8347-6b3122bc1e4d service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:09.908519 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd8e87-3551-4130-80ef-a04abba26c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:09.909917 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd8e87-3551-4130-80ef-a04abba26c63 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:09.910207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd8e87-3551-4130-80ef-a04abba26c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:09.910484 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd8e87-3551-4130-80ef-a04abba26c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:09.911268 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd8e87-3551-4130-80ef-a04abba26c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:09.913634 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd8e87-3551-4130-80ef-a04abba26c63 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:09.926082 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1082/2185] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:38:09.929887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d07ae9-6a5a-4165-af21-464bcafb5fc7 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:09.942879 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d07ae9-6a5a-4165-af21-464bcafb5fc7 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:09.949730 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4ccd1-d098-471d-a657-588e64c3c05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:09.950675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4ccd1-d098-471d-a657-588e64c3c05d admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:09.951361 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4ccd1-d098-471d-a657-588e64c3c05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:09.951949 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4ccd1-d098-471d-a657-588e64c3c05d admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:09.952852 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4ccd1-d098-471d-a657-588e64c3c05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:09.955590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4ccd1-d098-471d-a657-588e64c3c05d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:09.969965 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1104/2186] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:38:09.970656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd8e87-3551-4130-80ef-a04abba26c63 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:09.983367 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd8e87-3551-4130-80ef-a04abba26c63 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:09.989483 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ce5c6-e8bd-4ee5-9874-b94151ac02c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:09.990901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ce5c6-e8bd-4ee5-9874-b94151ac02c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:09.991375 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ce5c6-e8bd-4ee5-9874-b94151ac02c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:09.991727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ce5c6-e8bd-4ee5-9874-b94151ac02c4 admin admin] PATH_INFO: `/v3/projects/a1e9bd28b718466198e9b7bf7d6cc1d8/users/5ab5f94b16dc45febd760314715a35cf/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:10.010549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ce5c6-e8bd-4ee5-9874-b94151ac02c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e9bd28b718466198e9b7bf7d6cc1d8, user_id=5ab5f94b16dc45febd760314715a35cf, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:10.013789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ce5c6-e8bd-4ee5-9874-b94151ac02c4 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:10.168847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1083/2187] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:38:09 2022] PUT /identity/v3/projects/a1e9bd28b718466198e9b7bf7d6cc1d8/users/5ab5f94b16dc45febd760314715a35cf/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:38:10.182166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40270d-d26c-42fa-855f-f70ce5a2fa22 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:10.182467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40270d-d26c-42fa-855f-f70ce5a2fa22 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:10.182751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40270d-d26c-42fa-855f-f70ce5a2fa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:10.234068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ed40270d-d26c-42fa-855f-f70ce5a2fa22 None None] MFA Rules not processed for user `5ab5f94b16dc45febd760314715a35cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:10.236003 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ed40270d-d26c-42fa-855f-f70ce5a2fa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:10.338069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1105/2188] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:10.343177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ce5c6-e8bd-4ee5-9874-b94151ac02c4 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:10.382947 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:10.441555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ce5c6-e8bd-4ee5-9874-b94151ac02c4 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:10.447931 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cf1b7-3b43-4b2e-b99e-0513d744f93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:10.448800 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cf1b7-3b43-4b2e-b99e-0513d744f93c admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:10.449233 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cf1b7-3b43-4b2e-b99e-0513d744f93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:10.449655 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cf1b7-3b43-4b2e-b99e-0513d744f93c admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:10.450632 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9cf1b7-3b43-4b2e-b99e-0513d744f93c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:10.453766 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9cf1b7-3b43-4b2e-b99e-0513d744f93c admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:10.692618 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1084/2189] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:38:10 2022] POST /identity/v3/projects => generated 383 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:38:10.695940 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40270d-d26c-42fa-855f-f70ce5a2fa22 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:10.711056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40270d-d26c-42fa-855f-f70ce5a2fa22 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:10.788161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4b54c-a7c4-4ca5-9599-c268759ecd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:10.790282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4b54c-a7c4-4ca5-9599-c268759ecd55 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:10.790282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4b54c-a7c4-4ca5-9599-c268759ecd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:10.790282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4b54c-a7c4-4ca5-9599-c268759ecd55 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:10.790802 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4b54c-a7c4-4ca5-9599-c268759ecd55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:10.794028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4b54c-a7c4-4ca5-9599-c268759ecd55 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:10.965755 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1106/2190] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:38:10 2022] POST /identity/v3/users => generated 292 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:38:10.969907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cf1b7-3b43-4b2e-b99e-0513d744f93c admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:10.980200 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cf1b7-3b43-4b2e-b99e-0513d744f93c admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:10.986022 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f547c-6508-4e1d-be23-a6eed9d4aaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:10.986948 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f547c-6508-4e1d-be23-a6eed9d4aaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:10.987329 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f547c-6508-4e1d-be23-a6eed9d4aaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:10.987707 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f547c-6508-4e1d-be23-a6eed9d4aaa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:10.988681 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f547c-6508-4e1d-be23-a6eed9d4aaa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:10.990506 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f547c-6508-4e1d-be23-a6eed9d4aaa1 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:11.004160 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1085/2191] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:38:11.008751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4b54c-a7c4-4ca5-9599-c268759ecd55 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:11.023213 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4b54c-a7c4-4ca5-9599-c268759ecd55 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:11.037324 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57964c7a-4d29-4294-ac14-0804f46faedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:11.038146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57964c7a-4d29-4294-ac14-0804f46faedf admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:11.038498 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57964c7a-4d29-4294-ac14-0804f46faedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:11.038845 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57964c7a-4d29-4294-ac14-0804f46faedf admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:11.039573 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57964c7a-4d29-4294-ac14-0804f46faedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:11.041451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57964c7a-4d29-4294-ac14-0804f46faedf admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:11.054500 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1107/2192] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:38:11.059224 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f547c-6508-4e1d-be23-a6eed9d4aaa1 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:11.074736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f547c-6508-4e1d-be23-a6eed9d4aaa1 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:11.079712 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd0437-bfc6-4491-9bec-1c8e51f17ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:11.080405 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd0437-bfc6-4491-9bec-1c8e51f17ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:11.080693 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd0437-bfc6-4491-9bec-1c8e51f17ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:11.081494 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd0437-bfc6-4491-9bec-1c8e51f17ab8 admin admin] PATH_INFO: `/v3/projects/1eb7f1fb799a4f259ecc451c34f4d21e/users/9ec39dcc2f5c46d998aba77b4a664d8c/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:11.101799 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd0437-bfc6-4491-9bec-1c8e51f17ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb7f1fb799a4f259ecc451c34f4d21e, user_id=9ec39dcc2f5c46d998aba77b4a664d8c, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:11.104859 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd0437-bfc6-4491-9bec-1c8e51f17ab8 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:11.180166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1086/2193] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:38:11 2022] PUT /identity/v3/projects/1eb7f1fb799a4f259ecc451c34f4d21e/users/9ec39dcc2f5c46d998aba77b4a664d8c/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:11.192226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd8c97-cd7d-46e7-a915-0a8df506f2f9 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:11.192888 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd8c97-cd7d-46e7-a915-0a8df506f2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:11.193341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd8c97-cd7d-46e7-a915-0a8df506f2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:11.238853 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-58cd8c97-cd7d-46e7-a915-0a8df506f2f9 None None] MFA Rules not processed for user `9ec39dcc2f5c46d998aba77b4a664d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:11.240134 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-58cd8c97-cd7d-46e7-a915-0a8df506f2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:11.340808 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1108/2194] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:11.343794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd0437-bfc6-4491-9bec-1c8e51f17ab8 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:11.475282 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd0437-bfc6-4491-9bec-1c8e51f17ab8 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:11.482582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fc92e-b75a-4192-a03d-0f219983f5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:11.483535 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fc92e-b75a-4192-a03d-0f219983f5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:11.483879 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fc92e-b75a-4192-a03d-0f219983f5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:11.484367 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fc92e-b75a-4192-a03d-0f219983f5f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:11.485750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fc92e-b75a-4192-a03d-0f219983f5f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:11.488525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fc92e-b75a-4192-a03d-0f219983f5f9 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:11.617644 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1087/2195] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:38:11 2022] POST /identity/v3/projects => generated 385 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:38:11.617976 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd8c97-cd7d-46e7-a915-0a8df506f2f9 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:11.635464 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd8c97-cd7d-46e7-a915-0a8df506f2f9 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:11.639407 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:11.717251 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c65d4-f491-49e5-a395-c8a1d9fcbb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:11.717955 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c65d4-f491-49e5-a395-c8a1d9fcbb8d admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:11.718440 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c65d4-f491-49e5-a395-c8a1d9fcbb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:11.718881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c65d4-f491-49e5-a395-c8a1d9fcbb8d admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:11.719705 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c65d4-f491-49e5-a395-c8a1d9fcbb8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:11.721843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c65d4-f491-49e5-a395-c8a1d9fcbb8d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:11.816548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:11.823572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1109/2196] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:38:11 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:38:11.827616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fc92e-b75a-4192-a03d-0f219983f5f9 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:11.840901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fc92e-b75a-4192-a03d-0f219983f5f9 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:11.847289 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0706c54-edb9-4cae-9682-ba1f8e6933f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:11.848476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0706c54-edb9-4cae-9682-ba1f8e6933f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:11.848824 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0706c54-edb9-4cae-9682-ba1f8e6933f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:11.849166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0706c54-edb9-4cae-9682-ba1f8e6933f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:11.849914 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0706c54-edb9-4cae-9682-ba1f8e6933f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:11.851641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0706c54-edb9-4cae-9682-ba1f8e6933f2 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:11.867058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1088/2197] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:38:11.871074 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c65d4-f491-49e5-a395-c8a1d9fcbb8d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:11.882777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c65d4-f491-49e5-a395-c8a1d9fcbb8d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:11.887623 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d3935-4b2e-4860-86d3-8e89b14c0858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:11.888578 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3935-4b2e-4860-86d3-8e89b14c0858 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:11.888945 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3935-4b2e-4860-86d3-8e89b14c0858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:11.889319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3935-4b2e-4860-86d3-8e89b14c0858 admin admin] PATH_INFO: `/v3/projects/4f3b41d2125743eb84473dc21a92c01a/users/5fd73ea46a144a1d9458c4463a390046/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:11.904959 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d3935-4b2e-4860-86d3-8e89b14c0858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3b41d2125743eb84473dc21a92c01a, user_id=5fd73ea46a144a1d9458c4463a390046, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:11.910590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d3935-4b2e-4860-86d3-8e89b14c0858 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:11.989847 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1110/2198] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:38:11 2022] PUT /identity/v3/projects/4f3b41d2125743eb84473dc21a92c01a/users/5fd73ea46a144a1d9458c4463a390046/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:11.993578 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0706c54-edb9-4cae-9682-ba1f8e6933f2 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:12.007885 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0706c54-edb9-4cae-9682-ba1f8e6933f2 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:12.084829 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39703a-34cf-4177-aebd-89ff0184522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:12.085520 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39703a-34cf-4177-aebd-89ff0184522b admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:12.085874 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39703a-34cf-4177-aebd-89ff0184522b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:12.086290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39703a-34cf-4177-aebd-89ff0184522b admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:12.087088 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39703a-34cf-4177-aebd-89ff0184522b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:12.089379 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39703a-34cf-4177-aebd-89ff0184522b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:12.102720 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1089/2199] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:38:12.106859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d3935-4b2e-4860-86d3-8e89b14c0858 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:12.133268 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d3935-4b2e-4860-86d3-8e89b14c0858 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:12.146905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc223ff-c83a-4337-8522-3e99b7693c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:12.147670 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc223ff-c83a-4337-8522-3e99b7693c18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:12.148145 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc223ff-c83a-4337-8522-3e99b7693c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:12.148476 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc223ff-c83a-4337-8522-3e99b7693c18 admin admin] PATH_INFO: `/v3/projects/4f3b41d2125743eb84473dc21a92c01a/users/5fd73ea46a144a1d9458c4463a390046/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:12.160211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc223ff-c83a-4337-8522-3e99b7693c18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3b41d2125743eb84473dc21a92c01a, user_id=5fd73ea46a144a1d9458c4463a390046, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:12.163215 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc223ff-c83a-4337-8522-3e99b7693c18 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:12.185085 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1111/2200] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:38:12 2022] PUT /identity/v3/projects/4f3b41d2125743eb84473dc21a92c01a/users/5fd73ea46a144a1d9458c4463a390046/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:12.197351 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4530301-cc99-4f3f-81f0-8ba4ef1f2379 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:12.197784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4530301-cc99-4f3f-81f0-8ba4ef1f2379 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:12.198195 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4530301-cc99-4f3f-81f0-8ba4ef1f2379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:12.236863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-c4530301-cc99-4f3f-81f0-8ba4ef1f2379 None None] MFA Rules not processed for user `5fd73ea46a144a1d9458c4463a390046`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:12.238325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c4530301-cc99-4f3f-81f0-8ba4ef1f2379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:12.325663 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1090/2201] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:12.338460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc223ff-c83a-4337-8522-3e99b7693c18 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:12.340587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9cc223ff-c83a-4337-8522-3e99b7693c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:12.421399 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc223ff-c83a-4337-8522-3e99b7693c18 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:12.427199 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c941e9d-b0f4-45b6-9aa3-99728b9cd2ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:12.428011 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c941e9d-b0f4-45b6-9aa3-99728b9cd2ac service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:12.428622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c941e9d-b0f4-45b6-9aa3-99728b9cd2ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:12.428981 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c941e9d-b0f4-45b6-9aa3-99728b9cd2ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:12.493602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c941e9d-b0f4-45b6-9aa3-99728b9cd2ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:12.495046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c941e9d-b0f4-45b6-9aa3-99728b9cd2ac service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:12.504116 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1112/2202] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:38:12.861229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:13.038304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:13.535858 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:13.883921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:14.234243 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:14.461369 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:14.765967 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4530301-cc99-4f3f-81f0-8ba4ef1f2379 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:14.778979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4530301-cc99-4f3f-81f0-8ba4ef1f2379 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:14.780049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7817e0e-6d0c-4f76-b1fd-897ba17cb149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:14.780677 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7817e0e-6d0c-4f76-b1fd-897ba17cb149 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:14.780958 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7817e0e-6d0c-4f76-b1fd-897ba17cb149 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:14.781230 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7817e0e-6d0c-4f76-b1fd-897ba17cb149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:14.844044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c941e9d-b0f4-45b6-9aa3-99728b9cd2ac service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:14.847667 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7817e0e-6d0c-4f76-b1fd-897ba17cb149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:14.847820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5c941e9d-b0f4-45b6-9aa3-99728b9cd2ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:14.849129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7817e0e-6d0c-4f76-b1fd-897ba17cb149 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:14.861513 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1091/2203] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:38:14.918784 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c941e9d-b0f4-45b6-9aa3-99728b9cd2ac service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:14.923324 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b3a92-7dce-4c18-a34b-3a9272a34bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:14.924040 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b3a92-7dce-4c18-a34b-3a9272a34bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:14.924415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b3a92-7dce-4c18-a34b-3a9272a34bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:14.924753 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b3a92-7dce-4c18-a34b-3a9272a34bd2 admin admin] PATH_INFO: `/v3/users/523b74a471d34d34bb8693e63074085d` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:14.925927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b3a92-7dce-4c18-a34b-3a9272a34bd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=523b74a471d34d34bb8693e63074085d)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:14.927941 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b3a92-7dce-4c18-a34b-3a9272a34bd2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:15.144808 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-676b3a92-7dce-4c18-a34b-3a9272a34bd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '523b74a471d34d34bb8693e63074085d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:15.145459 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-676b3a92-7dce-4c18-a34b-3a9272a34bd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '523b74a471d34d34bb8693e63074085d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:15.158823 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-676b3a92-7dce-4c18-a34b-3a9272a34bd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '523b74a471d34d34bb8693e63074085d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:15.221170 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-676b3a92-7dce-4c18-a34b-3a9272a34bd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '523b74a471d34d34bb8693e63074085d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:15.221810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-676b3a92-7dce-4c18-a34b-3a9272a34bd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '523b74a471d34d34bb8693e63074085d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:15.234610 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1113/2204] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:38:14 2022] DELETE /identity/v3/users/523b74a471d34d34bb8693e63074085d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:15.239365 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d508049-d9f2-4996-8a35-050be34435b7 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:15.239924 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d508049-d9f2-4996-8a35-050be34435b7 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:15.239924 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d508049-d9f2-4996-8a35-050be34435b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:15.259950 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-0d508049-d9f2-4996-8a35-050be34435b7 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:15.261180 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-0d508049-d9f2-4996-8a35-050be34435b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:15.324023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1092/2205] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:15.324946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:15.334214 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b3a92-7dce-4c18-a34b-3a9272a34bd2 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:15.335646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-676b3a92-7dce-4c18-a34b-3a9272a34bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:15.398463 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b3a92-7dce-4c18-a34b-3a9272a34bd2 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:15.402467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbf8ce-3694-49fb-b823-2d5f4d70f424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:15.403075 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbf8ce-3694-49fb-b823-2d5f4d70f424 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:15.403351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbf8ce-3694-49fb-b823-2d5f4d70f424 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:15.403624 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbf8ce-3694-49fb-b823-2d5f4d70f424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:15.413011 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbf8ce-3694-49fb-b823-2d5f4d70f424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:15.414501 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbf8ce-3694-49fb-b823-2d5f4d70f424 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:15.424649 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1114/2206] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:38:15.470753 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:15.699037 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:15.925181 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d508049-d9f2-4996-8a35-050be34435b7 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:15.927862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-0d508049-d9f2-4996-8a35-050be34435b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:15.961177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d508049-d9f2-4996-8a35-050be34435b7 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:15.969363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fe4cc-b734-45f2-894c-cb83b8914ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:15.970293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fe4cc-b734-45f2-894c-cb83b8914ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:15.970631 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fe4cc-b734-45f2-894c-cb83b8914ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:15.971066 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fe4cc-b734-45f2-894c-cb83b8914ecc admin admin] PATH_INFO: `/v3/projects/41c823a459994fac90a074f57fd511ff` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:15.972200 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fe4cc-b734-45f2-894c-cb83b8914ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=41c823a459994fac90a074f57fd511ff)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:15.975211 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fe4cc-b734-45f2-894c-cb83b8914ecc admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:16.127161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-996fe4cc-b734-45f2-894c-cb83b8914ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41c823a459994fac90a074f57fd511ff', 'request_id': 'req-996fe4cc-b734-45f2-894c-cb83b8914ecc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:16.133728 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-996fe4cc-b734-45f2-894c-cb83b8914ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41c823a459994fac90a074f57fd511ff', 'request_id': 'req-996fe4cc-b734-45f2-894c-cb83b8914ecc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:16.237317 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-996fe4cc-b734-45f2-894c-cb83b8914ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41c823a459994fac90a074f57fd511ff', 'request_id': 'req-996fe4cc-b734-45f2-894c-cb83b8914ecc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:16.248198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-996fe4cc-b734-45f2-894c-cb83b8914ecc admin admin] The token cache is being invalidate because project 41c823a459994fac90a074f57fd511ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:38:16.248839 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-996fe4cc-b734-45f2-894c-cb83b8914ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:16.249326 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-996fe4cc-b734-45f2-894c-cb83b8914ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:16.250818 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1093/2207] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:38:15 2022] DELETE /identity/v3/projects/41c823a459994fac90a074f57fd511ff => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:16.256312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534820-31c7-4e53-88ac-79e90c3bec1e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:16.256787 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534820-31c7-4e53-88ac-79e90c3bec1e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:16.257057 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534820-31c7-4e53-88ac-79e90c3bec1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:16.277559 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-83534820-31c7-4e53-88ac-79e90c3bec1e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:16.279087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-83534820-31c7-4e53-88ac-79e90c3bec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:16.352488 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1115/2208] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:38:16.362188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9548e1b-96c2-4289-bf55-7ab833ea21d4 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:16.362749 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9548e1b-96c2-4289-bf55-7ab833ea21d4 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:16.363247 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9548e1b-96c2-4289-bf55-7ab833ea21d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:16.405292 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-c9548e1b-96c2-4289-bf55-7ab833ea21d4 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:16.406958 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c9548e1b-96c2-4289-bf55-7ab833ea21d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:16.419842 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1094/2209] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:16.421004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83534820-31c7-4e53-88ac-79e90c3bec1e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:16.443739 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83534820-31c7-4e53-88ac-79e90c3bec1e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:16.448828 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93e4d4-4dbc-45ee-9c9a-0aff3294662e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:16.449517 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93e4d4-4dbc-45ee-9c9a-0aff3294662e admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:16.449798 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93e4d4-4dbc-45ee-9c9a-0aff3294662e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:16.456699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93e4d4-4dbc-45ee-9c9a-0aff3294662e admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:16.456699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93e4d4-4dbc-45ee-9c9a-0aff3294662e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:38:16.456699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93e4d4-4dbc-45ee-9c9a-0aff3294662e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:16.456699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93e4d4-4dbc-45ee-9c9a-0aff3294662e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:16.465266 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9548e1b-96c2-4289-bf55-7ab833ea21d4 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:16.466883 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c9548e1b-96c2-4289-bf55-7ab833ea21d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:16.472055 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1116/2210] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:38:16.473289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93e4d4-4dbc-45ee-9c9a-0aff3294662e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:16.487811 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9548e1b-96c2-4289-bf55-7ab833ea21d4 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:16.488051 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93e4d4-4dbc-45ee-9c9a-0aff3294662e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:16.493177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555dc3b-f424-4504-8a6c-1ab6d3c7ae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:16.493737 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52850ce3-0481-4856-832a-3d81d66af771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:16.493953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555dc3b-f424-4504-8a6c-1ab6d3c7ae2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:16.494360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555dc3b-f424-4504-8a6c-1ab6d3c7ae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:16.494594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52850ce3-0481-4856-832a-3d81d66af771 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:16.494744 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555dc3b-f424-4504-8a6c-1ab6d3c7ae2b admin admin] PATH_INFO: `/v3/users/e9325124701349bb83178470caf79ea3` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:16.495197 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52850ce3-0481-4856-832a-3d81d66af771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:16.495525 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52850ce3-0481-4856-832a-3d81d66af771 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:16.496060 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555dc3b-f424-4504-8a6c-1ab6d3c7ae2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9325124701349bb83178470caf79ea3)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:16.496396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52850ce3-0481-4856-832a-3d81d66af771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:16.498141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555dc3b-f424-4504-8a6c-1ab6d3c7ae2b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:16.498873 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52850ce3-0481-4856-832a-3d81d66af771 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:16.581649 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:16.641376 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1117/2211] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:38:16 2022] POST /identity/v3/projects => generated 399 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:38:16.645421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52850ce3-0481-4856-832a-3d81d66af771 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:16.647046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-52850ce3-0481-4856-832a-3d81d66af771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:16.713675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52850ce3-0481-4856-832a-3d81d66af771 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:16.894461 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09d60c-8aa5-4544-8caa-d8a64d268030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:16.894461 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09d60c-8aa5-4544-8caa-d8a64d268030 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:16.894461 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09d60c-8aa5-4544-8caa-d8a64d268030 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:16.894461 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09d60c-8aa5-4544-8caa-d8a64d268030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:16.895329 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9f09d60c-8aa5-4544-8caa-d8a64d268030 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:16.895329 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09d60c-8aa5-4544-8caa-d8a64d268030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:16.895329 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09d60c-8aa5-4544-8caa-d8a64d268030 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:16.895329 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1118/2212] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:38:16.895329 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09d60c-8aa5-4544-8caa-d8a64d268030 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:16.895329 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09d60c-8aa5-4544-8caa-d8a64d268030 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:16.895840 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf6397-4bdc-4f6d-ab01-3f904e67625c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:16.895840 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf6397-4bdc-4f6d-ab01-3f904e67625c admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:16.895840 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf6397-4bdc-4f6d-ab01-3f904e67625c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:16.895840 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf6397-4bdc-4f6d-ab01-3f904e67625c admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:16.896180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf6397-4bdc-4f6d-ab01-3f904e67625c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:16.896180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf6397-4bdc-4f6d-ab01-3f904e67625c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:17.036019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4555dc3b-f424-4504-8a6c-1ab6d3c7ae2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9325124701349bb83178470caf79ea3'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:17.036765 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4555dc3b-f424-4504-8a6c-1ab6d3c7ae2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9325124701349bb83178470caf79ea3'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:17.052361 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4555dc3b-f424-4504-8a6c-1ab6d3c7ae2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9325124701349bb83178470caf79ea3'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:17.061428 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1119/2213] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:38:16 2022] POST /identity/v3/users => generated 300 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:38:17.063110 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf6397-4bdc-4f6d-ab01-3f904e67625c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:17.064913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-38cf6397-4bdc-4f6d-ab01-3f904e67625c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:17.077296 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf6397-4bdc-4f6d-ab01-3f904e67625c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:17.082659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c72e62-8f64-43dd-9c50-0a7634a0bf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:17.083253 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c72e62-8f64-43dd-9c50-0a7634a0bf59 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:17.083537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c72e62-8f64-43dd-9c50-0a7634a0bf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:17.083843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c72e62-8f64-43dd-9c50-0a7634a0bf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:17.084513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c72e62-8f64-43dd-9c50-0a7634a0bf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:17.086125 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c72e62-8f64-43dd-9c50-0a7634a0bf59 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:17.097909 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1120/2214] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:38:17.101148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c72e62-8f64-43dd-9c50-0a7634a0bf59 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:17.110575 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c72e62-8f64-43dd-9c50-0a7634a0bf59 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:17.115350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af238e-2c38-4bd8-a60b-c1e4728e4a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:17.115935 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af238e-2c38-4bd8-a60b-c1e4728e4a50 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:17.116220 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af238e-2c38-4bd8-a60b-c1e4728e4a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:17.116540 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af238e-2c38-4bd8-a60b-c1e4728e4a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:17.117251 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af238e-2c38-4bd8-a60b-c1e4728e4a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:17.118861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af238e-2c38-4bd8-a60b-c1e4728e4a50 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:17.129923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1121/2215] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:38:17.133551 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af238e-2c38-4bd8-a60b-c1e4728e4a50 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:17.143802 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af238e-2c38-4bd8-a60b-c1e4728e4a50 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:17.146918 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4555dc3b-f424-4504-8a6c-1ab6d3c7ae2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9325124701349bb83178470caf79ea3'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:17.147670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4555dc3b-f424-4504-8a6c-1ab6d3c7ae2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9325124701349bb83178470caf79ea3'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:17.155033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515fc2a-9073-4c83-bc5e-e96b08384aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:17.155033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515fc2a-9073-4c83-bc5e-e96b08384aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:17.155033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515fc2a-9073-4c83-bc5e-e96b08384aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:17.155033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515fc2a-9073-4c83-bc5e-e96b08384aa6 admin admin] PATH_INFO: `/v3/projects/a44e9c897e39456087fe7c78081942b4/users/2a71bbab0bf047bf94a18f4727479cf8/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:17.165148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1095/2216] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:38:16 2022] DELETE /identity/v3/users/e9325124701349bb83178470caf79ea3 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:17.169518 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d71a2-df7c-4062-8957-24eca973e864 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:17.169800 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d71a2-df7c-4062-8957-24eca973e864 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:17.169908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515fc2a-9073-4c83-bc5e-e96b08384aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a44e9c897e39456087fe7c78081942b4, user_id=2a71bbab0bf047bf94a18f4727479cf8, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:17.170071 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d71a2-df7c-4062-8957-24eca973e864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:17.182295 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515fc2a-9073-4c83-bc5e-e96b08384aa6 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:17.193540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-fb4d71a2-df7c-4062-8957-24eca973e864 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:17.194931 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-fb4d71a2-df7c-4062-8957-24eca973e864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:17.254804 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1096/2217] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:17.264432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d71a2-df7c-4062-8957-24eca973e864 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:17.265761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-fb4d71a2-df7c-4062-8957-24eca973e864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:17.266942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1122/2218] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:38:17 2022] PUT /identity/v3/projects/a44e9c897e39456087fe7c78081942b4/users/2a71bbab0bf047bf94a18f4727479cf8/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:38:17.278943 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4588bd6-2692-4853-acd3-ad20c9c7e1e7 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:17.279233 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4588bd6-2692-4853-acd3-ad20c9c7e1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:17.279511 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4588bd6-2692-4853-acd3-ad20c9c7e1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:17.308982 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a4588bd6-2692-4853-acd3-ad20c9c7e1e7 None None] MFA Rules not processed for user `2a71bbab0bf047bf94a18f4727479cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:17.310347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a4588bd6-2692-4853-acd3-ad20c9c7e1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:17.322996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d71a2-df7c-4062-8957-24eca973e864 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:17.371193 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb017e-e0ff-45b9-bb34-16d9307fded1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:17.371797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb017e-e0ff-45b9-bb34-16d9307fded1 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:17.372072 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb017e-e0ff-45b9-bb34-16d9307fded1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:17.372368 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb017e-e0ff-45b9-bb34-16d9307fded1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:17.374693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1123/2219] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:17 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:38:17.386621 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4588bd6-2692-4853-acd3-ad20c9c7e1e7 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:17.388046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a4588bd6-2692-4853-acd3-ad20c9c7e1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:17.433786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb017e-e0ff-45b9-bb34-16d9307fded1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:17.435297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb017e-e0ff-45b9-bb34-16d9307fded1 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:17.445431 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1097/2220] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:38:17.448428 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4588bd6-2692-4853-acd3-ad20c9c7e1e7 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:17.452005 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cc84d-7ef5-417c-a528-f65173a56c7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:17.452648 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cc84d-7ef5-417c-a528-f65173a56c7a service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:17.452932 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cc84d-7ef5-417c-a528-f65173a56c7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:17.453209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cc84d-7ef5-417c-a528-f65173a56c7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:17.462400 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3cc84d-7ef5-417c-a528-f65173a56c7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:17.463835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3cc84d-7ef5-417c-a528-f65173a56c7a service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:17.473618 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1124/2221] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:17 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:38:17.922132 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb017e-e0ff-45b9-bb34-16d9307fded1 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:17.923519 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3efb017e-e0ff-45b9-bb34-16d9307fded1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:17.937979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb017e-e0ff-45b9-bb34-16d9307fded1 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:17.958762 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accdd3a-f53b-4e39-9992-ed7e415c150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:17.959423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accdd3a-f53b-4e39-9992-ed7e415c150a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:17.959704 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accdd3a-f53b-4e39-9992-ed7e415c150a admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:17.959979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accdd3a-f53b-4e39-9992-ed7e415c150a admin admin] PATH_INFO: `/v3/projects/fe3d99adaee942b1857efa2c91763a9f` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:17.962030 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accdd3a-f53b-4e39-9992-ed7e415c150a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe3d99adaee942b1857efa2c91763a9f)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:17.964454 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accdd3a-f53b-4e39-9992-ed7e415c150a admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:18.096861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-0accdd3a-f53b-4e39-9992-ed7e415c150a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe3d99adaee942b1857efa2c91763a9f', 'request_id': 'req-0accdd3a-f53b-4e39-9992-ed7e415c150a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:18.103358 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-0accdd3a-f53b-4e39-9992-ed7e415c150a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe3d99adaee942b1857efa2c91763a9f', 'request_id': 'req-0accdd3a-f53b-4e39-9992-ed7e415c150a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:18.162955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-0accdd3a-f53b-4e39-9992-ed7e415c150a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe3d99adaee942b1857efa2c91763a9f', 'request_id': 'req-0accdd3a-f53b-4e39-9992-ed7e415c150a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:18.176926 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-0accdd3a-f53b-4e39-9992-ed7e415c150a admin admin] The token cache is being invalidate because project fe3d99adaee942b1857efa2c91763a9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:38:18.177220 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-0accdd3a-f53b-4e39-9992-ed7e415c150a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:18.177874 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-0accdd3a-f53b-4e39-9992-ed7e415c150a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:18.179383 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1098/2222] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:38:17 2022] DELETE /identity/v3/projects/fe3d99adaee942b1857efa2c91763a9f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:18.183731 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cc84d-7ef5-417c-a528-f65173a56c7a service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:18.195998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cc84d-7ef5-417c-a528-f65173a56c7a service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:18.228992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:18.291405 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bad94-a601-45e2-8014-2e49af0179ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:18.292111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bad94-a601-45e2-8014-2e49af0179ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:18.292463 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bad94-a601-45e2-8014-2e49af0179ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:18.292794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bad94-a601-45e2-8014-2e49af0179ca admin admin] PATH_INFO: `/v3/users/b02fc332b4114ed6b359018edc2a0250` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:18.294238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bad94-a601-45e2-8014-2e49af0179ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=b02fc332b4114ed6b359018edc2a0250)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:18.296246 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bad94-a601-45e2-8014-2e49af0179ca admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:18.420050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:18.487425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6d0bad94-a601-45e2-8014-2e49af0179ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b02fc332b4114ed6b359018edc2a0250'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:18.488159 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6d0bad94-a601-45e2-8014-2e49af0179ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b02fc332b4114ed6b359018edc2a0250'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:18.501108 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6d0bad94-a601-45e2-8014-2e49af0179ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b02fc332b4114ed6b359018edc2a0250'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:18.626962 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6d0bad94-a601-45e2-8014-2e49af0179ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b02fc332b4114ed6b359018edc2a0250'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:18.626962 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6d0bad94-a601-45e2-8014-2e49af0179ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b02fc332b4114ed6b359018edc2a0250'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:18.635426 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1125/2223] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:38:18 2022] DELETE /identity/v3/users/b02fc332b4114ed6b359018edc2a0250 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:19.193919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accdd3a-f53b-4e39-9992-ed7e415c150a admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:19.194740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-0accdd3a-f53b-4e39-9992-ed7e415c150a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:19.208139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accdd3a-f53b-4e39-9992-ed7e415c150a admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:19.266044 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dae60-814f-4a54-ab32-c921e57fa4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:19.266698 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dae60-814f-4a54-ab32-c921e57fa4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:19.267023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dae60-814f-4a54-ab32-c921e57fa4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:19.267325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dae60-814f-4a54-ab32-c921e57fa4d5 admin admin] PATH_INFO: `/v3/projects/f139f12c1496486484815d5471ba5754` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:19.268534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dae60-814f-4a54-ab32-c921e57fa4d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f139f12c1496486484815d5471ba5754)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:19.270503 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dae60-814f-4a54-ab32-c921e57fa4d5 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:19.434173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ab2dae60-814f-4a54-ab32-c921e57fa4d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f139f12c1496486484815d5471ba5754', 'request_id': 'req-ab2dae60-814f-4a54-ab32-c921e57fa4d5'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:19.441575 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ab2dae60-814f-4a54-ab32-c921e57fa4d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f139f12c1496486484815d5471ba5754', 'request_id': 'req-ab2dae60-814f-4a54-ab32-c921e57fa4d5'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:19.507079 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ab2dae60-814f-4a54-ab32-c921e57fa4d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f139f12c1496486484815d5471ba5754', 'request_id': 'req-ab2dae60-814f-4a54-ab32-c921e57fa4d5'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:19.518976 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ab2dae60-814f-4a54-ab32-c921e57fa4d5 admin admin] The token cache is being invalidate because project f139f12c1496486484815d5471ba5754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:38:19.521447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ab2dae60-814f-4a54-ab32-c921e57fa4d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:19.521447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ab2dae60-814f-4a54-ab32-c921e57fa4d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:19.524486 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1099/2224] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:38:19 2022] DELETE /identity/v3/projects/f139f12c1496486484815d5471ba5754 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:19.525689 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bad94-a601-45e2-8014-2e49af0179ca admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:19.527109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6d0bad94-a601-45e2-8014-2e49af0179ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:19.542160 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bad94-a601-45e2-8014-2e49af0179ca admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:19.601582 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07b603-4b83-422a-ae34-96f25f711d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:19.602206 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07b603-4b83-422a-ae34-96f25f711d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:19.602474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07b603-4b83-422a-ae34-96f25f711d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:19.602742 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07b603-4b83-422a-ae34-96f25f711d47 admin admin] PATH_INFO: `/v3/users/f881a32a733c4e089f228efcc90c4bff` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:19.603850 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07b603-4b83-422a-ae34-96f25f711d47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f881a32a733c4e089f228efcc90c4bff)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:19.605788 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07b603-4b83-422a-ae34-96f25f711d47 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:19.812213 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8f07b603-4b83-422a-ae34-96f25f711d47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f881a32a733c4e089f228efcc90c4bff'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:19.812935 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8f07b603-4b83-422a-ae34-96f25f711d47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f881a32a733c4e089f228efcc90c4bff'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:19.827286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8f07b603-4b83-422a-ae34-96f25f711d47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f881a32a733c4e089f228efcc90c4bff'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:19.901511 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8f07b603-4b83-422a-ae34-96f25f711d47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f881a32a733c4e089f228efcc90c4bff'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:19.902143 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8f07b603-4b83-422a-ae34-96f25f711d47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f881a32a733c4e089f228efcc90c4bff'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:19.915008 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1126/2225] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:38:19 2022] DELETE /identity/v3/users/f881a32a733c4e089f228efcc90c4bff => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:20.399721 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dae60-814f-4a54-ab32-c921e57fa4d5 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:20.401546 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ab2dae60-814f-4a54-ab32-c921e57fa4d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:20.415877 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dae60-814f-4a54-ab32-c921e57fa4d5 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:20.419309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:20.480057 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc9c2c-9650-4edd-a257-5451fb6dbc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:20.480963 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc9c2c-9650-4edd-a257-5451fb6dbc2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:20.481248 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc9c2c-9650-4edd-a257-5451fb6dbc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:20.481527 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc9c2c-9650-4edd-a257-5451fb6dbc2e admin admin] PATH_INFO: `/v3/projects/7cee9d08a76d4944bb22a87b2ec7b22d` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:20.482856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc9c2c-9650-4edd-a257-5451fb6dbc2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cee9d08a76d4944bb22a87b2ec7b22d)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:20.484756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc9c2c-9650-4edd-a257-5451fb6dbc2e admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:20.595079 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-69fc9c2c-9650-4edd-a257-5451fb6dbc2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cee9d08a76d4944bb22a87b2ec7b22d', 'request_id': 'req-69fc9c2c-9650-4edd-a257-5451fb6dbc2e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:20.603981 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-69fc9c2c-9650-4edd-a257-5451fb6dbc2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cee9d08a76d4944bb22a87b2ec7b22d', 'request_id': 'req-69fc9c2c-9650-4edd-a257-5451fb6dbc2e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:20.696291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:20.724239 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-69fc9c2c-9650-4edd-a257-5451fb6dbc2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cee9d08a76d4944bb22a87b2ec7b22d', 'request_id': 'req-69fc9c2c-9650-4edd-a257-5451fb6dbc2e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:20.750878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-69fc9c2c-9650-4edd-a257-5451fb6dbc2e admin admin] The token cache is being invalidate because project 7cee9d08a76d4944bb22a87b2ec7b22d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:38:20.751156 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-69fc9c2c-9650-4edd-a257-5451fb6dbc2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:20.751816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-69fc9c2c-9650-4edd-a257-5451fb6dbc2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:20.753546 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1100/2226] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:38:20 2022] DELETE /identity/v3/projects/7cee9d08a76d4944bb22a87b2ec7b22d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:20.764194 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe052b0-be78-4efa-8ad7-10e9918101be None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:20.764713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe052b0-be78-4efa-8ad7-10e9918101be None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:20.764810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe052b0-be78-4efa-8ad7-10e9918101be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:20.785751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-2fe052b0-be78-4efa-8ad7-10e9918101be None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:20.786972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2fe052b0-be78-4efa-8ad7-10e9918101be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:20.847741 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1127/2227] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:38:20.855474 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dc777-6864-4806-a6fa-9fefb5038d01 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:20.855764 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dc777-6864-4806-a6fa-9fefb5038d01 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:20.856035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dc777-6864-4806-a6fa-9fefb5038d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:20.875749 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-185dc777-6864-4806-a6fa-9fefb5038d01 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:20.876917 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-185dc777-6864-4806-a6fa-9fefb5038d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:20.888550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1101/2228] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:20.889490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe052b0-be78-4efa-8ad7-10e9918101be None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:20.899511 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe052b0-be78-4efa-8ad7-10e9918101be None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:20.904025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcac442-1632-4171-8da3-22df9d3375bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:20.904661 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcac442-1632-4171-8da3-22df9d3375bb admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:20.904940 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcac442-1632-4171-8da3-22df9d3375bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:20.905212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcac442-1632-4171-8da3-22df9d3375bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:20.905853 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcac442-1632-4171-8da3-22df9d3375bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:38:20.906151 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcac442-1632-4171-8da3-22df9d3375bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:20.907726 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcac442-1632-4171-8da3-22df9d3375bb admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:20.919276 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1128/2229] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:38:20.923550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dc777-6864-4806-a6fa-9fefb5038d01 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:20.933486 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dc777-6864-4806-a6fa-9fefb5038d01 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:20.938450 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83099dc4-4821-44f1-8318-70361454eeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:20.939049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83099dc4-4821-44f1-8318-70361454eeb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:20.939331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83099dc4-4821-44f1-8318-70361454eeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:20.939604 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83099dc4-4821-44f1-8318-70361454eeb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:20.940785 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83099dc4-4821-44f1-8318-70361454eeb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:20.942684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83099dc4-4821-44f1-8318-70361454eeb6 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:21.046765 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1102/2230] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:38:20 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:38:21.050579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcac442-1632-4171-8da3-22df9d3375bb admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:21.064454 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcac442-1632-4171-8da3-22df9d3375bb admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:21.140002 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6289fd8-630a-4755-ab5f-9de6a7896127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:21.140654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6289fd8-630a-4755-ab5f-9de6a7896127 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:21.141155 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6289fd8-630a-4755-ab5f-9de6a7896127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:21.145566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6289fd8-630a-4755-ab5f-9de6a7896127 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:21.145566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6289fd8-630a-4755-ab5f-9de6a7896127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:21.145566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6289fd8-630a-4755-ab5f-9de6a7896127 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:21.217649 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1129/2231] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:38:21 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:38:21.219032 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83099dc4-4821-44f1-8318-70361454eeb6 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:21.232994 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83099dc4-4821-44f1-8318-70361454eeb6 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:21.240761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d7cba-9d4c-4518-985d-8b1a580cdc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:21.241634 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d7cba-9d4c-4518-985d-8b1a580cdc25 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:21.246723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d7cba-9d4c-4518-985d-8b1a580cdc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:21.246723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d7cba-9d4c-4518-985d-8b1a580cdc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:21.246723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d7cba-9d4c-4518-985d-8b1a580cdc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:21.247244 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d7cba-9d4c-4518-985d-8b1a580cdc25 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:21.261790 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1103/2232] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:38:21.263073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6289fd8-630a-4755-ab5f-9de6a7896127 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:21.273903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6289fd8-630a-4755-ab5f-9de6a7896127 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:21.290323 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f23dba-a8f5-498b-a667-241094ee8dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:21.291867 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f23dba-a8f5-498b-a667-241094ee8dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:21.292489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f23dba-a8f5-498b-a667-241094ee8dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:21.292825 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f23dba-a8f5-498b-a667-241094ee8dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:21.293513 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f23dba-a8f5-498b-a667-241094ee8dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:21.302991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f23dba-a8f5-498b-a667-241094ee8dd2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:21.312036 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1130/2233] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:38:21.324092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d7cba-9d4c-4518-985d-8b1a580cdc25 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:21.338274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d7cba-9d4c-4518-985d-8b1a580cdc25 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:21.350285 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968fe5d-2344-4f1b-ae51-c0cc8cab3973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:21.350285 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968fe5d-2344-4f1b-ae51-c0cc8cab3973 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:21.350780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968fe5d-2344-4f1b-ae51-c0cc8cab3973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:21.351633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968fe5d-2344-4f1b-ae51-c0cc8cab3973 admin admin] PATH_INFO: `/v3/projects/39e300e3bec74a37ba99493c3736b60c/users/a4678daf1b94473c8fa9895af32486b9/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:21.369922 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968fe5d-2344-4f1b-ae51-c0cc8cab3973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e300e3bec74a37ba99493c3736b60c, user_id=a4678daf1b94473c8fa9895af32486b9, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:21.372994 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968fe5d-2344-4f1b-ae51-c0cc8cab3973 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:21.496967 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1104/2234] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:38:21 2022] PUT /identity/v3/projects/39e300e3bec74a37ba99493c3736b60c/users/a4678daf1b94473c8fa9895af32486b9/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:21.501241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f6be6-5d48-46ad-bbe9-72740b1f8822 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:21.501823 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f6be6-5d48-46ad-bbe9-72740b1f8822 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:21.502115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f6be6-5d48-46ad-bbe9-72740b1f8822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:21.555583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-eb4f6be6-5d48-46ad-bbe9-72740b1f8822 None None] MFA Rules not processed for user `a4678daf1b94473c8fa9895af32486b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:21.555583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-eb4f6be6-5d48-46ad-bbe9-72740b1f8822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:21.567923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:21.637385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1131/2235] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:21.649214 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968fe5d-2344-4f1b-ae51-c0cc8cab3973 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:21.651016 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-0968fe5d-2344-4f1b-ae51-c0cc8cab3973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:21.733357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968fe5d-2344-4f1b-ae51-c0cc8cab3973 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:21.737747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afad9a-b541-46d4-907d-5faa93c4eccc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e15cb1d012934ebeac53af885ca65f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:21.738434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afad9a-b541-46d4-907d-5faa93c4eccc service glance] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:21.739086 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afad9a-b541-46d4-907d-5faa93c4eccc service glance] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:21.739457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afad9a-b541-46d4-907d-5faa93c4eccc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:21.749730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afad9a-b541-46d4-907d-5faa93c4eccc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:21.751177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afad9a-b541-46d4-907d-5faa93c4eccc service glance] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:21.771793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1105/2236] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:38:22.130639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:22.559694 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:22.832025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:22.956583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f6be6-5d48-46ad-bbe9-72740b1f8822 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:22.958243 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-eb4f6be6-5d48-46ad-bbe9-72740b1f8822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:23.007494 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afad9a-b541-46d4-907d-5faa93c4eccc service glance] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:23.009069 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-45afad9a-b541-46d4-907d-5faa93c4eccc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:23.037455 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f6be6-5d48-46ad-bbe9-72740b1f8822 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:23.042138 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24570598-1139-495e-a212-e98608acf010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:23.042917 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24570598-1139-495e-a212-e98608acf010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:23.049866 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24570598-1139-495e-a212-e98608acf010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:23.054255 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24570598-1139-495e-a212-e98608acf010 admin admin] PATH_INFO: `/v3/users/e44163744d2b432e847517c746e3a7a1` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:23.057875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24570598-1139-495e-a212-e98608acf010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44163744d2b432e847517c746e3a7a1)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:23.061166 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24570598-1139-495e-a212-e98608acf010 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:23.108759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afad9a-b541-46d4-907d-5faa93c4eccc service glance] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:23.113435 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d47476-5947-4efd-aee4-4257e2150788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:23.114158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d47476-5947-4efd-aee4-4257e2150788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:23.114517 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d47476-5947-4efd-aee4-4257e2150788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:23.114853 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d47476-5947-4efd-aee4-4257e2150788 admin admin] PATH_INFO: `/v3/users/5ab5f94b16dc45febd760314715a35cf` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:23.116033 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d47476-5947-4efd-aee4-4257e2150788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab5f94b16dc45febd760314715a35cf)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:23.118458 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d47476-5947-4efd-aee4-4257e2150788 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:23.210941 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:23.326569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-24570598-1139-495e-a212-e98608acf010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44163744d2b432e847517c746e3a7a1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:23.327131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-24570598-1139-495e-a212-e98608acf010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44163744d2b432e847517c746e3a7a1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:23.341717 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-50d47476-5947-4efd-aee4-4257e2150788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab5f94b16dc45febd760314715a35cf'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:23.342586 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-50d47476-5947-4efd-aee4-4257e2150788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab5f94b16dc45febd760314715a35cf'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:23.343245 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-24570598-1139-495e-a212-e98608acf010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44163744d2b432e847517c746e3a7a1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:23.354572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-50d47476-5947-4efd-aee4-4257e2150788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab5f94b16dc45febd760314715a35cf'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:23.368634 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:23.420431 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-24570598-1139-495e-a212-e98608acf010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44163744d2b432e847517c746e3a7a1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:23.421068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-24570598-1139-495e-a212-e98608acf010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44163744d2b432e847517c746e3a7a1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:23.434521 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1132/2237] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:38:22 2022] DELETE /identity/v3/users/e44163744d2b432e847517c746e3a7a1 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:23.439016 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d65fb-4a30-4f63-9f26-cd3711c76fe6 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:23.439399 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d65fb-4a30-4f63-9f26-cd3711c76fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:23.439684 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d65fb-4a30-4f63-9f26-cd3711c76fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:23.462875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4b4d65fb-4a30-4f63-9f26-cd3711c76fe6 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:23.464068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4b4d65fb-4a30-4f63-9f26-cd3711c76fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:23.467249 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-50d47476-5947-4efd-aee4-4257e2150788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab5f94b16dc45febd760314715a35cf'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:23.468046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-50d47476-5947-4efd-aee4-4257e2150788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab5f94b16dc45febd760314715a35cf'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:23.481385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1106/2238] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:38:23 2022] DELETE /identity/v3/users/5ab5f94b16dc45febd760314715a35cf => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:38:23.485659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13c17a-85d7-47d1-a280-28c42d885aaf None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:23.485941 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13c17a-85d7-47d1-a280-28c42d885aaf None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:23.486215 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13c17a-85d7-47d1-a280-28c42d885aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:23.505649 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-0a13c17a-85d7-47d1-a280-28c42d885aaf None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:23.506837 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-0a13c17a-85d7-47d1-a280-28c42d885aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:23.525702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1133/2239] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:38:23.546775 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d65fb-4a30-4f63-9f26-cd3711c76fe6 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:23.547960 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4b4d65fb-4a30-4f63-9f26-cd3711c76fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:23.574399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1107/2240] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:38:23.594252 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13c17a-85d7-47d1-a280-28c42d885aaf None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:23.595702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-0a13c17a-85d7-47d1-a280-28c42d885aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:23.613806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d65fb-4a30-4f63-9f26-cd3711c76fe6 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:23.661808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13c17a-85d7-47d1-a280-28c42d885aaf None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:23.665821 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622f030-8d3f-4055-b44c-bb497522905f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:23.666052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db756a36-cfd5-4c53-921c-f733ca55e3b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:23.666451 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622f030-8d3f-4055-b44c-bb497522905f service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:23.666575 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db756a36-cfd5-4c53-921c-f733ca55e3b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:23.666738 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622f030-8d3f-4055-b44c-bb497522905f service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:23.666858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db756a36-cfd5-4c53-921c-f733ca55e3b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:23.666999 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622f030-8d3f-4055-b44c-bb497522905f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:23.667095 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db756a36-cfd5-4c53-921c-f733ca55e3b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:23.678490 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622f030-8d3f-4055-b44c-bb497522905f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:23.680364 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622f030-8d3f-4055-b44c-bb497522905f service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:23.683540 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db756a36-cfd5-4c53-921c-f733ca55e3b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:23.685073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db756a36-cfd5-4c53-921c-f733ca55e3b4 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:23.692534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1108/2241] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:38:23.695948 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1134/2242] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:38:23.711366 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:23.782582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:23.895536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622f030-8d3f-4055-b44c-bb497522905f service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:23.899825 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6622f030-8d3f-4055-b44c-bb497522905f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:23.918700 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622f030-8d3f-4055-b44c-bb497522905f service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:23.927957 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18a419-a2ca-49f6-8b2f-9582bd43cee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:23.928809 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18a419-a2ca-49f6-8b2f-9582bd43cee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:23.929522 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18a419-a2ca-49f6-8b2f-9582bd43cee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:23.929522 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18a419-a2ca-49f6-8b2f-9582bd43cee1 admin admin] PATH_INFO: `/v3/users/2a71bbab0bf047bf94a18f4727479cf8` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:23.931695 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18a419-a2ca-49f6-8b2f-9582bd43cee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a71bbab0bf047bf94a18f4727479cf8)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:23.934274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18a419-a2ca-49f6-8b2f-9582bd43cee1 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:24.205099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ff18a419-a2ca-49f6-8b2f-9582bd43cee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a71bbab0bf047bf94a18f4727479cf8'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.205765 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ff18a419-a2ca-49f6-8b2f-9582bd43cee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a71bbab0bf047bf94a18f4727479cf8'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.217308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ff18a419-a2ca-49f6-8b2f-9582bd43cee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a71bbab0bf047bf94a18f4727479cf8'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.222453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:24.229492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db756a36-cfd5-4c53-921c-f733ca55e3b4 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:24.231015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-db756a36-cfd5-4c53-921c-f733ca55e3b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:24.246876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db756a36-cfd5-4c53-921c-f733ca55e3b4 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:24.263096 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78cd2d-89e2-4e2f-9f99-4199dc5327ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:24.263874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78cd2d-89e2-4e2f-9f99-4199dc5327ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:24.264237 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78cd2d-89e2-4e2f-9f99-4199dc5327ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:24.264634 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78cd2d-89e2-4e2f-9f99-4199dc5327ea admin admin] PATH_INFO: `/v3/projects/a1e9bd28b718466198e9b7bf7d6cc1d8` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:24.265812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78cd2d-89e2-4e2f-9f99-4199dc5327ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1e9bd28b718466198e9b7bf7d6cc1d8)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:24.268617 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78cd2d-89e2-4e2f-9f99-4199dc5327ea admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:24.307012 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ff18a419-a2ca-49f6-8b2f-9582bd43cee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a71bbab0bf047bf94a18f4727479cf8'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.307644 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ff18a419-a2ca-49f6-8b2f-9582bd43cee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a71bbab0bf047bf94a18f4727479cf8'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.320142 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:24.325581 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1109/2243] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:38:23 2022] DELETE /identity/v3/users/2a71bbab0bf047bf94a18f4727479cf8 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:38:24.326647 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18a419-a2ca-49f6-8b2f-9582bd43cee1 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:24.328110 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ff18a419-a2ca-49f6-8b2f-9582bd43cee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:24.396541 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18a419-a2ca-49f6-8b2f-9582bd43cee1 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:24.412660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5d78cd2d-89e2-4e2f-9f99-4199dc5327ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1e9bd28b718466198e9b7bf7d6cc1d8', 'request_id': 'req-5d78cd2d-89e2-4e2f-9f99-4199dc5327ea'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.419028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5d78cd2d-89e2-4e2f-9f99-4199dc5327ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1e9bd28b718466198e9b7bf7d6cc1d8', 'request_id': 'req-5d78cd2d-89e2-4e2f-9f99-4199dc5327ea'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.466853 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6411a21-b2da-4f25-b956-8e80acb9f9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:24.467403 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6411a21-b2da-4f25-b956-8e80acb9f9c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:24.467707 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6411a21-b2da-4f25-b956-8e80acb9f9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:24.467983 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6411a21-b2da-4f25-b956-8e80acb9f9c7 admin admin] PATH_INFO: `/v3/projects/63a2ffbe172944a3bfa066f473a1f8da` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:24.469145 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6411a21-b2da-4f25-b956-8e80acb9f9c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a2ffbe172944a3bfa066f473a1f8da)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:24.471815 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6411a21-b2da-4f25-b956-8e80acb9f9c7 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:24.473332 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5d78cd2d-89e2-4e2f-9f99-4199dc5327ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1e9bd28b718466198e9b7bf7d6cc1d8', 'request_id': 'req-5d78cd2d-89e2-4e2f-9f99-4199dc5327ea'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.484671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5d78cd2d-89e2-4e2f-9f99-4199dc5327ea admin admin] The token cache is being invalidate because project a1e9bd28b718466198e9b7bf7d6cc1d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:38:24.484958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5d78cd2d-89e2-4e2f-9f99-4199dc5327ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.485593 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5d78cd2d-89e2-4e2f-9f99-4199dc5327ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.490802 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1135/2244] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:38:24 2022] DELETE /identity/v3/projects/a1e9bd28b718466198e9b7bf7d6cc1d8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:24.490802 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b378028-f28f-4ebc-9859-d5b4f10039d6 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:24.490802 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b378028-f28f-4ebc-9859-d5b4f10039d6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:24.490802 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b378028-f28f-4ebc-9859-d5b4f10039d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:24.508254 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-8b378028-f28f-4ebc-9859-d5b4f10039d6 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:24.509471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8b378028-f28f-4ebc-9859-d5b4f10039d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:24.517186 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1136/2245] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:24.520946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b378028-f28f-4ebc-9859-d5b4f10039d6 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:24.520946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8b378028-f28f-4ebc-9859-d5b4f10039d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:24.531926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b378028-f28f-4ebc-9859-d5b4f10039d6 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:24.538981 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433f896-10b6-4da9-b0fd-345c22d76c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:24.539626 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433f896-10b6-4da9-b0fd-345c22d76c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:24.539905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433f896-10b6-4da9-b0fd-345c22d76c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:24.544522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433f896-10b6-4da9-b0fd-345c22d76c7f admin admin] PATH_INFO: `/v3/users/9ec39dcc2f5c46d998aba77b4a664d8c` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:24.544522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433f896-10b6-4da9-b0fd-345c22d76c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec39dcc2f5c46d998aba77b4a664d8c)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:24.544522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433f896-10b6-4da9-b0fd-345c22d76c7f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:24.578328 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-e6411a21-b2da-4f25-b956-8e80acb9f9c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a2ffbe172944a3bfa066f473a1f8da', 'request_id': 'req-e6411a21-b2da-4f25-b956-8e80acb9f9c7'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.585082 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-e6411a21-b2da-4f25-b956-8e80acb9f9c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a2ffbe172944a3bfa066f473a1f8da', 'request_id': 'req-e6411a21-b2da-4f25-b956-8e80acb9f9c7'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.633077 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-e6411a21-b2da-4f25-b956-8e80acb9f9c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a2ffbe172944a3bfa066f473a1f8da', 'request_id': 'req-e6411a21-b2da-4f25-b956-8e80acb9f9c7'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.644750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-e6411a21-b2da-4f25-b956-8e80acb9f9c7 admin admin] The token cache is being invalidate because project 63a2ffbe172944a3bfa066f473a1f8da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:38:24.645040 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-e6411a21-b2da-4f25-b956-8e80acb9f9c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.645699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-e6411a21-b2da-4f25-b956-8e80acb9f9c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.647375 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1110/2246] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:38:24 2022] DELETE /identity/v3/projects/63a2ffbe172944a3bfa066f473a1f8da => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:24.648139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6411a21-b2da-4f25-b956-8e80acb9f9c7 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:24.649674 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-e6411a21-b2da-4f25-b956-8e80acb9f9c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:24.708420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6411a21-b2da-4f25-b956-8e80acb9f9c7 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:24.712065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5689b0-2b69-47c6-81d3-c5d692fec484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:24.712699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5689b0-2b69-47c6-81d3-c5d692fec484 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:24.713007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5689b0-2b69-47c6-81d3-c5d692fec484 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:24.713276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5689b0-2b69-47c6-81d3-c5d692fec484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:24.715040 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-dd5689b0-2b69-47c6-81d3-c5d692fec484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:24.755848 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6433f896-10b6-4da9-b0fd-345c22d76c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec39dcc2f5c46d998aba77b4a664d8c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.756975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6433f896-10b6-4da9-b0fd-345c22d76c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec39dcc2f5c46d998aba77b4a664d8c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.759306 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:24.772561 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6433f896-10b6-4da9-b0fd-345c22d76c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec39dcc2f5c46d998aba77b4a664d8c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.779848 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5689b0-2b69-47c6-81d3-c5d692fec484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:24.786854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5689b0-2b69-47c6-81d3-c5d692fec484 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:24.793439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1111/2247] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:38:24.794949 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed35c1-efa7-4e6e-af19-346659259de0 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:24.795427 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed35c1-efa7-4e6e-af19-346659259de0 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:24.795777 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed35c1-efa7-4e6e-af19-346659259de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:24.816804 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-aeed35c1-efa7-4e6e-af19-346659259de0 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:24.818000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-aeed35c1-efa7-4e6e-af19-346659259de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:24.825894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1112/2248] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:24.833943 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa5b50-b920-4b2f-948c-dd97ce5ae37e None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:24.834224 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa5b50-b920-4b2f-948c-dd97ce5ae37e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:24.834497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa5b50-b920-4b2f-948c-dd97ce5ae37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:24.852307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:24.854874 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-31fa5b50-b920-4b2f-948c-dd97ce5ae37e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:24.856077 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-31fa5b50-b920-4b2f-948c-dd97ce5ae37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:24.863875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1113/2249] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:38:24.867877 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa5b50-b920-4b2f-948c-dd97ce5ae37e None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:24.876666 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa5b50-b920-4b2f-948c-dd97ce5ae37e None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:24.881784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acc1c2-f279-4eda-a040-dc072f13ddf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:24.882345 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acc1c2-f279-4eda-a040-dc072f13ddf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:24.882623 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acc1c2-f279-4eda-a040-dc072f13ddf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:24.882894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acc1c2-f279-4eda-a040-dc072f13ddf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:24.883517 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9acc1c2-f279-4eda-a040-dc072f13ddf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:38:24.883824 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9acc1c2-f279-4eda-a040-dc072f13ddf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:24.885433 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9acc1c2-f279-4eda-a040-dc072f13ddf7 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:24.895349 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6433f896-10b6-4da9-b0fd-345c22d76c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec39dcc2f5c46d998aba77b4a664d8c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.900695 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6433f896-10b6-4da9-b0fd-345c22d76c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec39dcc2f5c46d998aba77b4a664d8c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:24.900805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1114/2250] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:38:24.903743 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acc1c2-f279-4eda-a040-dc072f13ddf7 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:24.910908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1137/2251] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:38:24 2022] DELETE /identity/v3/users/9ec39dcc2f5c46d998aba77b4a664d8c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:24.913974 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acc1c2-f279-4eda-a040-dc072f13ddf7 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:24.983290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bde974-6fd2-4966-9b9c-4d51f3f64c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:24.984566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bde974-6fd2-4966-9b9c-4d51f3f64c8e admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:24.984856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bde974-6fd2-4966-9b9c-4d51f3f64c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:24.985233 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bde974-6fd2-4966-9b9c-4d51f3f64c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:24.986020 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bde974-6fd2-4966-9b9c-4d51f3f64c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:24.989063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bde974-6fd2-4966-9b9c-4d51f3f64c8e admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:25.159015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1115/2252] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:38:24 2022] POST /identity/v3/projects => generated 371 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:38:25.160642 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433f896-10b6-4da9-b0fd-345c22d76c7f admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:25.174942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433f896-10b6-4da9-b0fd-345c22d76c7f admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:25.243735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e17e9-63fe-4121-87cc-8c0a3ff6205e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:25.244720 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e17e9-63fe-4121-87cc-8c0a3ff6205e admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:25.245190 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e17e9-63fe-4121-87cc-8c0a3ff6205e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:25.245746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e17e9-63fe-4121-87cc-8c0a3ff6205e admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:25.246634 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e17e9-63fe-4121-87cc-8c0a3ff6205e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:25.248894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e17e9-63fe-4121-87cc-8c0a3ff6205e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:25.342351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1138/2253] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:38:25 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:38:25.349786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bde974-6fd2-4966-9b9c-4d51f3f64c8e admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:25.357423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bde974-6fd2-4966-9b9c-4d51f3f64c8e admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:25.362792 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c1f08-ba5a-446a-8aea-91ce5c50c43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:25.363497 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c1f08-ba5a-446a-8aea-91ce5c50c43b admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:25.363704 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c1f08-ba5a-446a-8aea-91ce5c50c43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:25.363977 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c1f08-ba5a-446a-8aea-91ce5c50c43b admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:25.364832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c1f08-ba5a-446a-8aea-91ce5c50c43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:25.366247 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c1f08-ba5a-446a-8aea-91ce5c50c43b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:25.377688 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1116/2254] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:38:25.388680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e17e9-63fe-4121-87cc-8c0a3ff6205e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:25.402616 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e17e9-63fe-4121-87cc-8c0a3ff6205e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:25.409337 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5a6df-f217-4534-9ae7-6d2005170660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:25.418651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5a6df-f217-4534-9ae7-6d2005170660 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:25.418651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5a6df-f217-4534-9ae7-6d2005170660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:25.418651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5a6df-f217-4534-9ae7-6d2005170660 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:25.418651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5a6df-f217-4534-9ae7-6d2005170660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:25.418651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5a6df-f217-4534-9ae7-6d2005170660 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:25.424061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1139/2255] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:38:25.429935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c1f08-ba5a-446a-8aea-91ce5c50c43b admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:25.453602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:25.453693 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c1f08-ba5a-446a-8aea-91ce5c50c43b admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:25.457682 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b62b6d-feba-4d23-a97a-e19ecab1ffb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:25.458523 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b62b6d-feba-4d23-a97a-e19ecab1ffb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:25.458807 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b62b6d-feba-4d23-a97a-e19ecab1ffb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:25.459083 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b62b6d-feba-4d23-a97a-e19ecab1ffb0 admin admin] PATH_INFO: `/v3/projects/b46ed14150ee42d493585604cde74cfa/users/8db5a2625ade476793aa666f96cba650/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:25.475871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b62b6d-feba-4d23-a97a-e19ecab1ffb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46ed14150ee42d493585604cde74cfa, user_id=8db5a2625ade476793aa666f96cba650, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:25.482299 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b62b6d-feba-4d23-a97a-e19ecab1ffb0 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:25.568237 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5a6df-f217-4534-9ae7-6d2005170660 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:25.572697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-02f5a6df-f217-4534-9ae7-6d2005170660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:25.587069 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1117/2256] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:38:25 2022] PUT /identity/v3/projects/b46ed14150ee42d493585604cde74cfa/users/8db5a2625ade476793aa666f96cba650/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:25.587525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b62b6d-feba-4d23-a97a-e19ecab1ffb0 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:25.599704 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-d9b62b6d-feba-4d23-a97a-e19ecab1ffb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:25.599904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5a6df-f217-4534-9ae7-6d2005170660 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:25.662944 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:25.677637 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e1bd9-d396-4b49-8b0e-074314d43357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:25.678348 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e1bd9-d396-4b49-8b0e-074314d43357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:25.678693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e1bd9-d396-4b49-8b0e-074314d43357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:25.679031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e1bd9-d396-4b49-8b0e-074314d43357 admin admin] PATH_INFO: `/v3/projects/1eb7f1fb799a4f259ecc451c34f4d21e` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:25.679629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b62b6d-feba-4d23-a97a-e19ecab1ffb0 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:25.680449 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e1bd9-d396-4b49-8b0e-074314d43357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb7f1fb799a4f259ecc451c34f4d21e)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:25.682910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e1bd9-d396-4b49-8b0e-074314d43357 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:25.684654 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3964b9-86e8-4bef-907c-07d010271f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:25.688655 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3964b9-86e8-4bef-907c-07d010271f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:25.688655 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3964b9-86e8-4bef-907c-07d010271f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:25.688655 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3964b9-86e8-4bef-907c-07d010271f43 admin admin] PATH_INFO: `/v3/projects/a44e9c897e39456087fe7c78081942b4` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:25.688655 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3964b9-86e8-4bef-907c-07d010271f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a44e9c897e39456087fe7c78081942b4)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:25.688971 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3964b9-86e8-4bef-907c-07d010271f43 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:25.797938 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3a3e1bd9-d396-4b49-8b0e-074314d43357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb7f1fb799a4f259ecc451c34f4d21e', 'request_id': 'req-3a3e1bd9-d396-4b49-8b0e-074314d43357'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:25.806873 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3a3e1bd9-d396-4b49-8b0e-074314d43357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb7f1fb799a4f259ecc451c34f4d21e', 'request_id': 'req-3a3e1bd9-d396-4b49-8b0e-074314d43357'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:25.820893 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ec3964b9-86e8-4bef-907c-07d010271f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a44e9c897e39456087fe7c78081942b4', 'request_id': 'req-ec3964b9-86e8-4bef-907c-07d010271f43'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:25.827706 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ec3964b9-86e8-4bef-907c-07d010271f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a44e9c897e39456087fe7c78081942b4', 'request_id': 'req-ec3964b9-86e8-4bef-907c-07d010271f43'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:25.878882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3a3e1bd9-d396-4b49-8b0e-074314d43357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb7f1fb799a4f259ecc451c34f4d21e', 'request_id': 'req-3a3e1bd9-d396-4b49-8b0e-074314d43357'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:25.890115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3a3e1bd9-d396-4b49-8b0e-074314d43357 admin admin] The token cache is being invalidate because project 1eb7f1fb799a4f259ecc451c34f4d21e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:38:25.890428 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3a3e1bd9-d396-4b49-8b0e-074314d43357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:25.891094 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3a3e1bd9-d396-4b49-8b0e-074314d43357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:25.892909 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1140/2257] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:38:25 2022] DELETE /identity/v3/projects/1eb7f1fb799a4f259ecc451c34f4d21e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:38:25.896102 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f22ea-5fe1-46ee-8858-6e363c37f080 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:25.896102 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f22ea-5fe1-46ee-8858-6e363c37f080 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:25.896102 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f22ea-5fe1-46ee-8858-6e363c37f080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:25.914719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-895f22ea-5fe1-46ee-8858-6e363c37f080 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:25.915943 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-895f22ea-5fe1-46ee-8858-6e363c37f080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:25.977363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1141/2258] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:25.978026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f22ea-5fe1-46ee-8858-6e363c37f080 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:25.979357 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-895f22ea-5fe1-46ee-8858-6e363c37f080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:25.991625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ec3964b9-86e8-4bef-907c-07d010271f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a44e9c897e39456087fe7c78081942b4', 'request_id': 'req-ec3964b9-86e8-4bef-907c-07d010271f43'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:25.995954 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f22ea-5fe1-46ee-8858-6e363c37f080 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:25.997382 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867a837-30a2-4658-afb3-d762762eaa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:25.998016 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867a837-30a2-4658-afb3-d762762eaa93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:25.998299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867a837-30a2-4658-afb3-d762762eaa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:25.998578 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867a837-30a2-4658-afb3-d762762eaa93 admin admin] PATH_INFO: `/v3/users/5fd73ea46a144a1d9458c4463a390046` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:25.999712 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867a837-30a2-4658-afb3-d762762eaa93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fd73ea46a144a1d9458c4463a390046)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:26.001761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867a837-30a2-4658-afb3-d762762eaa93 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:26.004111 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ec3964b9-86e8-4bef-907c-07d010271f43 admin admin] The token cache is being invalidate because project a44e9c897e39456087fe7c78081942b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:38:26.004498 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ec3964b9-86e8-4bef-907c-07d010271f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:26.005225 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ec3964b9-86e8-4bef-907c-07d010271f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:26.006724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1118/2259] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:38:25 2022] DELETE /identity/v3/projects/a44e9c897e39456087fe7c78081942b4 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:26.007493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3964b9-86e8-4bef-907c-07d010271f43 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:26.008808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ec3964b9-86e8-4bef-907c-07d010271f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:26.099369 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3964b9-86e8-4bef-907c-07d010271f43 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:26.104911 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795dfcb-e6bf-40b0-a31a-9d600b35ae81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:26.105730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795dfcb-e6bf-40b0-a31a-9d600b35ae81 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:26.106097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795dfcb-e6bf-40b0-a31a-9d600b35ae81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:26.106468 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795dfcb-e6bf-40b0-a31a-9d600b35ae81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:26.108554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f795dfcb-e6bf-40b0-a31a-9d600b35ae81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:26.122354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795dfcb-e6bf-40b0-a31a-9d600b35ae81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:26.124160 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795dfcb-e6bf-40b0-a31a-9d600b35ae81 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:26.135141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1119/2260] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:38:26.197379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0867a837-30a2-4658-afb3-d762762eaa93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fd73ea46a144a1d9458c4463a390046'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:26.198080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0867a837-30a2-4658-afb3-d762762eaa93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fd73ea46a144a1d9458c4463a390046'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:26.210174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0867a837-30a2-4658-afb3-d762762eaa93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fd73ea46a144a1d9458c4463a390046'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:26.301724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0867a837-30a2-4658-afb3-d762762eaa93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fd73ea46a144a1d9458c4463a390046'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:26.302516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0867a837-30a2-4658-afb3-d762762eaa93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fd73ea46a144a1d9458c4463a390046'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:26.315286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1142/2261] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:38:25 2022] DELETE /identity/v3/users/5fd73ea46a144a1d9458c4463a390046 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:26.517991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:26.746879 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:26.963361 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795dfcb-e6bf-40b0-a31a-9d600b35ae81 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:26.965185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f795dfcb-e6bf-40b0-a31a-9d600b35ae81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:26.980215 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795dfcb-e6bf-40b0-a31a-9d600b35ae81 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:27.038727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd24dae-f173-472f-b149-57d38f088e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:27.039367 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd24dae-f173-472f-b149-57d38f088e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:27.039732 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd24dae-f173-472f-b149-57d38f088e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:27.040011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd24dae-f173-472f-b149-57d38f088e0a admin admin] PATH_INFO: `/v3/projects/4f3b41d2125743eb84473dc21a92c01a` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:27.041273 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd24dae-f173-472f-b149-57d38f088e0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f3b41d2125743eb84473dc21a92c01a)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:27.043732 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd24dae-f173-472f-b149-57d38f088e0a admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:27.157972 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-3dd24dae-f173-472f-b149-57d38f088e0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f3b41d2125743eb84473dc21a92c01a', 'request_id': 'req-3dd24dae-f173-472f-b149-57d38f088e0a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:27.164699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-3dd24dae-f173-472f-b149-57d38f088e0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f3b41d2125743eb84473dc21a92c01a', 'request_id': 'req-3dd24dae-f173-472f-b149-57d38f088e0a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:27.250380 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-3dd24dae-f173-472f-b149-57d38f088e0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f3b41d2125743eb84473dc21a92c01a', 'request_id': 'req-3dd24dae-f173-472f-b149-57d38f088e0a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:27.262851 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-3dd24dae-f173-472f-b149-57d38f088e0a admin admin] The token cache is being invalidate because project 4f3b41d2125743eb84473dc21a92c01a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:38:27.263141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-3dd24dae-f173-472f-b149-57d38f088e0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:27.263757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-3dd24dae-f173-472f-b149-57d38f088e0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:27.265354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1120/2262] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:38:26 2022] DELETE /identity/v3/projects/4f3b41d2125743eb84473dc21a92c01a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:27.268051 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:27.272766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e0bf9-4740-4716-ad60-e5eb20818f61 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:27.273911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e0bf9-4740-4716-ad60-e5eb20818f61 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:27.274192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e0bf9-4740-4716-ad60-e5eb20818f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:27.304782 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-063e0bf9-4740-4716-ad60-e5eb20818f61 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:27.306382 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-063e0bf9-4740-4716-ad60-e5eb20818f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:27.373265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1143/2263] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:27.381371 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86823bf8-bccb-46bf-a4d8-d22ea26f4764 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:27.381666 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86823bf8-bccb-46bf-a4d8-d22ea26f4764 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:27.381948 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86823bf8-bccb-46bf-a4d8-d22ea26f4764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:27.394297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:27.408450 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-86823bf8-bccb-46bf-a4d8-d22ea26f4764 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:27.408450 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-86823bf8-bccb-46bf-a4d8-d22ea26f4764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:27.414513 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1121/2264] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:27.418820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e0bf9-4740-4716-ad60-e5eb20818f61 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:27.429288 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e0bf9-4740-4716-ad60-e5eb20818f61 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:27.434306 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33021465-34e5-4bec-a977-c2ffea1872c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:27.434899 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33021465-34e5-4bec-a977-c2ffea1872c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:27.435200 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33021465-34e5-4bec-a977-c2ffea1872c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:27.435471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33021465-34e5-4bec-a977-c2ffea1872c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:27.436116 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33021465-34e5-4bec-a977-c2ffea1872c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:38:27.436440 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33021465-34e5-4bec-a977-c2ffea1872c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:27.438024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33021465-34e5-4bec-a977-c2ffea1872c3 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:27.450836 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1144/2265] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:38:27.455290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86823bf8-bccb-46bf-a4d8-d22ea26f4764 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:27.464777 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86823bf8-bccb-46bf-a4d8-d22ea26f4764 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:27.469479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee17de4-fa4e-4e5c-b9c8-07b62e09ddfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:27.470083 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee17de4-fa4e-4e5c-b9c8-07b62e09ddfa admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:27.470355 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee17de4-fa4e-4e5c-b9c8-07b62e09ddfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:27.470626 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee17de4-fa4e-4e5c-b9c8-07b62e09ddfa admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:27.471377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee17de4-fa4e-4e5c-b9c8-07b62e09ddfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:27.473361 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee17de4-fa4e-4e5c-b9c8-07b62e09ddfa admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:27.563949 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1122/2266] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:38:27 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:38:27.568683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33021465-34e5-4bec-a977-c2ffea1872c3 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:27.579028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33021465-34e5-4bec-a977-c2ffea1872c3 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:27.637990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817d318-1ad9-4b13-919c-b9bd62ae70e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:27.638613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817d318-1ad9-4b13-919c-b9bd62ae70e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:27.639083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817d318-1ad9-4b13-919c-b9bd62ae70e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:27.639750 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817d318-1ad9-4b13-919c-b9bd62ae70e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:27.641008 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817d318-1ad9-4b13-919c-b9bd62ae70e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:27.644515 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817d318-1ad9-4b13-919c-b9bd62ae70e4 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:27.653541 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd34b11-89fd-4076-aaa3-899285050bb6 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:27.653907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd34b11-89fd-4076-aaa3-899285050bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:27.654654 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd34b11-89fd-4076-aaa3-899285050bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:27.685788 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-6cd34b11-89fd-4076-aaa3-899285050bb6 None None] MFA Rules not processed for user `8db5a2625ade476793aa666f96cba650`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:27.687387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6cd34b11-89fd-4076-aaa3-899285050bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:27.742184 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1145/2267] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:38:27 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:38:27.745978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817d318-1ad9-4b13-919c-b9bd62ae70e4 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:27.757622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817d318-1ad9-4b13-919c-b9bd62ae70e4 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:27.761074 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1123/2268] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:27.762763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d6dfe-4d0f-4552-b97c-3b24af883ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:27.763363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d6dfe-4d0f-4552-b97c-3b24af883ece admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:27.770050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d6dfe-4d0f-4552-b97c-3b24af883ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:27.770050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d6dfe-4d0f-4552-b97c-3b24af883ece admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:27.770050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d6dfe-4d0f-4552-b97c-3b24af883ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:27.770050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d6dfe-4d0f-4552-b97c-3b24af883ece admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:27.780038 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd34b11-89fd-4076-aaa3-899285050bb6 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:27.781594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1146/2269] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:38:27.782774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6cd34b11-89fd-4076-aaa3-899285050bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:27.786700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d6dfe-4d0f-4552-b97c-3b24af883ece admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:27.800505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d6dfe-4d0f-4552-b97c-3b24af883ece admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:27.807603 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1edc86-4201-4dd0-9dcb-85aba16e92cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:27.808729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1edc86-4201-4dd0-9dcb-85aba16e92cd admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:27.809009 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1edc86-4201-4dd0-9dcb-85aba16e92cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:27.809280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1edc86-4201-4dd0-9dcb-85aba16e92cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:27.810419 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1edc86-4201-4dd0-9dcb-85aba16e92cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:27.812165 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1edc86-4201-4dd0-9dcb-85aba16e92cd admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:27.823531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1147/2270] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:38:27.827533 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1edc86-4201-4dd0-9dcb-85aba16e92cd admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:27.837220 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1edc86-4201-4dd0-9dcb-85aba16e92cd admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:27.841786 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960b746-f7a0-4d00-8351-68e9ebc719a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:27.842440 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960b746-f7a0-4d00-8351-68e9ebc719a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:27.842758 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960b746-f7a0-4d00-8351-68e9ebc719a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:27.843035 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960b746-f7a0-4d00-8351-68e9ebc719a3 admin admin] PATH_INFO: `/v3/projects/4e8dfb444e254135a245904b4e256d19/users/dd5d5aa2b54e49b5b4f996b70c2f523e/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:27.846940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd34b11-89fd-4076-aaa3-899285050bb6 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:27.850591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ee660-553b-447a-a17a-6df2cdc2c1f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:27.851187 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ee660-553b-447a-a17a-6df2cdc2c1f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:27.851463 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ee660-553b-447a-a17a-6df2cdc2c1f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:27.851736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ee660-553b-447a-a17a-6df2cdc2c1f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:27.858405 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960b746-f7a0-4d00-8351-68e9ebc719a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8dfb444e254135a245904b4e256d19, user_id=dd5d5aa2b54e49b5b4f996b70c2f523e, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:27.860060 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ee660-553b-447a-a17a-6df2cdc2c1f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:27.861566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ee660-553b-447a-a17a-6df2cdc2c1f1 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:27.863208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960b746-f7a0-4d00-8351-68e9ebc719a3 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:27.871575 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1124/2271] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:38:27.937969 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1148/2272] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:38:27 2022] PUT /identity/v3/projects/4e8dfb444e254135a245904b4e256d19/users/dd5d5aa2b54e49b5b4f996b70c2f523e/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:38:27.942837 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:27.951463 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42fca2-d110-4e0c-932d-08e0180b5ccc None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:27.951753 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42fca2-d110-4e0c-932d-08e0180b5ccc None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:27.952027 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42fca2-d110-4e0c-932d-08e0180b5ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:27.986542 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-6c42fca2-d110-4e0c-932d-08e0180b5ccc None None] MFA Rules not processed for user `dd5d5aa2b54e49b5b4f996b70c2f523e`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:27.988527 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6c42fca2-d110-4e0c-932d-08e0180b5ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:28.057671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:28.070765 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1125/2273] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:28.078072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960b746-f7a0-4d00-8351-68e9ebc719a3 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:28.079949 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d960b746-f7a0-4d00-8351-68e9ebc719a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:28.137579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960b746-f7a0-4d00-8351-68e9ebc719a3 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:28.141731 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d308b54-a86f-41f7-b34f-64a2e3255b3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:28.141892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d308b54-a86f-41f7-b34f-64a2e3255b3b service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:28.142175 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d308b54-a86f-41f7-b34f-64a2e3255b3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:28.142447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d308b54-a86f-41f7-b34f-64a2e3255b3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:28.151915 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d308b54-a86f-41f7-b34f-64a2e3255b3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:28.153362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d308b54-a86f-41f7-b34f-64a2e3255b3b service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:28.162991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1149/2274] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:38:28.223242 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:28.324380 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:28.907711 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:29.143035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:29.580269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b57e4-319d-4382-b890-10adfd3c2d0a None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:29.581226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b57e4-319d-4382-b890-10adfd3c2d0a None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:29.581612 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b57e4-319d-4382-b890-10adfd3c2d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:29.587605 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:29.603147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-db2b57e4-319d-4382-b890-10adfd3c2d0a None None] MFA Rules not processed for user `8db5a2625ade476793aa666f96cba650`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:29.604445 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-db2b57e4-319d-4382-b890-10adfd3c2d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:29.667774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:29.679524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1126/2275] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:30.152438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:30.393716 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:31.141915 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:31.382607 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:32.092437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:32.325176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:32.949134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:33.146543 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:33.614637 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:33.666404 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:34.084986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:34.256620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:34.353523 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:34.387593 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:34.460573 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:40.376838 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff85dce-da6c-46f1-b688-f486bb4c9087 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:40.377324 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff85dce-da6c-46f1-b688-f486bb4c9087 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:40.377433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff85dce-da6c-46f1-b688-f486bb4c9087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:40.397209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-eff85dce-da6c-46f1-b688-f486bb4c9087 None None] MFA Rules not processed for user `a84e162448a64727acdb841c839a384d`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:40.398415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-eff85dce-da6c-46f1-b688-f486bb4c9087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:40.455520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1150/2276] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:41.510352 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b57e4-319d-4382-b890-10adfd3c2d0a None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:41.573161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b57e4-319d-4382-b890-10adfd3c2d0a None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:41.577748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a9db0-fe95-4cd9-99ed-42d284f69a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:41.578377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a9db0-fe95-4cd9-99ed-42d284f69a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:41.578671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a9db0-fe95-4cd9-99ed-42d284f69a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:41.578934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a9db0-fe95-4cd9-99ed-42d284f69a2f admin admin] PATH_INFO: `/v3/users/dd5d5aa2b54e49b5b4f996b70c2f523e` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:41.580073 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a9db0-fe95-4cd9-99ed-42d284f69a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd5d5aa2b54e49b5b4f996b70c2f523e)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:41.585785 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a9db0-fe95-4cd9-99ed-42d284f69a2f admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:41.588601 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:41.897663 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d54a9db0-fe95-4cd9-99ed-42d284f69a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd5d5aa2b54e49b5b4f996b70c2f523e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:41.898315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d54a9db0-fe95-4cd9-99ed-42d284f69a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd5d5aa2b54e49b5b4f996b70c2f523e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:41.909972 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d54a9db0-fe95-4cd9-99ed-42d284f69a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd5d5aa2b54e49b5b4f996b70c2f523e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:41.992700 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d54a9db0-fe95-4cd9-99ed-42d284f69a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd5d5aa2b54e49b5b4f996b70c2f523e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:41.993456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d54a9db0-fe95-4cd9-99ed-42d284f69a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd5d5aa2b54e49b5b4f996b70c2f523e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:42.008192 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1127/2277] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:38:41 2022] DELETE /identity/v3/users/dd5d5aa2b54e49b5b4f996b70c2f523e => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:42.012558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126246d7-fc84-4a5a-83a9-fbe20673d859 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:42.013068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126246d7-fc84-4a5a-83a9-fbe20673d859 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:42.013160 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126246d7-fc84-4a5a-83a9-fbe20673d859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:42.033439 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-126246d7-fc84-4a5a-83a9-fbe20673d859 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:42.034628 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-126246d7-fc84-4a5a-83a9-fbe20673d859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:42.086049 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:42.095270 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1151/2278] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:42.105165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a9db0-fe95-4cd9-99ed-42d284f69a2f admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:42.106592 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-d54a9db0-fe95-4cd9-99ed-42d284f69a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:42.164431 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a9db0-fe95-4cd9-99ed-42d284f69a2f admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:42.168187 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398f212-b670-4ae7-aac3-9fc06190730c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:42.169037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398f212-b670-4ae7-aac3-9fc06190730c service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:42.169311 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398f212-b670-4ae7-aac3-9fc06190730c service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:42.169576 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398f212-b670-4ae7-aac3-9fc06190730c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:42.196580 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398f212-b670-4ae7-aac3-9fc06190730c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:42.196580 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398f212-b670-4ae7-aac3-9fc06190730c service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:42.196580 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1128/2279] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:38:42.750844 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126246d7-fc84-4a5a-83a9-fbe20673d859 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:42.752430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-126246d7-fc84-4a5a-83a9-fbe20673d859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:42.766958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126246d7-fc84-4a5a-83a9-fbe20673d859 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:42.772418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7434b-2335-4e2c-ac78-9bbef54786e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:42.773340 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7434b-2335-4e2c-ac78-9bbef54786e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:42.774192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7434b-2335-4e2c-ac78-9bbef54786e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:42.774192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7434b-2335-4e2c-ac78-9bbef54786e3 admin admin] PATH_INFO: `/v3/projects/4e8dfb444e254135a245904b4e256d19` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:42.775683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7434b-2335-4e2c-ac78-9bbef54786e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8dfb444e254135a245904b4e256d19)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:42.777894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7434b-2335-4e2c-ac78-9bbef54786e3 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:42.915833 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-70c7434b-2335-4e2c-ac78-9bbef54786e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8dfb444e254135a245904b4e256d19', 'request_id': 'req-70c7434b-2335-4e2c-ac78-9bbef54786e3'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:42.922414 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-70c7434b-2335-4e2c-ac78-9bbef54786e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8dfb444e254135a245904b4e256d19', 'request_id': 'req-70c7434b-2335-4e2c-ac78-9bbef54786e3'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:43.032267 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-70c7434b-2335-4e2c-ac78-9bbef54786e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8dfb444e254135a245904b4e256d19', 'request_id': 'req-70c7434b-2335-4e2c-ac78-9bbef54786e3'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:43.044891 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-70c7434b-2335-4e2c-ac78-9bbef54786e3 admin admin] The token cache is being invalidate because project 4e8dfb444e254135a245904b4e256d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:38:43.045182 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-70c7434b-2335-4e2c-ac78-9bbef54786e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:43.045814 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-70c7434b-2335-4e2c-ac78-9bbef54786e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:43.047389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1152/2280] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:38:42 2022] DELETE /identity/v3/projects/4e8dfb444e254135a245904b4e256d19 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:52.187929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:52.383233 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398f212-b670-4ae7-aac3-9fc06190730c service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:52.384686 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6398f212-b670-4ae7-aac3-9fc06190730c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:52.398473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398f212-b670-4ae7-aac3-9fc06190730c service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:52.537149 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb754663-4d1b-40fc-a416-8f0185141c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:52.538133 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb754663-4d1b-40fc-a416-8f0185141c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:52.538567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb754663-4d1b-40fc-a416-8f0185141c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:52.539192 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb754663-4d1b-40fc-a416-8f0185141c1d admin admin] PATH_INFO: `/v3/users/a4678daf1b94473c8fa9895af32486b9` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:52.543229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb754663-4d1b-40fc-a416-8f0185141c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4678daf1b94473c8fa9895af32486b9)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:52.545248 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb754663-4d1b-40fc-a416-8f0185141c1d admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:52.925447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-fb754663-4d1b-40fc-a416-8f0185141c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4678daf1b94473c8fa9895af32486b9'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:52.927536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-fb754663-4d1b-40fc-a416-8f0185141c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4678daf1b94473c8fa9895af32486b9'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:52.941726 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-fb754663-4d1b-40fc-a416-8f0185141c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4678daf1b94473c8fa9895af32486b9'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:53.041670 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:53.062431 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-fb754663-4d1b-40fc-a416-8f0185141c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4678daf1b94473c8fa9895af32486b9'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:53.063317 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-fb754663-4d1b-40fc-a416-8f0185141c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4678daf1b94473c8fa9895af32486b9'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:53.085020 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1129/2281] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:38:52 2022] DELETE /identity/v3/users/a4678daf1b94473c8fa9895af32486b9 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:53.089341 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c7364-6421-423d-86c1-fec0d4125bdc None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:53.094068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c7364-6421-423d-86c1-fec0d4125bdc None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:53.094068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c7364-6421-423d-86c1-fec0d4125bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:53.108966 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-f57c7364-6421-423d-86c1-fec0d4125bdc None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:53.110189 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f57c7364-6421-423d-86c1-fec0d4125bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:53.176407 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1153/2282] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:38:53.183645 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb754663-4d1b-40fc-a416-8f0185141c1d admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:53.185261 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-fb754663-4d1b-40fc-a416-8f0185141c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:53.248504 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb754663-4d1b-40fc-a416-8f0185141c1d admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:53.252200 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc239b-d391-49d5-81ba-29b21aea38eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:53.252923 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc239b-d391-49d5-81ba-29b21aea38eb service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:53.253206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc239b-d391-49d5-81ba-29b21aea38eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:53.253483 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc239b-d391-49d5-81ba-29b21aea38eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:53.263363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc239b-d391-49d5-81ba-29b21aea38eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:53.264909 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc239b-d391-49d5-81ba-29b21aea38eb service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:53.275794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1130/2283] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:38:53.715693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c7364-6421-423d-86c1-fec0d4125bdc None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:38:53.718436 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f57c7364-6421-423d-86c1-fec0d4125bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:53.732355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c7364-6421-423d-86c1-fec0d4125bdc None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:38:53.737291 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d22f17-0534-4cdf-9fa9-3cb40e776eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:38:53.738082 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d22f17-0534-4cdf-9fa9-3cb40e776eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:53.738460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d22f17-0534-4cdf-9fa9-3cb40e776eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:53.738835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d22f17-0534-4cdf-9fa9-3cb40e776eb9 admin admin] PATH_INFO: `/v3/projects/39e300e3bec74a37ba99493c3736b60c` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:53.740841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d22f17-0534-4cdf-9fa9-3cb40e776eb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e300e3bec74a37ba99493c3736b60c)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:38:53.743158 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d22f17-0534-4cdf-9fa9-3cb40e776eb9 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:38:53.914518 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a5d22f17-0534-4cdf-9fa9-3cb40e776eb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e300e3bec74a37ba99493c3736b60c', 'request_id': 'req-a5d22f17-0534-4cdf-9fa9-3cb40e776eb9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:53.921069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a5d22f17-0534-4cdf-9fa9-3cb40e776eb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e300e3bec74a37ba99493c3736b60c', 'request_id': 'req-a5d22f17-0534-4cdf-9fa9-3cb40e776eb9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:54.028200 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a5d22f17-0534-4cdf-9fa9-3cb40e776eb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e300e3bec74a37ba99493c3736b60c', 'request_id': 'req-a5d22f17-0534-4cdf-9fa9-3cb40e776eb9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:54.043571 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a5d22f17-0534-4cdf-9fa9-3cb40e776eb9 admin admin] The token cache is being invalidate because project 39e300e3bec74a37ba99493c3736b60c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:38:54.044163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a5d22f17-0534-4cdf-9fa9-3cb40e776eb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:54.044780 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a5d22f17-0534-4cdf-9fa9-3cb40e776eb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:38:54.062180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1154/2284] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:38:53 2022] DELETE /identity/v3/projects/39e300e3bec74a37ba99493c3736b60c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:38:54.944597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78dd5e-29cb-43a6-b9c5-8b28f5e76bc9 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:38:54.945012 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78dd5e-29cb-43a6-b9c5-8b28f5e76bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:38:54.945152 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78dd5e-29cb-43a6-b9c5-8b28f5e76bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:38:54.964803 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-6e78dd5e-29cb-43a6-b9c5-8b28f5e76bc9 None None] MFA Rules not processed for user `8db5a2625ade476793aa666f96cba650`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:38:54.966001 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6e78dd5e-29cb-43a6-b9c5-8b28f5e76bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:38:54.984637 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:55.024279 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1131/2285] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:38:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:39:00.400360 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b72b4d-b0ae-44aa-9ea5-8b8eff28fb24 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:00.401223 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b72b4d-b0ae-44aa-9ea5-8b8eff28fb24 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:00.401650 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b72b4d-b0ae-44aa-9ea5-8b8eff28fb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:00.425051 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-f6b72b4d-b0ae-44aa-9ea5-8b8eff28fb24 None None] MFA Rules not processed for user `0c8d0a718e8347b5af397f866056266e`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:39:00.431567 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f6b72b4d-b0ae-44aa-9ea5-8b8eff28fb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:39:00.483891 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1155/2286] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 27 16:39:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:39:00.529083 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78dd5e-29cb-43a6-b9c5-8b28f5e76bc9 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:39:00.529774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6e78dd5e-29cb-43a6-b9c5-8b28f5e76bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:39:00.600350 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78dd5e-29cb-43a6-b9c5-8b28f5e76bc9 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:39:00.606249 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7533a8-33cd-4e1e-aeb9-8d9c686f38d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b85e430004a8b865622354c1d1ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:39:00.606893 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7533a8-33cd-4e1e-aeb9-8d9c686f38d4 service swift] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:00.607179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7533a8-33cd-4e1e-aeb9-8d9c686f38d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:00.610743 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7533a8-33cd-4e1e-aeb9-8d9c686f38d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:00.616931 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7533a8-33cd-4e1e-aeb9-8d9c686f38d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:39:00.618005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7533a8-33cd-4e1e-aeb9-8d9c686f38d4 service swift] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:39:00.628157 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1132/2287] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 27 16:39:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 16:39:10.476487 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:10.625739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=47 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:19.810162 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7731944-7f65-42e6-99ee-449ba77f707b None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:19.810632 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7731944-7f65-42e6-99ee-449ba77f707b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:19.810773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7731944-7f65-42e6-99ee-449ba77f707b None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:19.812267 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1156/2288] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 27 16:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:39:19.818120 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cf11f-cafe-4d0a-951d-a6e36c43d49d None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:19.818564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cf11f-cafe-4d0a-951d-a6e36c43d49d None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:19.818658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cf11f-cafe-4d0a-951d-a6e36c43d49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:19.839166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-163cf11f-cafe-4d0a-951d-a6e36c43d49d None None] MFA Rules not processed for user `e71fea96b2b949f9abca12172e69284b`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:39:19.840464 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-163cf11f-cafe-4d0a-951d-a6e36c43d49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:39:19.924302 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1133/2289] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 27 16:39:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:39:19.942219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7731944-7f65-42e6-99ee-449ba77f707b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:39:19.944666 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c7731944-7f65-42e6-99ee-449ba77f707b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:39:20.008203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7731944-7f65-42e6-99ee-449ba77f707b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:39:20.011933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764befd-8ed7-4f60-8556-0a2675fad1c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e15cb1d012934ebeac53af885ca65f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:39:20.012547 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764befd-8ed7-4f60-8556-0a2675fad1c8 service glance] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:20.012828 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764befd-8ed7-4f60-8556-0a2675fad1c8 service glance] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:20.013102 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764befd-8ed7-4f60-8556-0a2675fad1c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:20.023087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764befd-8ed7-4f60-8556-0a2675fad1c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:39:20.024600 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764befd-8ed7-4f60-8556-0a2675fad1c8 service glance] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:39:20.038855 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1157/2290] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:39:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:39:20.277776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb5420-0f77-4bd8-91d9-287faa91850b None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:20.279326 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb5420-0f77-4bd8-91d9-287faa91850b None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:20.279326 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb5420-0f77-4bd8-91d9-287faa91850b None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:20.279773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1134/2291] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 27 16:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:39:20.284797 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44bfe5-93c9-401a-bd01-3888d73f2115 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:20.285085 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44bfe5-93c9-401a-bd01-3888d73f2115 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:20.285517 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44bfe5-93c9-401a-bd01-3888d73f2115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:20.306179 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1c44bfe5-93c9-401a-bd01-3888d73f2115 None None] MFA Rules not processed for user `758380280e33458f8f9112147d5a7819`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:39:20.307541 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1c44bfe5-93c9-401a-bd01-3888d73f2115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:39:20.359660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1158/2292] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 27 16:39:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:39:20.371472 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb5420-0f77-4bd8-91d9-287faa91850b None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:39:20.373205 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-63fb5420-0f77-4bd8-91d9-287faa91850b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:39:20.386825 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb5420-0f77-4bd8-91d9-287faa91850b None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:39:20.390291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063d886-6f2c-4721-a826-77884ca900b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:39:20.390934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063d886-6f2c-4721-a826-77884ca900b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:20.391187 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063d886-6f2c-4721-a826-77884ca900b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:20.391456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063d886-6f2c-4721-a826-77884ca900b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:20.398504 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063d886-6f2c-4721-a826-77884ca900b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:39:20.400639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063d886-6f2c-4721-a826-77884ca900b0 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:39:20.408528 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1135/2293] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:39:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:39:20.493997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf612b0-9cfa-427a-84f6-b5143ced9b2a None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:20.494292 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf612b0-9cfa-427a-84f6-b5143ced9b2a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:20.494575 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf612b0-9cfa-427a-84f6-b5143ced9b2a None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:20.496100 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1159/2294] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 27 16:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:39:20.501304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25b916-560d-4cd6-83f7-32534b676292 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:20.501617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25b916-560d-4cd6-83f7-32534b676292 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:20.501891 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25b916-560d-4cd6-83f7-32534b676292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:20.523204 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-ac25b916-560d-4cd6-83f7-32534b676292 None None] MFA Rules not processed for user `e71fea96b2b949f9abca12172e69284b`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:39:20.533747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ac25b916-560d-4cd6-83f7-32534b676292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:39:20.534459 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1136/2295] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 27 16:39:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:39:20.545102 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf612b0-9cfa-427a-84f6-b5143ced9b2a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:39:20.546840 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7bf612b0-9cfa-427a-84f6-b5143ced9b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:39:20.562306 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf612b0-9cfa-427a-84f6-b5143ced9b2a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:39:20.564702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0afe8e-9fab-436c-b974-04fec597011d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:39:20.565308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0afe8e-9fab-436c-b974-04fec597011d service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:20.565591 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0afe8e-9fab-436c-b974-04fec597011d service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:20.565866 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0afe8e-9fab-436c-b974-04fec597011d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:20.576438 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0afe8e-9fab-436c-b974-04fec597011d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:39:20.577957 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0afe8e-9fab-436c-b974-04fec597011d service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:39:20.590334 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1160/2296] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:39:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:39:22.049957 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b701a2-ffda-480a-a763-4573155a450e None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:22.050423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b701a2-ffda-480a-a763-4573155a450e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:22.050864 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b701a2-ffda-480a-a763-4573155a450e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:22.072687 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-c7b701a2-ffda-480a-a763-4573155a450e None None] MFA Rules not processed for user `0c8d0a718e8347b5af397f866056266e`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:39:22.073989 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c7b701a2-ffda-480a-a763-4573155a450e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:39:22.082072 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1137/2297] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 27 16:39:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:39:22.096674 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0afe8e-9fab-436c-b974-04fec597011d service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:39:22.108000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0afe8e-9fab-436c-b974-04fec597011d service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:39:22.113414 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50867242-f7a2-4466-b48b-94b099531cc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b85e430004a8b865622354c1d1ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:39:22.114022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50867242-f7a2-4466-b48b-94b099531cc7 service swift] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:22.114301 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50867242-f7a2-4466-b48b-94b099531cc7 service swift] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:22.114576 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50867242-f7a2-4466-b48b-94b099531cc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:22.123325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50867242-f7a2-4466-b48b-94b099531cc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:39:22.124971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50867242-f7a2-4466-b48b-94b099531cc7 service swift] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:39:22.133875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1161/2298] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 27 16:39:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 16:39:25.239772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1ec54-244b-4710-8113-601388a1e587 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:25.240319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1ec54-244b-4710-8113-601388a1e587 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:25.240319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1ec54-244b-4710-8113-601388a1e587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:25.265300 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-f0c1ec54-244b-4710-8113-601388a1e587 None None] MFA Rules not processed for user `a6507ed9a47848c29d72fd9af71e2cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:39:25.266839 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f0c1ec54-244b-4710-8113-601388a1e587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:39:25.336263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1138/2299] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:39:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:39:25.549171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbbe11-a88b-4c03-976b-3f7e80b29724 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:25.549744 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbbe11-a88b-4c03-976b-3f7e80b29724 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:25.549937 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbbe11-a88b-4c03-976b-3f7e80b29724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:25.576433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-5bcbbe11-a88b-4c03-976b-3f7e80b29724 None None] MFA Rules not processed for user `0c8d0a718e8347b5af397f866056266e`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:39:25.577983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5bcbbe11-a88b-4c03-976b-3f7e80b29724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:39:25.592251 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1162/2300] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 27 16:39:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:39:25.609439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1ec54-244b-4710-8113-601388a1e587 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:39:25.622964 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1ec54-244b-4710-8113-601388a1e587 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:39:25.628638 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da2370-2815-40bb-918e-853b273a98b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b85e430004a8b865622354c1d1ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:39:25.629253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da2370-2815-40bb-918e-853b273a98b6 service swift] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:25.629530 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da2370-2815-40bb-918e-853b273a98b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:25.629808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da2370-2815-40bb-918e-853b273a98b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:25.639493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da2370-2815-40bb-918e-853b273a98b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:39:25.641590 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da2370-2815-40bb-918e-853b273a98b6 service swift] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:39:25.652087 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1139/2301] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 27 16:39:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 16:39:35.570880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=64 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:35.647578 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=74 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:40.944587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd0bdc-0b2c-44c8-8783-028489460227 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:40.947195 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd0bdc-0b2c-44c8-8783-028489460227 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:40.947195 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd0bdc-0b2c-44c8-8783-028489460227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:40.972061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-e5bd0bdc-0b2c-44c8-8783-028489460227 None None] MFA Rules not processed for user `0c8d0a718e8347b5af397f866056266e`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:39:40.975931 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e5bd0bdc-0b2c-44c8-8783-028489460227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:39:40.981853 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1163/2302] 10.222.0.26 () {58 vars in 967 bytes} [Tue Sep 27 16:39:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:39:40.995598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da2370-2815-40bb-918e-853b273a98b6 service swift] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:39:41.006549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da2370-2815-40bb-918e-853b273a98b6 service swift] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:39:41.011968 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641822dd-1e07-47c1-bb23-d3a562ca7b3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b85e430004a8b865622354c1d1ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:39:41.012839 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641822dd-1e07-47c1-bb23-d3a562ca7b3b service swift] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:41.013279 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641822dd-1e07-47c1-bb23-d3a562ca7b3b service swift] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:41.013737 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641822dd-1e07-47c1-bb23-d3a562ca7b3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:41.023937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641822dd-1e07-47c1-bb23-d3a562ca7b3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:39:41.025804 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641822dd-1e07-47c1-bb23-d3a562ca7b3b service swift] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:39:41.035489 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1140/2303] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 27 16:39:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 16:39:43.166615 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e172d-b35a-4f6a-932c-c1446941001c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:43.167084 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e172d-b35a-4f6a-932c-c1446941001c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:43.167177 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e172d-b35a-4f6a-932c-c1446941001c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:43.186897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a02e172d-b35a-4f6a-932c-c1446941001c None None] MFA Rules not processed for user `0c8d0a718e8347b5af397f866056266e`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:39:43.188102 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a02e172d-b35a-4f6a-932c-c1446941001c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:39:43.195220 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1164/2304] 10.222.0.26 () {58 vars in 967 bytes} [Tue Sep 27 16:39:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:39:43.208126 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641822dd-1e07-47c1-bb23-d3a562ca7b3b service swift] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:39:43.219218 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641822dd-1e07-47c1-bb23-d3a562ca7b3b service swift] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:39:43.224180 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406daca-ad0c-4835-b53a-876401fb47d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b85e430004a8b865622354c1d1ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:39:43.224807 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406daca-ad0c-4835-b53a-876401fb47d3 service swift] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:43.225087 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406daca-ad0c-4835-b53a-876401fb47d3 service swift] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:43.225358 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406daca-ad0c-4835-b53a-876401fb47d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:43.233141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406daca-ad0c-4835-b53a-876401fb47d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:39:43.234716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406daca-ad0c-4835-b53a-876401fb47d3 service swift] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:39:43.242635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1141/2305] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 27 16:39:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 16:39:44.585552 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e172d-b35a-4f6a-932c-c1446941001c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:39:44.587033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a02e172d-b35a-4f6a-932c-c1446941001c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:39:44.658067 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e172d-b35a-4f6a-932c-c1446941001c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:39:44.662603 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de37071-92d8-410f-88d7-40dc9ce294cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:39:44.663221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de37071-92d8-410f-88d7-40dc9ce294cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:44.663499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de37071-92d8-410f-88d7-40dc9ce294cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:44.663773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de37071-92d8-410f-88d7-40dc9ce294cc admin admin] PATH_INFO: `/v3/users/8db5a2625ade476793aa666f96cba650` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:44.664911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de37071-92d8-410f-88d7-40dc9ce294cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8db5a2625ade476793aa666f96cba650)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:39:44.666867 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de37071-92d8-410f-88d7-40dc9ce294cc admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:39:44.851276 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6de37071-92d8-410f-88d7-40dc9ce294cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8db5a2625ade476793aa666f96cba650'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:39:44.852061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6de37071-92d8-410f-88d7-40dc9ce294cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8db5a2625ade476793aa666f96cba650'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:39:44.866138 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6de37071-92d8-410f-88d7-40dc9ce294cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8db5a2625ade476793aa666f96cba650'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:39:44.968567 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6de37071-92d8-410f-88d7-40dc9ce294cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8db5a2625ade476793aa666f96cba650'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:39:44.968567 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6de37071-92d8-410f-88d7-40dc9ce294cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8db5a2625ade476793aa666f96cba650'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:39:44.978892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1165/2306] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:39:44 2022] DELETE /identity/v3/users/8db5a2625ade476793aa666f96cba650 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:39:45.228722 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406daca-ad0c-4835-b53a-876401fb47d3 service swift] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:39:45.240747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406daca-ad0c-4835-b53a-876401fb47d3 service swift] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:39:45.301556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce707ed0-9816-4768-97e7-b1894e2ebc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:39:45.302328 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce707ed0-9816-4768-97e7-b1894e2ebc32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:45.302741 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce707ed0-9816-4768-97e7-b1894e2ebc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:45.303118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce707ed0-9816-4768-97e7-b1894e2ebc32 admin admin] PATH_INFO: `/v3/projects/b46ed14150ee42d493585604cde74cfa` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:45.304312 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce707ed0-9816-4768-97e7-b1894e2ebc32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b46ed14150ee42d493585604cde74cfa)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:39:45.306313 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce707ed0-9816-4768-97e7-b1894e2ebc32 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:39:45.449426 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ce707ed0-9816-4768-97e7-b1894e2ebc32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46ed14150ee42d493585604cde74cfa', 'request_id': 'req-ce707ed0-9816-4768-97e7-b1894e2ebc32'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:39:45.455984 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ce707ed0-9816-4768-97e7-b1894e2ebc32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46ed14150ee42d493585604cde74cfa', 'request_id': 'req-ce707ed0-9816-4768-97e7-b1894e2ebc32'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:39:45.515396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ce707ed0-9816-4768-97e7-b1894e2ebc32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46ed14150ee42d493585604cde74cfa', 'request_id': 'req-ce707ed0-9816-4768-97e7-b1894e2ebc32'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:39:45.527018 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ce707ed0-9816-4768-97e7-b1894e2ebc32 admin admin] The token cache is being invalidate because project b46ed14150ee42d493585604cde74cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:39:45.527362 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ce707ed0-9816-4768-97e7-b1894e2ebc32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:39:45.527931 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-ce707ed0-9816-4768-97e7-b1894e2ebc32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:39:45.530374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1142/2307] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:39:45 2022] DELETE /identity/v3/projects/b46ed14150ee42d493585604cde74cfa => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:39:45.535472 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7de63f-c0bd-4d36-9eea-013765a100cf None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:45.535763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7de63f-c0bd-4d36-9eea-013765a100cf None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:45.536044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7de63f-c0bd-4d36-9eea-013765a100cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:45.558142 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ac7de63f-c0bd-4d36-9eea-013765a100cf None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:39:45.559494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ac7de63f-c0bd-4d36-9eea-013765a100cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:39:45.621328 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1166/2308] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:39:45.629801 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8db9bd-ccbb-4417-975f-153e930705d8 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:45.630162 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8db9bd-ccbb-4417-975f-153e930705d8 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:45.630503 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8db9bd-ccbb-4417-975f-153e930705d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:45.650216 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-be8db9bd-ccbb-4417-975f-153e930705d8 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:39:45.651996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-be8db9bd-ccbb-4417-975f-153e930705d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:39:45.660171 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1143/2309] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:39:45.664265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7de63f-c0bd-4d36-9eea-013765a100cf None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:39:45.674386 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7de63f-c0bd-4d36-9eea-013765a100cf None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:39:45.679271 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf067e-f752-4d08-bf0a-165904128edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:39:45.679570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf067e-f752-4d08-bf0a-165904128edf admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:45.679820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf067e-f752-4d08-bf0a-165904128edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:45.680088 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf067e-f752-4d08-bf0a-165904128edf admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:45.680760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf067e-f752-4d08-bf0a-165904128edf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:39:45.681063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf067e-f752-4d08-bf0a-165904128edf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:39:45.682641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf067e-f752-4d08-bf0a-165904128edf admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:39:45.684193 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:45.695520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1167/2310] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:39:45.699892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8db9bd-ccbb-4417-975f-153e930705d8 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:39:45.709386 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8db9bd-ccbb-4417-975f-153e930705d8 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:39:45.715652 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c1953-1537-426b-8532-01f3df766042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:39:45.716246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c1953-1537-426b-8532-01f3df766042 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:45.716556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c1953-1537-426b-8532-01f3df766042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:45.716850 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c1953-1537-426b-8532-01f3df766042 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:45.717496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c1953-1537-426b-8532-01f3df766042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:39:45.719372 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c1953-1537-426b-8532-01f3df766042 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:39:45.802135 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1144/2311] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:39:45 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:39:45.806493 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf067e-f752-4d08-bf0a-165904128edf admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:39:45.817221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf067e-f752-4d08-bf0a-165904128edf admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:39:45.877238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136f0cc-ceba-4499-b072-071d518ad76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:39:45.877842 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136f0cc-ceba-4499-b072-071d518ad76b admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:45.878125 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136f0cc-ceba-4499-b072-071d518ad76b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:45.878398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136f0cc-ceba-4499-b072-071d518ad76b admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:45.879035 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136f0cc-ceba-4499-b072-071d518ad76b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:39:45.880980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136f0cc-ceba-4499-b072-071d518ad76b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:39:45.953076 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1168/2312] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:39:45 2022] POST /identity/v3/users => generated 285 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:39:45.957086 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c1953-1537-426b-8532-01f3df766042 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:39:45.968106 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c1953-1537-426b-8532-01f3df766042 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:39:45.972784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d2426-0a80-4a65-a88b-4b8a482f547c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:39:45.973382 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d2426-0a80-4a65-a88b-4b8a482f547c admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:45.973662 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d2426-0a80-4a65-a88b-4b8a482f547c admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:45.973935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d2426-0a80-4a65-a88b-4b8a482f547c admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:45.974573 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d2426-0a80-4a65-a88b-4b8a482f547c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:39:45.976161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d2426-0a80-4a65-a88b-4b8a482f547c admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:39:45.986588 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1145/2313] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:39:45.990471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136f0cc-ceba-4499-b072-071d518ad76b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:39:46.000662 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136f0cc-ceba-4499-b072-071d518ad76b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:39:46.005159 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015c240-da18-4e7a-a0ce-a363d2d0f383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:39:46.005751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015c240-da18-4e7a-a0ce-a363d2d0f383 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:46.006026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015c240-da18-4e7a-a0ce-a363d2d0f383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:46.006299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015c240-da18-4e7a-a0ce-a363d2d0f383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:46.006932 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4015c240-da18-4e7a-a0ce-a363d2d0f383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:39:46.008527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4015c240-da18-4e7a-a0ce-a363d2d0f383 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:39:46.019578 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1169/2314] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:39:46.081682 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d2426-0a80-4a65-a88b-4b8a482f547c admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:39:46.092646 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d2426-0a80-4a65-a88b-4b8a482f547c admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:39:46.097558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67102c2e-2cc8-4fc2-9ca5-94d02dfeba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:39:46.098230 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67102c2e-2cc8-4fc2-9ca5-94d02dfeba88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:46.098514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67102c2e-2cc8-4fc2-9ca5-94d02dfeba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:46.098795 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67102c2e-2cc8-4fc2-9ca5-94d02dfeba88 admin admin] PATH_INFO: `/v3/projects/e5b0a3ebd34f404aa9d1e78ba7fc088a/users/1de9321e74a54a948410e488b6f3095f/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:46.115264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67102c2e-2cc8-4fc2-9ca5-94d02dfeba88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b0a3ebd34f404aa9d1e78ba7fc088a, user_id=1de9321e74a54a948410e488b6f3095f, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:39:46.118132 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67102c2e-2cc8-4fc2-9ca5-94d02dfeba88 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:39:46.223052 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:46.229779 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1146/2315] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:39:46 2022] PUT /identity/v3/projects/e5b0a3ebd34f404aa9d1e78ba7fc088a/users/1de9321e74a54a948410e488b6f3095f/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:39:46.239331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174ae21-a2d9-45f8-a8dc-7e55ff86644b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:46.239612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174ae21-a2d9-45f8-a8dc-7e55ff86644b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:46.239884 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174ae21-a2d9-45f8-a8dc-7e55ff86644b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:46.272191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3174ae21-a2d9-45f8-a8dc-7e55ff86644b None None] MFA Rules not processed for user `1de9321e74a54a948410e488b6f3095f`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:39:46.273533 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3174ae21-a2d9-45f8-a8dc-7e55ff86644b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:39:46.355773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1170/2316] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:39:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:39:46.368718 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67102c2e-2cc8-4fc2-9ca5-94d02dfeba88 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:39:46.371266 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-67102c2e-2cc8-4fc2-9ca5-94d02dfeba88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:39:46.441152 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67102c2e-2cc8-4fc2-9ca5-94d02dfeba88 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:39:46.445023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763c96f-c8a8-40a5-8170-2ce2e6d33904 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e15cb1d012934ebeac53af885ca65f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:39:46.445635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763c96f-c8a8-40a5-8170-2ce2e6d33904 service glance] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:39:46.445916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763c96f-c8a8-40a5-8170-2ce2e6d33904 service glance] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:39:46.446194 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763c96f-c8a8-40a5-8170-2ce2e6d33904 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:39:46.455478 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763c96f-c8a8-40a5-8170-2ce2e6d33904 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:39:46.456954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763c96f-c8a8-40a5-8170-2ce2e6d33904 service glance] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:39:46.465836 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1147/2317] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:39:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:39:56.350781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=69,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:56.461723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=26 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:13.380977 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174ae21-a2d9-45f8-a8dc-7e55ff86644b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:40:13.443172 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174ae21-a2d9-45f8-a8dc-7e55ff86644b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:40:13.447980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b8a49-7534-4162-9ae7-b685acd50404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:40:13.448677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b8a49-7534-4162-9ae7-b685acd50404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:40:13.448960 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b8a49-7534-4162-9ae7-b685acd50404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:40:13.449233 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b8a49-7534-4162-9ae7-b685acd50404 admin admin] PATH_INFO: `/v3/users/1de9321e74a54a948410e488b6f3095f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:40:13.450367 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b8a49-7534-4162-9ae7-b685acd50404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de9321e74a54a948410e488b6f3095f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:40:13.452395 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b8a49-7534-4162-9ae7-b685acd50404 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:40:13.667503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2f4b8a49-7534-4162-9ae7-b685acd50404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de9321e74a54a948410e488b6f3095f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:40:13.668174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2f4b8a49-7534-4162-9ae7-b685acd50404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de9321e74a54a948410e488b6f3095f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:40:13.681564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2f4b8a49-7534-4162-9ae7-b685acd50404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de9321e74a54a948410e488b6f3095f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:40:13.753145 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2f4b8a49-7534-4162-9ae7-b685acd50404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de9321e74a54a948410e488b6f3095f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:40:13.753762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2f4b8a49-7534-4162-9ae7-b685acd50404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de9321e74a54a948410e488b6f3095f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:40:13.767282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1171/2318] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:40:13 2022] DELETE /identity/v3/users/1de9321e74a54a948410e488b6f3095f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:40:13.771766 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc5096-1a57-461b-b7f6-a066a67aab19 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:40:13.772239 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc5096-1a57-461b-b7f6-a066a67aab19 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:40:13.772382 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc5096-1a57-461b-b7f6-a066a67aab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:40:13.791508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-88fc5096-1a57-461b-b7f6-a066a67aab19 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:40:13.792788 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-88fc5096-1a57-461b-b7f6-a066a67aab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:40:13.857486 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1148/2319] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:40:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:40:13.867744 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b8a49-7534-4162-9ae7-b685acd50404 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:40:13.869199 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2f4b8a49-7534-4162-9ae7-b685acd50404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:40:13.933648 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b8a49-7534-4162-9ae7-b685acd50404 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:40:13.938285 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ebe4d-dc4e-40a7-8cf5-83e4796e2a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:40:13.938928 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ebe4d-dc4e-40a7-8cf5-83e4796e2a00 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:40:13.939353 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ebe4d-dc4e-40a7-8cf5-83e4796e2a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:40:13.939476 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ebe4d-dc4e-40a7-8cf5-83e4796e2a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:40:13.950252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ebe4d-dc4e-40a7-8cf5-83e4796e2a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:40:13.951689 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ebe4d-dc4e-40a7-8cf5-83e4796e2a00 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:40:13.962104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1172/2320] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:40:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:40:14.434584 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc5096-1a57-461b-b7f6-a066a67aab19 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:40:14.435994 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-88fc5096-1a57-461b-b7f6-a066a67aab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:40:14.448694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc5096-1a57-461b-b7f6-a066a67aab19 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:40:14.454425 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe83f9-96e5-4901-ade2-d5b5d0c363dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:40:14.455071 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe83f9-96e5-4901-ade2-d5b5d0c363dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:40:14.455432 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe83f9-96e5-4901-ade2-d5b5d0c363dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:40:14.455714 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe83f9-96e5-4901-ade2-d5b5d0c363dd admin admin] PATH_INFO: `/v3/projects/e5b0a3ebd34f404aa9d1e78ba7fc088a` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:40:14.456935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe83f9-96e5-4901-ade2-d5b5d0c363dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b0a3ebd34f404aa9d1e78ba7fc088a)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:40:14.459087 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe83f9-96e5-4901-ade2-d5b5d0c363dd admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:40:14.577053 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-c9fe83f9-96e5-4901-ade2-d5b5d0c363dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b0a3ebd34f404aa9d1e78ba7fc088a', 'request_id': 'req-c9fe83f9-96e5-4901-ade2-d5b5d0c363dd'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:40:14.584363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-c9fe83f9-96e5-4901-ade2-d5b5d0c363dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b0a3ebd34f404aa9d1e78ba7fc088a', 'request_id': 'req-c9fe83f9-96e5-4901-ade2-d5b5d0c363dd'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:40:14.658333 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-c9fe83f9-96e5-4901-ade2-d5b5d0c363dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b0a3ebd34f404aa9d1e78ba7fc088a', 'request_id': 'req-c9fe83f9-96e5-4901-ade2-d5b5d0c363dd'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:40:14.668950 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-c9fe83f9-96e5-4901-ade2-d5b5d0c363dd admin admin] The token cache is being invalidate because project e5b0a3ebd34f404aa9d1e78ba7fc088a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:40:14.669273 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-c9fe83f9-96e5-4901-ade2-d5b5d0c363dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:40:14.669873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-c9fe83f9-96e5-4901-ade2-d5b5d0c363dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:40:14.671867 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1149/2321] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:40:14 2022] DELETE /identity/v3/projects/e5b0a3ebd34f404aa9d1e78ba7fc088a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:40:16.659380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebb954-631d-4551-bea6-41a5e4d091a1 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:40:16.659910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebb954-631d-4551-bea6-41a5e4d091a1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:40:16.659910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebb954-631d-4551-bea6-41a5e4d091a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:40:16.679126 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-bbebb954-631d-4551-bea6-41a5e4d091a1 None None] MFA Rules not processed for user `a84e162448a64727acdb841c839a384d`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:40:16.680309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-bbebb954-631d-4551-bea6-41a5e4d091a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:40:16.696604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:16.734549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1173/2322] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:40:24.665867 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:26.784536 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=15 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:34.112060 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe83f9-96e5-4901-ade2-d5b5d0c363dd admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:40:34.113779 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c9fe83f9-96e5-4901-ade2-d5b5d0c363dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:40:34.192640 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe83f9-96e5-4901-ade2-d5b5d0c363dd admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:40:34.198129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d762ebf-73a4-4de3-b98a-563db61892e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5deb7370bc3045c5be2d391d3b1dbd82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:40:34.198994 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d762ebf-73a4-4de3-b98a-563db61892e4 service placement] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:40:34.199436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d762ebf-73a4-4de3-b98a-563db61892e4 service placement] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:40:34.199889 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d762ebf-73a4-4de3-b98a-563db61892e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:40:34.201873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-2d762ebf-73a4-4de3-b98a-563db61892e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:40:34.214589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d762ebf-73a4-4de3-b98a-563db61892e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:40:34.216569 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d762ebf-73a4-4de3-b98a-563db61892e4 service placement] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:40:34.227645 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1150/2323] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:40:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:40:39.024793 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd68c40-ba4b-4683-b8c8-d4a8729f8976 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:40:39.025373 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd68c40-ba4b-4683-b8c8-d4a8729f8976 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:40:39.025587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd68c40-ba4b-4683-b8c8-d4a8729f8976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:40:39.052865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-afd68c40-ba4b-4683-b8c8-d4a8729f8976 None None] MFA Rules not processed for user `55a1961b3af6490d9a615e2d907365e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:40:39.054211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-afd68c40-ba4b-4683-b8c8-d4a8729f8976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:40:39.116070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1174/2324] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:40:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:40:44.223170 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=32 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:49.107868 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=25 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:54.764873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bac66f-6d57-48ed-a1ec-f270bdff1ae2 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:40:54.765347 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bac66f-6d57-48ed-a1ec-f270bdff1ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:40:54.765441 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bac66f-6d57-48ed-a1ec-f270bdff1ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:40:54.786213 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-a2bac66f-6d57-48ed-a1ec-f270bdff1ae2 None None] MFA Rules not processed for user `a6507ed9a47848c29d72fd9af71e2cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:40:54.787556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a2bac66f-6d57-48ed-a1ec-f270bdff1ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:40:54.851182 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1151/2325] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:40:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:41:04.844361 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=25 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:15.571322 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919693cc-40cd-481c-b1d4-5f5339746361 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:15.571837 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919693cc-40cd-481c-b1d4-5f5339746361 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:15.571837 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919693cc-40cd-481c-b1d4-5f5339746361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:15.595386 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-919693cc-40cd-481c-b1d4-5f5339746361 None None] MFA Rules not processed for user `6d32130690454568b620faa8957ce111`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:41:15.595386 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-919693cc-40cd-481c-b1d4-5f5339746361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:15.647227 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1175/2326] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:41:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:41:25.639913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=25 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:34.406862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bac66f-6d57-48ed-a1ec-f270bdff1ae2 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:34.408481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a2bac66f-6d57-48ed-a1ec-f270bdff1ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:34.477563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bac66f-6d57-48ed-a1ec-f270bdff1ae2 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:34.482631 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d72c8-a21d-4efb-87c7-e0c3a37adc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:34.483266 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d72c8-a21d-4efb-87c7-e0c3a37adc76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:34.483527 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d72c8-a21d-4efb-87c7-e0c3a37adc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:34.484314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d72c8-a21d-4efb-87c7-e0c3a37adc76 admin admin] PATH_INFO: `/v3/users/a84e162448a64727acdb841c839a384d` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:34.484985 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d72c8-a21d-4efb-87c7-e0c3a37adc76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a84e162448a64727acdb841c839a384d)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:34.486983 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d72c8-a21d-4efb-87c7-e0c3a37adc76 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:34.677919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-188d72c8-a21d-4efb-87c7-e0c3a37adc76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a84e162448a64727acdb841c839a384d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:34.678633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-188d72c8-a21d-4efb-87c7-e0c3a37adc76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a84e162448a64727acdb841c839a384d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:34.691979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-188d72c8-a21d-4efb-87c7-e0c3a37adc76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a84e162448a64727acdb841c839a384d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:34.748680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-188d72c8-a21d-4efb-87c7-e0c3a37adc76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a84e162448a64727acdb841c839a384d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:34.749243 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-188d72c8-a21d-4efb-87c7-e0c3a37adc76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a84e162448a64727acdb841c839a384d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:34.762917 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1152/2327] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:41:34 2022] DELETE /identity/v3/users/a84e162448a64727acdb841c839a384d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:35.005294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919693cc-40cd-481c-b1d4-5f5339746361 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:35.017927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919693cc-40cd-481c-b1d4-5f5339746361 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:35.080462 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8c9af-140c-4133-973b-5ccce1f41a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:35.081092 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8c9af-140c-4133-973b-5ccce1f41a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:35.081378 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8c9af-140c-4133-973b-5ccce1f41a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:35.081638 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8c9af-140c-4133-973b-5ccce1f41a44 admin admin] PATH_INFO: `/v3/projects/0ceffd50ede14cd5a2daaed46f3c1ff2` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:35.082767 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8c9af-140c-4133-973b-5ccce1f41a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ceffd50ede14cd5a2daaed46f3c1ff2)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:35.085197 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8c9af-140c-4133-973b-5ccce1f41a44 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:35.195041 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-62b8c9af-140c-4133-973b-5ccce1f41a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ceffd50ede14cd5a2daaed46f3c1ff2', 'request_id': 'req-62b8c9af-140c-4133-973b-5ccce1f41a44'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:35.201599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-62b8c9af-140c-4133-973b-5ccce1f41a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ceffd50ede14cd5a2daaed46f3c1ff2', 'request_id': 'req-62b8c9af-140c-4133-973b-5ccce1f41a44'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:35.273849 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-62b8c9af-140c-4133-973b-5ccce1f41a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ceffd50ede14cd5a2daaed46f3c1ff2', 'request_id': 'req-62b8c9af-140c-4133-973b-5ccce1f41a44'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:35.285821 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-62b8c9af-140c-4133-973b-5ccce1f41a44 admin admin] The token cache is being invalidate because project 0ceffd50ede14cd5a2daaed46f3c1ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:41:35.288445 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-62b8c9af-140c-4133-973b-5ccce1f41a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:35.288445 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-62b8c9af-140c-4133-973b-5ccce1f41a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:35.288445 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1176/2328] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:41:35 2022] DELETE /identity/v3/projects/0ceffd50ede14cd5a2daaed46f3c1ff2 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:35.295040 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4e661-1c27-41c3-98e6-f0b6a73640a3 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:35.295342 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4e661-1c27-41c3-98e6-f0b6a73640a3 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:35.295604 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4e661-1c27-41c3-98e6-f0b6a73640a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:35.318754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-abf4e661-1c27-41c3-98e6-f0b6a73640a3 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:41:35.320230 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-abf4e661-1c27-41c3-98e6-f0b6a73640a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:35.388990 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1153/2329] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:41:35.398659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e91f4-72a3-4133-9f78-d13eb2626547 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:35.399048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e91f4-72a3-4133-9f78-d13eb2626547 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:35.399421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e91f4-72a3-4133-9f78-d13eb2626547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:35.422239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-958e91f4-72a3-4133-9f78-d13eb2626547 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:41:35.423478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-958e91f4-72a3-4133-9f78-d13eb2626547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:35.433001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1177/2330] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:41:35.437183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4e661-1c27-41c3-98e6-f0b6a73640a3 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:35.448842 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4e661-1c27-41c3-98e6-f0b6a73640a3 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:35.454365 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179a731-b0e4-4460-b609-c6b93de24553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:35.455076 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a731-b0e4-4460-b609-c6b93de24553 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:35.455361 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a731-b0e4-4460-b609-c6b93de24553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:35.455761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a731-b0e4-4460-b609-c6b93de24553 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:35.457097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179a731-b0e4-4460-b609-c6b93de24553 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:41:35.457430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179a731-b0e4-4460-b609-c6b93de24553 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:35.459834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179a731-b0e4-4460-b609-c6b93de24553 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:35.472577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1154/2331] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:41:35.477492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e91f4-72a3-4133-9f78-d13eb2626547 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:35.487045 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e91f4-72a3-4133-9f78-d13eb2626547 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:35.491569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca84d05-f063-4fef-9a01-420f82a32b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:35.492176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca84d05-f063-4fef-9a01-420f82a32b53 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:35.492499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca84d05-f063-4fef-9a01-420f82a32b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:35.492776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca84d05-f063-4fef-9a01-420f82a32b53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:35.493408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca84d05-f063-4fef-9a01-420f82a32b53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:35.495312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca84d05-f063-4fef-9a01-420f82a32b53 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:35.596237 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1178/2332] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:41:35 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:41:35.600414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179a731-b0e4-4460-b609-c6b93de24553 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:35.611595 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179a731-b0e4-4460-b609-c6b93de24553 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:35.616156 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:35.674970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb362d8-ab22-4918-9d52-303b55c3f458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:35.675584 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb362d8-ab22-4918-9d52-303b55c3f458 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:35.675865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb362d8-ab22-4918-9d52-303b55c3f458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:35.676139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb362d8-ab22-4918-9d52-303b55c3f458 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:35.677355 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb362d8-ab22-4918-9d52-303b55c3f458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:35.680024 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb362d8-ab22-4918-9d52-303b55c3f458 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:35.793896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1155/2333] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:41:35 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:41:35.794506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca84d05-f063-4fef-9a01-420f82a32b53 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:35.811816 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca84d05-f063-4fef-9a01-420f82a32b53 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:35.818185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a598797-e75e-4a4b-bed7-9ba8fadcbefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:35.818808 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a598797-e75e-4a4b-bed7-9ba8fadcbefa admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:35.819089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a598797-e75e-4a4b-bed7-9ba8fadcbefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:35.819364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a598797-e75e-4a4b-bed7-9ba8fadcbefa admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:35.820067 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a598797-e75e-4a4b-bed7-9ba8fadcbefa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:35.821717 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a598797-e75e-4a4b-bed7-9ba8fadcbefa admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:35.832861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1179/2334] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:41:35.836785 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb362d8-ab22-4918-9d52-303b55c3f458 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:35.847462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb362d8-ab22-4918-9d52-303b55c3f458 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:35.853315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e588ba-c435-4ce0-a46d-acdca93fcb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:35.854016 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e588ba-c435-4ce0-a46d-acdca93fcb81 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:35.854385 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e588ba-c435-4ce0-a46d-acdca93fcb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:35.854740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e588ba-c435-4ce0-a46d-acdca93fcb81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:35.855535 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e588ba-c435-4ce0-a46d-acdca93fcb81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:35.857168 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e588ba-c435-4ce0-a46d-acdca93fcb81 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:35.878737 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1156/2335] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:41:35.878843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a598797-e75e-4a4b-bed7-9ba8fadcbefa admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:35.892613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a598797-e75e-4a4b-bed7-9ba8fadcbefa admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:35.897829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c93b9-c9a6-4e4b-9586-6e1a252c8308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:35.898503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c93b9-c9a6-4e4b-9586-6e1a252c8308 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:35.898785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c93b9-c9a6-4e4b-9586-6e1a252c8308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:35.899061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c93b9-c9a6-4e4b-9586-6e1a252c8308 admin admin] PATH_INFO: `/v3/projects/8fd98c490e4f4d2db1acbfc5a14be489/users/a828b0f7562f4dd883dc3e01aed9c7a8/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:35.917307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c93b9-c9a6-4e4b-9586-6e1a252c8308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd98c490e4f4d2db1acbfc5a14be489, user_id=a828b0f7562f4dd883dc3e01aed9c7a8, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:35.920078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c93b9-c9a6-4e4b-9586-6e1a252c8308 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:36.005978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1180/2336] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:41:35 2022] PUT /identity/v3/projects/8fd98c490e4f4d2db1acbfc5a14be489/users/a828b0f7562f4dd883dc3e01aed9c7a8/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:36.016298 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e32daa-1a61-4a5b-81d1-f7942c1fe0d3 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:36.016614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e32daa-1a61-4a5b-81d1-f7942c1fe0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:36.016889 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e32daa-1a61-4a5b-81d1-f7942c1fe0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:36.045800 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-69e32daa-1a61-4a5b-81d1-f7942c1fe0d3 None None] MFA Rules not processed for user `a828b0f7562f4dd883dc3e01aed9c7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:41:36.047403 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-69e32daa-1a61-4a5b-81d1-f7942c1fe0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:36.113757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1157/2337] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:41:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:41:36.125713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c93b9-c9a6-4e4b-9586-6e1a252c8308 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:36.127423 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9e0c93b9-c9a6-4e4b-9586-6e1a252c8308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:36.157684 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:36.202317 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c93b9-c9a6-4e4b-9586-6e1a252c8308 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:36.208289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca4f96-897d-4bad-b462-04df63eda791 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:36.208956 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca4f96-897d-4bad-b462-04df63eda791 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:36.209238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca4f96-897d-4bad-b462-04df63eda791 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:36.209515 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca4f96-897d-4bad-b462-04df63eda791 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:36.218799 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca4f96-897d-4bad-b462-04df63eda791 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:36.220833 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca4f96-897d-4bad-b462-04df63eda791 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:36.231447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1181/2338] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:41:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:41:36.452209 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e32daa-1a61-4a5b-81d1-f7942c1fe0d3 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:36.519975 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e32daa-1a61-4a5b-81d1-f7942c1fe0d3 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:36.525125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993403b1-6cf2-4d3b-af95-e96ab3c38d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:36.525771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993403b1-6cf2-4d3b-af95-e96ab3c38d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:36.526050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993403b1-6cf2-4d3b-af95-e96ab3c38d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:36.526322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993403b1-6cf2-4d3b-af95-e96ab3c38d3d admin admin] PATH_INFO: `/v3/users/a828b0f7562f4dd883dc3e01aed9c7a8` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:36.527457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993403b1-6cf2-4d3b-af95-e96ab3c38d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a828b0f7562f4dd883dc3e01aed9c7a8)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:36.529461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993403b1-6cf2-4d3b-af95-e96ab3c38d3d admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:36.547389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:36.780323 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-993403b1-6cf2-4d3b-af95-e96ab3c38d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a828b0f7562f4dd883dc3e01aed9c7a8'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:36.780993 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-993403b1-6cf2-4d3b-af95-e96ab3c38d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a828b0f7562f4dd883dc3e01aed9c7a8'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:36.795321 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-993403b1-6cf2-4d3b-af95-e96ab3c38d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a828b0f7562f4dd883dc3e01aed9c7a8'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:36.856813 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-993403b1-6cf2-4d3b-af95-e96ab3c38d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a828b0f7562f4dd883dc3e01aed9c7a8'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:36.857473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-993403b1-6cf2-4d3b-af95-e96ab3c38d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a828b0f7562f4dd883dc3e01aed9c7a8'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:36.870261 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1158/2339] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:41:36 2022] DELETE /identity/v3/users/a828b0f7562f4dd883dc3e01aed9c7a8 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:36.874702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7708ce-e2aa-4a39-83df-92eb9a3ccb17 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:36.874992 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7708ce-e2aa-4a39-83df-92eb9a3ccb17 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:36.875272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7708ce-e2aa-4a39-83df-92eb9a3ccb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:36.894599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-2e7708ce-e2aa-4a39-83df-92eb9a3ccb17 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:41:36.896555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2e7708ce-e2aa-4a39-83df-92eb9a3ccb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:36.953438 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1182/2340] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:41:36.963569 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993403b1-6cf2-4d3b-af95-e96ab3c38d3d admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:36.965008 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-993403b1-6cf2-4d3b-af95-e96ab3c38d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:37.019606 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993403b1-6cf2-4d3b-af95-e96ab3c38d3d admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:37.023761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da9bc0-9753-41ce-abf4-f4cfa11e5d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:37.024386 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da9bc0-9753-41ce-abf4-f4cfa11e5d1f service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:37.024665 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da9bc0-9753-41ce-abf4-f4cfa11e5d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:37.024932 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da9bc0-9753-41ce-abf4-f4cfa11e5d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:37.033656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da9bc0-9753-41ce-abf4-f4cfa11e5d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:37.035061 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da9bc0-9753-41ce-abf4-f4cfa11e5d1f service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:37.044429 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1159/2341] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:41:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:41:37.572843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7708ce-e2aa-4a39-83df-92eb9a3ccb17 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:37.574356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2e7708ce-e2aa-4a39-83df-92eb9a3ccb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:37.587515 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7708ce-e2aa-4a39-83df-92eb9a3ccb17 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:37.592280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e87c4-f56a-4025-9535-64f34b0618a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:37.592948 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e87c4-f56a-4025-9535-64f34b0618a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:37.593223 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e87c4-f56a-4025-9535-64f34b0618a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:37.593495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e87c4-f56a-4025-9535-64f34b0618a3 admin admin] PATH_INFO: `/v3/projects/8fd98c490e4f4d2db1acbfc5a14be489` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:37.594615 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e87c4-f56a-4025-9535-64f34b0618a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd98c490e4f4d2db1acbfc5a14be489)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:37.596547 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e87c4-f56a-4025-9535-64f34b0618a3 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:37.724042 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-af1e87c4-f56a-4025-9535-64f34b0618a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd98c490e4f4d2db1acbfc5a14be489', 'request_id': 'req-af1e87c4-f56a-4025-9535-64f34b0618a3'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:37.730653 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-af1e87c4-f56a-4025-9535-64f34b0618a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd98c490e4f4d2db1acbfc5a14be489', 'request_id': 'req-af1e87c4-f56a-4025-9535-64f34b0618a3'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:37.803602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-af1e87c4-f56a-4025-9535-64f34b0618a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd98c490e4f4d2db1acbfc5a14be489', 'request_id': 'req-af1e87c4-f56a-4025-9535-64f34b0618a3'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:37.814431 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-af1e87c4-f56a-4025-9535-64f34b0618a3 admin admin] The token cache is being invalidate because project 8fd98c490e4f4d2db1acbfc5a14be489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:41:37.818650 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-af1e87c4-f56a-4025-9535-64f34b0618a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:37.818650 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-af1e87c4-f56a-4025-9535-64f34b0618a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:37.818650 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1183/2342] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:41:37 2022] DELETE /identity/v3/projects/8fd98c490e4f4d2db1acbfc5a14be489 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:37.821937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e4097-3511-4759-98d8-b9e0294069cf None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:37.822394 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e4097-3511-4759-98d8-b9e0294069cf None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:37.822496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e4097-3511-4759-98d8-b9e0294069cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:37.842620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-d28e4097-3511-4759-98d8-b9e0294069cf None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:41:37.843738 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-d28e4097-3511-4759-98d8-b9e0294069cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:37.899959 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1160/2343] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:41:37.907804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61379dab-c4b0-418c-be1f-0683a5fc4a93 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:37.908087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61379dab-c4b0-418c-be1f-0683a5fc4a93 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:37.908436 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61379dab-c4b0-418c-be1f-0683a5fc4a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:37.929466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-61379dab-c4b0-418c-be1f-0683a5fc4a93 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:41:37.930656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-61379dab-c4b0-418c-be1f-0683a5fc4a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:37.938832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1184/2344] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:41:37.943242 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e4097-3511-4759-98d8-b9e0294069cf None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:37.952794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e4097-3511-4759-98d8-b9e0294069cf None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:37.957248 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93814e18-d1e0-4c19-b998-7e0b3ace5758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:37.957836 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93814e18-d1e0-4c19-b998-7e0b3ace5758 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:37.958629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93814e18-d1e0-4c19-b998-7e0b3ace5758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:37.958900 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93814e18-d1e0-4c19-b998-7e0b3ace5758 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:37.959528 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93814e18-d1e0-4c19-b998-7e0b3ace5758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:41:37.959825 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93814e18-d1e0-4c19-b998-7e0b3ace5758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:37.961486 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93814e18-d1e0-4c19-b998-7e0b3ace5758 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:37.972659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1161/2345] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:41:37.977325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61379dab-c4b0-418c-be1f-0683a5fc4a93 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:37.986258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61379dab-c4b0-418c-be1f-0683a5fc4a93 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:37.990763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246445b9-9de1-41dd-9ad5-c5c6a0a4c2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:37.991348 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246445b9-9de1-41dd-9ad5-c5c6a0a4c2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:37.991621 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246445b9-9de1-41dd-9ad5-c5c6a0a4c2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:37.991888 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246445b9-9de1-41dd-9ad5-c5c6a0a4c2e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:37.992555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246445b9-9de1-41dd-9ad5-c5c6a0a4c2e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:37.994440 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246445b9-9de1-41dd-9ad5-c5c6a0a4c2e6 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:38.085708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1185/2346] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:41:37 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:41:38.088995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93814e18-d1e0-4c19-b998-7e0b3ace5758 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:38.099569 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93814e18-d1e0-4c19-b998-7e0b3ace5758 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:38.119924 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:38.155631 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddd290-c184-4165-ad92-a7537f550022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:38.156291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddd290-c184-4165-ad92-a7537f550022 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:38.156604 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddd290-c184-4165-ad92-a7537f550022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:38.156875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddd290-c184-4165-ad92-a7537f550022 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:38.157502 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddd290-c184-4165-ad92-a7537f550022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:38.159399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddd290-c184-4165-ad92-a7537f550022 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:38.260949 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1162/2347] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:41:38 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:41:38.265237 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246445b9-9de1-41dd-9ad5-c5c6a0a4c2e6 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:38.276227 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246445b9-9de1-41dd-9ad5-c5c6a0a4c2e6 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:38.282233 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190100a-e7e5-41d4-9ee6-fae6cc22b4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:38.282233 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190100a-e7e5-41d4-9ee6-fae6cc22b4bd admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:38.282233 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190100a-e7e5-41d4-9ee6-fae6cc22b4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:38.282233 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190100a-e7e5-41d4-9ee6-fae6cc22b4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:38.282676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190100a-e7e5-41d4-9ee6-fae6cc22b4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:38.284218 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190100a-e7e5-41d4-9ee6-fae6cc22b4bd admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:38.285477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:38.294971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1186/2348] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:41:38.299018 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddd290-c184-4165-ad92-a7537f550022 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:38.308924 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddd290-c184-4165-ad92-a7537f550022 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:38.313721 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc77e68-49de-42f0-88ea-1780ee84a73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:38.316585 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc77e68-49de-42f0-88ea-1780ee84a73b admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:38.316585 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc77e68-49de-42f0-88ea-1780ee84a73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:38.316585 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc77e68-49de-42f0-88ea-1780ee84a73b admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:38.316585 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc77e68-49de-42f0-88ea-1780ee84a73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:38.317892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc77e68-49de-42f0-88ea-1780ee84a73b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:38.327820 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1163/2349] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:41:38.331867 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190100a-e7e5-41d4-9ee6-fae6cc22b4bd admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:38.342775 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190100a-e7e5-41d4-9ee6-fae6cc22b4bd admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:38.353303 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad50ef4-1567-4b8b-9a15-c161789439c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:38.353303 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad50ef4-1567-4b8b-9a15-c161789439c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:38.353303 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad50ef4-1567-4b8b-9a15-c161789439c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:38.353303 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad50ef4-1567-4b8b-9a15-c161789439c0 admin admin] PATH_INFO: `/v3/projects/50e2005f296e4d2b820d4efd8a3f8b9d/users/f9a8d9529ade4f92b0f588bbea9ae1b9/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:38.362476 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad50ef4-1567-4b8b-9a15-c161789439c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e2005f296e4d2b820d4efd8a3f8b9d, user_id=f9a8d9529ade4f92b0f588bbea9ae1b9, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:38.365278 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad50ef4-1567-4b8b-9a15-c161789439c0 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:38.422619 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1187/2350] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:41:38 2022] PUT /identity/v3/projects/50e2005f296e4d2b820d4efd8a3f8b9d/users/f9a8d9529ade4f92b0f588bbea9ae1b9/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:41:38.432905 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4631ad-28a7-41ae-a8e4-f252bf51df1e None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:38.433713 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4631ad-28a7-41ae-a8e4-f252bf51df1e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:38.433713 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4631ad-28a7-41ae-a8e4-f252bf51df1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:38.463076 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-6b4631ad-28a7-41ae-a8e4-f252bf51df1e None None] MFA Rules not processed for user `f9a8d9529ade4f92b0f588bbea9ae1b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:41:38.464426 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6b4631ad-28a7-41ae-a8e4-f252bf51df1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:38.527909 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1164/2351] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:41:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:41:38.532490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad50ef4-1567-4b8b-9a15-c161789439c0 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:38.594626 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad50ef4-1567-4b8b-9a15-c161789439c0 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:38.599270 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5716c-40eb-49da-8b0f-a6b33fbccf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:38.599858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5716c-40eb-49da-8b0f-a6b33fbccf42 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:38.600135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5716c-40eb-49da-8b0f-a6b33fbccf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:38.600441 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5716c-40eb-49da-8b0f-a6b33fbccf42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:38.601069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5716c-40eb-49da-8b0f-a6b33fbccf42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:38.602942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5716c-40eb-49da-8b0f-a6b33fbccf42 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:38.663189 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1188/2352] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:41:38 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:41:38.667155 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4631ad-28a7-41ae-a8e4-f252bf51df1e None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:38.678218 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4631ad-28a7-41ae-a8e4-f252bf51df1e None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:38.733663 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc1de7-7661-49dc-b0c3-45690baeb54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:38.734270 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc1de7-7661-49dc-b0c3-45690baeb54a admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:38.734573 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc1de7-7661-49dc-b0c3-45690baeb54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:38.734849 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc1de7-7661-49dc-b0c3-45690baeb54a admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:38.735486 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc1de7-7661-49dc-b0c3-45690baeb54a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:38.737454 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc1de7-7661-49dc-b0c3-45690baeb54a admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:38.834202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1165/2353] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:41:38 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:41:38.838132 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5716c-40eb-49da-8b0f-a6b33fbccf42 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:38.848173 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5716c-40eb-49da-8b0f-a6b33fbccf42 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:38.852868 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc642f-c2d1-417a-a323-23bf6cf7d78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:38.853457 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc642f-c2d1-417a-a323-23bf6cf7d78b admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:38.853736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc642f-c2d1-417a-a323-23bf6cf7d78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:38.854008 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc642f-c2d1-417a-a323-23bf6cf7d78b admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:38.854683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc642f-c2d1-417a-a323-23bf6cf7d78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:38.856272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc642f-c2d1-417a-a323-23bf6cf7d78b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:38.867039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1189/2354] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:41:38.871106 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc1de7-7661-49dc-b0c3-45690baeb54a admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:38.881571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc1de7-7661-49dc-b0c3-45690baeb54a admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:38.886194 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7777c70-2c00-4a5d-af76-700047d44c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:38.886840 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7777c70-2c00-4a5d-af76-700047d44c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:38.887122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7777c70-2c00-4a5d-af76-700047d44c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:38.887399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7777c70-2c00-4a5d-af76-700047d44c1e admin admin] PATH_INFO: `/v3/projects/ee608bac18cd4a128bf34a78b0a18295/users/7b14603d834948ac8f4d9e04147d377f/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:38.902214 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7777c70-2c00-4a5d-af76-700047d44c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee608bac18cd4a128bf34a78b0a18295, user_id=7b14603d834948ac8f4d9e04147d377f, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:38.904965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7777c70-2c00-4a5d-af76-700047d44c1e admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:38.965857 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:38.971075 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1166/2355] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:41:38 2022] PUT /identity/v3/projects/ee608bac18cd4a128bf34a78b0a18295/users/7b14603d834948ac8f4d9e04147d377f/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:38.975498 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc642f-c2d1-417a-a323-23bf6cf7d78b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:38.985468 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc642f-c2d1-417a-a323-23bf6cf7d78b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:39.041279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f2c26-694e-4a41-a971-0dd4ad34402c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:39.041882 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f2c26-694e-4a41-a971-0dd4ad34402c admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:39.042163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f2c26-694e-4a41-a971-0dd4ad34402c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:39.042437 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f2c26-694e-4a41-a971-0dd4ad34402c admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:39.043070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f2c26-694e-4a41-a971-0dd4ad34402c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:39.044722 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f2c26-694e-4a41-a971-0dd4ad34402c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:39.054864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1190/2356] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:41:39.059070 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7777c70-2c00-4a5d-af76-700047d44c1e admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:39.069531 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7777c70-2c00-4a5d-af76-700047d44c1e admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:39.074119 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba693a67-39d8-486a-b3ce-52d6f8648a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:39.074759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba693a67-39d8-486a-b3ce-52d6f8648a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:39.075039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba693a67-39d8-486a-b3ce-52d6f8648a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:39.075315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba693a67-39d8-486a-b3ce-52d6f8648a3f admin admin] PATH_INFO: `/v3/projects/ee608bac18cd4a128bf34a78b0a18295/users/7b14603d834948ac8f4d9e04147d377f/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:39.077229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba693a67-39d8-486a-b3ce-52d6f8648a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee608bac18cd4a128bf34a78b0a18295, user_id=7b14603d834948ac8f4d9e04147d377f, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:39.080199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba693a67-39d8-486a-b3ce-52d6f8648a3f admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:39.090508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1167/2357] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:41:39 2022] PUT /identity/v3/projects/ee608bac18cd4a128bf34a78b0a18295/users/7b14603d834948ac8f4d9e04147d377f/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:39.102181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e991ccc-ecd3-477f-aaee-df34e361a2db None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:39.102474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e991ccc-ecd3-477f-aaee-df34e361a2db None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:39.102756 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e991ccc-ecd3-477f-aaee-df34e361a2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:39.132488 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6e991ccc-ecd3-477f-aaee-df34e361a2db None None] MFA Rules not processed for user `7b14603d834948ac8f4d9e04147d377f`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:41:39.133693 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6e991ccc-ecd3-477f-aaee-df34e361a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:39.163005 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:39.200198 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1191/2358] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:41:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:41:39.211508 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba693a67-39d8-486a-b3ce-52d6f8648a3f admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:39.213296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ba693a67-39d8-486a-b3ce-52d6f8648a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:39.275404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba693a67-39d8-486a-b3ce-52d6f8648a3f admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:39.279152 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dd0ab-55b6-439e-b598-bed8ea0906df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:39.279757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dd0ab-55b6-439e-b598-bed8ea0906df service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:39.280038 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dd0ab-55b6-439e-b598-bed8ea0906df service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:39.280309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dd0ab-55b6-439e-b598-bed8ea0906df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:39.289943 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4dd0ab-55b6-439e-b598-bed8ea0906df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:39.292957 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4dd0ab-55b6-439e-b598-bed8ea0906df service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:39.300671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1168/2359] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:41:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:41:39.557022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e991ccc-ecd3-477f-aaee-df34e361a2db None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:39.566919 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e991ccc-ecd3-477f-aaee-df34e361a2db None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:39.570601 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed9cf0-57d7-443f-81e1-64ccbe10ef43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:39.571202 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed9cf0-57d7-443f-81e1-64ccbe10ef43 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:39.571481 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed9cf0-57d7-443f-81e1-64ccbe10ef43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:39.571750 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed9cf0-57d7-443f-81e1-64ccbe10ef43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:39.628645 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed9cf0-57d7-443f-81e1-64ccbe10ef43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:39.630113 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed9cf0-57d7-443f-81e1-64ccbe10ef43 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:39.639068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1192/2360] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:41:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:41:43.311105 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dd0ab-55b6-439e-b598-bed8ea0906df service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:43.312678 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ad4dd0ab-55b6-439e-b598-bed8ea0906df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:43.369636 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dd0ab-55b6-439e-b598-bed8ea0906df service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:43.373366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420461c-eef9-40d3-b274-04e3a90250ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e15cb1d012934ebeac53af885ca65f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:43.373976 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420461c-eef9-40d3-b274-04e3a90250ee service glance] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:43.374253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420461c-eef9-40d3-b274-04e3a90250ee service glance] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:43.374527 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420461c-eef9-40d3-b274-04e3a90250ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:43.376254 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3420461c-eef9-40d3-b274-04e3a90250ee service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:43.448936 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420461c-eef9-40d3-b274-04e3a90250ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:43.450402 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420461c-eef9-40d3-b274-04e3a90250ee service glance] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:43.461110 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1169/2361] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:41:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:41:46.045576 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed9cf0-57d7-443f-81e1-64ccbe10ef43 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:46.047077 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-26ed9cf0-57d7-443f-81e1-64ccbe10ef43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:46.104558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed9cf0-57d7-443f-81e1-64ccbe10ef43 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:46.108289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb53108-3352-4c37-b5f0-ad5aae592b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:46.108925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb53108-3352-4c37-b5f0-ad5aae592b0e service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:46.109207 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb53108-3352-4c37-b5f0-ad5aae592b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:46.109483 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb53108-3352-4c37-b5f0-ad5aae592b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:46.111176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2bb53108-3352-4c37-b5f0-ad5aae592b0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:46.125050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb53108-3352-4c37-b5f0-ad5aae592b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:46.126471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb53108-3352-4c37-b5f0-ad5aae592b0e service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:46.138037 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1193/2362] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:41:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:41:48.197194 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420461c-eef9-40d3-b274-04e3a90250ee service glance] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:48.228056 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:48.259465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420461c-eef9-40d3-b274-04e3a90250ee service glance] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:48.264269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec428d5-3f8e-442c-84d6-65134ef3119b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:48.264954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec428d5-3f8e-442c-84d6-65134ef3119b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:48.265217 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec428d5-3f8e-442c-84d6-65134ef3119b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:48.265491 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec428d5-3f8e-442c-84d6-65134ef3119b admin admin] PATH_INFO: `/v3/users/f9a8d9529ade4f92b0f588bbea9ae1b9` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:48.266659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec428d5-3f8e-442c-84d6-65134ef3119b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a8d9529ade4f92b0f588bbea9ae1b9)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:48.268766 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec428d5-3f8e-442c-84d6-65134ef3119b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:48.464606 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-dec428d5-3f8e-442c-84d6-65134ef3119b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a8d9529ade4f92b0f588bbea9ae1b9'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:48.467736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-dec428d5-3f8e-442c-84d6-65134ef3119b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a8d9529ade4f92b0f588bbea9ae1b9'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:48.493429 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-dec428d5-3f8e-442c-84d6-65134ef3119b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a8d9529ade4f92b0f588bbea9ae1b9'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:48.553974 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-dec428d5-3f8e-442c-84d6-65134ef3119b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a8d9529ade4f92b0f588bbea9ae1b9'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:48.554600 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-dec428d5-3f8e-442c-84d6-65134ef3119b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a8d9529ade4f92b0f588bbea9ae1b9'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:48.567996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1170/2363] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:41:48 2022] DELETE /identity/v3/users/f9a8d9529ade4f92b0f588bbea9ae1b9 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:48.572749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8e659-8361-4732-ac69-deed2359ffb3 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:48.573306 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8e659-8361-4732-ac69-deed2359ffb3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:48.573434 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8e659-8361-4732-ac69-deed2359ffb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:48.593383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-98d8e659-8361-4732-ac69-deed2359ffb3 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:41:48.594581 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-98d8e659-8361-4732-ac69-deed2359ffb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:48.655736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1194/2364] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:41:48.666163 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec428d5-3f8e-442c-84d6-65134ef3119b admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:48.667628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-dec428d5-3f8e-442c-84d6-65134ef3119b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:48.725550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec428d5-3f8e-442c-84d6-65134ef3119b admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:48.729434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778a97f-868d-442e-bf65-c4e94c39128e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:48.732595 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778a97f-868d-442e-bf65-c4e94c39128e service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:48.732595 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778a97f-868d-442e-bf65-c4e94c39128e service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:48.732595 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778a97f-868d-442e-bf65-c4e94c39128e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:48.740711 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778a97f-868d-442e-bf65-c4e94c39128e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:48.742391 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778a97f-868d-442e-bf65-c4e94c39128e service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:48.752162 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1171/2365] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:41:49.185111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8e659-8361-4732-ac69-deed2359ffb3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:49.186707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-98d8e659-8361-4732-ac69-deed2359ffb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:49.200192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8e659-8361-4732-ac69-deed2359ffb3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:49.205806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e0408-de60-41d4-8972-28b84c50fbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:49.206471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e0408-de60-41d4-8972-28b84c50fbdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:49.206754 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e0408-de60-41d4-8972-28b84c50fbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:49.207025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e0408-de60-41d4-8972-28b84c50fbdc admin admin] PATH_INFO: `/v3/projects/50e2005f296e4d2b820d4efd8a3f8b9d` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:49.208150 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e0408-de60-41d4-8972-28b84c50fbdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=50e2005f296e4d2b820d4efd8a3f8b9d)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:49.210997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e0408-de60-41d4-8972-28b84c50fbdc admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:49.213345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:49.309983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c3e0408-de60-41d4-8972-28b84c50fbdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50e2005f296e4d2b820d4efd8a3f8b9d', 'request_id': 'req-7c3e0408-de60-41d4-8972-28b84c50fbdc'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:49.316647 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c3e0408-de60-41d4-8972-28b84c50fbdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50e2005f296e4d2b820d4efd8a3f8b9d', 'request_id': 'req-7c3e0408-de60-41d4-8972-28b84c50fbdc'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:49.381373 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c3e0408-de60-41d4-8972-28b84c50fbdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50e2005f296e4d2b820d4efd8a3f8b9d', 'request_id': 'req-7c3e0408-de60-41d4-8972-28b84c50fbdc'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:49.393741 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c3e0408-de60-41d4-8972-28b84c50fbdc admin admin] The token cache is being invalidate because project 50e2005f296e4d2b820d4efd8a3f8b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:41:49.394264 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c3e0408-de60-41d4-8972-28b84c50fbdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:49.403909 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c3e0408-de60-41d4-8972-28b84c50fbdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:49.407237 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1195/2366] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:41:49 2022] DELETE /identity/v3/projects/50e2005f296e4d2b820d4efd8a3f8b9d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:49.410012 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778a97f-868d-442e-bf65-c4e94c39128e service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:49.421317 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778a97f-868d-442e-bf65-c4e94c39128e service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:49.470774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:49.481235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdbde8-52fd-4dbc-8620-c740f50262f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:49.481863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdbde8-52fd-4dbc-8620-c740f50262f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:49.482143 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdbde8-52fd-4dbc-8620-c740f50262f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:49.482420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdbde8-52fd-4dbc-8620-c740f50262f7 admin admin] PATH_INFO: `/v3/users/7b14603d834948ac8f4d9e04147d377f` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:49.483532 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fdbde8-52fd-4dbc-8620-c740f50262f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b14603d834948ac8f4d9e04147d377f)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:49.485477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fdbde8-52fd-4dbc-8620-c740f50262f7 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:49.720662 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a2fdbde8-52fd-4dbc-8620-c740f50262f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b14603d834948ac8f4d9e04147d377f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:49.721464 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a2fdbde8-52fd-4dbc-8620-c740f50262f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b14603d834948ac8f4d9e04147d377f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:49.734453 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a2fdbde8-52fd-4dbc-8620-c740f50262f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b14603d834948ac8f4d9e04147d377f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:49.802411 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a2fdbde8-52fd-4dbc-8620-c740f50262f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b14603d834948ac8f4d9e04147d377f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:49.802411 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a2fdbde8-52fd-4dbc-8620-c740f50262f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b14603d834948ac8f4d9e04147d377f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:49.813381 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1172/2367] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:41:49 2022] DELETE /identity/v3/users/7b14603d834948ac8f4d9e04147d377f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:50.252715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e0408-de60-41d4-8972-28b84c50fbdc admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:50.255815 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7c3e0408-de60-41d4-8972-28b84c50fbdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:50.267229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e0408-de60-41d4-8972-28b84c50fbdc admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:50.325229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d838a-492a-43a4-91c5-aa6605e200e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:50.325782 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d838a-492a-43a4-91c5-aa6605e200e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:50.326061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d838a-492a-43a4-91c5-aa6605e200e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:50.326378 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d838a-492a-43a4-91c5-aa6605e200e8 admin admin] PATH_INFO: `/v3/projects/ee608bac18cd4a128bf34a78b0a18295` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:50.327486 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d838a-492a-43a4-91c5-aa6605e200e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee608bac18cd4a128bf34a78b0a18295)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:50.329401 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d838a-492a-43a4-91c5-aa6605e200e8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:50.454951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c56d838a-492a-43a4-91c5-aa6605e200e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee608bac18cd4a128bf34a78b0a18295', 'request_id': 'req-c56d838a-492a-43a4-91c5-aa6605e200e8'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:50.461157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c56d838a-492a-43a4-91c5-aa6605e200e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee608bac18cd4a128bf34a78b0a18295', 'request_id': 'req-c56d838a-492a-43a4-91c5-aa6605e200e8'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:50.534812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c56d838a-492a-43a4-91c5-aa6605e200e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee608bac18cd4a128bf34a78b0a18295', 'request_id': 'req-c56d838a-492a-43a4-91c5-aa6605e200e8'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:50.547354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c56d838a-492a-43a4-91c5-aa6605e200e8 admin admin] The token cache is being invalidate because project ee608bac18cd4a128bf34a78b0a18295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:41:50.547653 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c56d838a-492a-43a4-91c5-aa6605e200e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:50.548294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c56d838a-492a-43a4-91c5-aa6605e200e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:50.550063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1196/2368] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:41:50 2022] DELETE /identity/v3/projects/ee608bac18cd4a128bf34a78b0a18295 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:50.554876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42e72e-c462-4e4c-b681-7e6af41bae92 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:50.555375 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42e72e-c462-4e4c-b681-7e6af41bae92 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:50.555491 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42e72e-c462-4e4c-b681-7e6af41bae92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:50.575794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-ea42e72e-c462-4e4c-b681-7e6af41bae92 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:41:50.576948 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ea42e72e-c462-4e4c-b681-7e6af41bae92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:50.638778 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1173/2369] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:41:50.647114 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ab33a-ef66-4d4d-9d36-88c2ac5cac9a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:50.647402 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ab33a-ef66-4d4d-9d36-88c2ac5cac9a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:50.647678 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ab33a-ef66-4d4d-9d36-88c2ac5cac9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:50.667843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-091ab33a-ef66-4d4d-9d36-88c2ac5cac9a None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:41:50.669090 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-091ab33a-ef66-4d4d-9d36-88c2ac5cac9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:50.677078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1197/2370] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:41:50.681296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42e72e-c462-4e4c-b681-7e6af41bae92 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:50.691370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42e72e-c462-4e4c-b681-7e6af41bae92 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:50.696087 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861403e0-4801-420c-ad32-d2eb3bfc861c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:50.696901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861403e0-4801-420c-ad32-d2eb3bfc861c admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:50.697189 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861403e0-4801-420c-ad32-d2eb3bfc861c admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:50.697460 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861403e0-4801-420c-ad32-d2eb3bfc861c admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:50.698099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861403e0-4801-420c-ad32-d2eb3bfc861c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:41:50.698401 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861403e0-4801-420c-ad32-d2eb3bfc861c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:50.700055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861403e0-4801-420c-ad32-d2eb3bfc861c admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:50.712129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1174/2371] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:41:50.716492 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ab33a-ef66-4d4d-9d36-88c2ac5cac9a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:50.726097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ab33a-ef66-4d4d-9d36-88c2ac5cac9a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:50.730769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9fcba-c53c-4d3c-b7b9-466d32ba620b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:50.731400 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9fcba-c53c-4d3c-b7b9-466d32ba620b admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:50.731677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9fcba-c53c-4d3c-b7b9-466d32ba620b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:50.731945 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9fcba-c53c-4d3c-b7b9-466d32ba620b admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:50.732599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9fcba-c53c-4d3c-b7b9-466d32ba620b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:50.734490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9fcba-c53c-4d3c-b7b9-466d32ba620b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:50.749935 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:50.850308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861403e0-4801-420c-ad32-d2eb3bfc861c admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:50.850486 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1198/2372] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:41:50 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:41:50.863536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861403e0-4801-420c-ad32-d2eb3bfc861c admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:50.917451 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:50.923740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afda79-1f68-41fd-b973-3e67c80d5e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:50.924376 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afda79-1f68-41fd-b973-3e67c80d5e0c admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:50.924664 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afda79-1f68-41fd-b973-3e67c80d5e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:50.924940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afda79-1f68-41fd-b973-3e67c80d5e0c admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:50.925572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afda79-1f68-41fd-b973-3e67c80d5e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:50.928277 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afda79-1f68-41fd-b973-3e67c80d5e0c admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:51.045832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1175/2373] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:41:50 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:41:51.050117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9fcba-c53c-4d3c-b7b9-466d32ba620b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:51.060443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9fcba-c53c-4d3c-b7b9-466d32ba620b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:51.064925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3d467-d9f9-408a-82b7-2dd6041dd379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:51.065519 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3d467-d9f9-408a-82b7-2dd6041dd379 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:51.066057 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3d467-d9f9-408a-82b7-2dd6041dd379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:51.066330 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3d467-d9f9-408a-82b7-2dd6041dd379 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:51.067012 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3d467-d9f9-408a-82b7-2dd6041dd379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:51.069222 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3d467-d9f9-408a-82b7-2dd6041dd379 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:51.079262 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1199/2374] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:41:51.084421 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afda79-1f68-41fd-b973-3e67c80d5e0c admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:51.094172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afda79-1f68-41fd-b973-3e67c80d5e0c admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:51.099651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f1f85-5d43-481f-bd74-1fee9539be01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:51.100256 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f1f85-5d43-481f-bd74-1fee9539be01 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:51.100629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f1f85-5d43-481f-bd74-1fee9539be01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:51.100913 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f1f85-5d43-481f-bd74-1fee9539be01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:51.101559 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f1f85-5d43-481f-bd74-1fee9539be01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:51.103204 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f1f85-5d43-481f-bd74-1fee9539be01 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:51.113993 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1176/2375] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:41:51.118909 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3d467-d9f9-408a-82b7-2dd6041dd379 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:51.128912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3d467-d9f9-408a-82b7-2dd6041dd379 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:51.133426 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379583e-29c0-4f60-846c-2a788038a1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:51.138512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379583e-29c0-4f60-846c-2a788038a1ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:51.138512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379583e-29c0-4f60-846c-2a788038a1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:51.138512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379583e-29c0-4f60-846c-2a788038a1ab admin admin] PATH_INFO: `/v3/projects/3cfabc6c4c004bafbad24c8165002169/users/aa7c8035cefa423882f3ee01a633d52d/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:51.149316 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379583e-29c0-4f60-846c-2a788038a1ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cfabc6c4c004bafbad24c8165002169, user_id=aa7c8035cefa423882f3ee01a633d52d, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:51.151929 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379583e-29c0-4f60-846c-2a788038a1ab admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:51.246265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1200/2376] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:41:51 2022] PUT /identity/v3/projects/3cfabc6c4c004bafbad24c8165002169/users/aa7c8035cefa423882f3ee01a633d52d/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:51.256855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c60022-48f5-4d39-840a-aa337b571c75 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:51.257140 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c60022-48f5-4d39-840a-aa337b571c75 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:51.257416 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c60022-48f5-4d39-840a-aa337b571c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:51.286921 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-30c60022-48f5-4d39-840a-aa337b571c75 None None] MFA Rules not processed for user `aa7c8035cefa423882f3ee01a633d52d`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:41:51.288176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-30c60022-48f5-4d39-840a-aa337b571c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:51.359000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1177/2377] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:41:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:41:51.363610 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379583e-29c0-4f60-846c-2a788038a1ab admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:51.426211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379583e-29c0-4f60-846c-2a788038a1ab admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:51.431726 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086dcbd-1a16-413b-9af4-55ff5272e129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:51.432361 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086dcbd-1a16-413b-9af4-55ff5272e129 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:51.432872 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086dcbd-1a16-413b-9af4-55ff5272e129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:51.433149 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086dcbd-1a16-413b-9af4-55ff5272e129 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:51.433788 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086dcbd-1a16-413b-9af4-55ff5272e129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:51.435685 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086dcbd-1a16-413b-9af4-55ff5272e129 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:51.538814 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1201/2378] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:41:51 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:41:51.543938 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c60022-48f5-4d39-840a-aa337b571c75 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:51.553949 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c60022-48f5-4d39-840a-aa337b571c75 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:51.611930 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dadc6b-6929-41c8-9c03-f9ede1e5b269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:51.612605 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dadc6b-6929-41c8-9c03-f9ede1e5b269 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:51.612836 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dadc6b-6929-41c8-9c03-f9ede1e5b269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:51.613106 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dadc6b-6929-41c8-9c03-f9ede1e5b269 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:51.613724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dadc6b-6929-41c8-9c03-f9ede1e5b269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:51.616165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dadc6b-6929-41c8-9c03-f9ede1e5b269 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:51.717635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1178/2379] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:41:51 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:41:51.721567 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086dcbd-1a16-413b-9af4-55ff5272e129 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:51.732420 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086dcbd-1a16-413b-9af4-55ff5272e129 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:51.737016 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b7ac1-3958-47ee-bbee-492ee0d91405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:51.737601 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b7ac1-3958-47ee-bbee-492ee0d91405 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:51.737879 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b7ac1-3958-47ee-bbee-492ee0d91405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:51.738149 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b7ac1-3958-47ee-bbee-492ee0d91405 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:51.738776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b7ac1-3958-47ee-bbee-492ee0d91405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:51.741082 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b7ac1-3958-47ee-bbee-492ee0d91405 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:51.751524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1202/2380] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:41:51.755727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dadc6b-6929-41c8-9c03-f9ede1e5b269 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:51.766093 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dadc6b-6929-41c8-9c03-f9ede1e5b269 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:51.770718 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f73a93-5e64-4863-b5eb-c8a2bcf2fbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:51.773029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f73a93-5e64-4863-b5eb-c8a2bcf2fbee admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:51.773029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f73a93-5e64-4863-b5eb-c8a2bcf2fbee admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:51.773029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f73a93-5e64-4863-b5eb-c8a2bcf2fbee admin admin] PATH_INFO: `/v3/projects/89d66e6ff8934f91bd6aa6634b9d5951/users/ede70d91a75b4c35bbe10431be9ed46c/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:51.787557 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f73a93-5e64-4863-b5eb-c8a2bcf2fbee admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d66e6ff8934f91bd6aa6634b9d5951, user_id=ede70d91a75b4c35bbe10431be9ed46c, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:51.790230 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f73a93-5e64-4863-b5eb-c8a2bcf2fbee admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:51.889361 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1179/2381] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:41:51 2022] PUT /identity/v3/projects/89d66e6ff8934f91bd6aa6634b9d5951/users/ede70d91a75b4c35bbe10431be9ed46c/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:51.893293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b7ac1-3958-47ee-bbee-492ee0d91405 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:51.903143 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b7ac1-3958-47ee-bbee-492ee0d91405 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:51.959826 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6d8c6-bda8-4e23-aeb8-ac6467548ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:51.960478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6d8c6-bda8-4e23-aeb8-ac6467548ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:51.960756 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6d8c6-bda8-4e23-aeb8-ac6467548ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:51.961022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6d8c6-bda8-4e23-aeb8-ac6467548ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:51.961641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6d8c6-bda8-4e23-aeb8-ac6467548ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:51.963328 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6d8c6-bda8-4e23-aeb8-ac6467548ca5 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:51.972906 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1203/2382] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:41:51.977776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f73a93-5e64-4863-b5eb-c8a2bcf2fbee admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:51.987920 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f73a93-5e64-4863-b5eb-c8a2bcf2fbee admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:51.993142 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8022ac8-18a1-4c42-a926-f25525c9de5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:51.993785 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8022ac8-18a1-4c42-a926-f25525c9de5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:51.994065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8022ac8-18a1-4c42-a926-f25525c9de5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:51.994338 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8022ac8-18a1-4c42-a926-f25525c9de5c admin admin] PATH_INFO: `/v3/projects/89d66e6ff8934f91bd6aa6634b9d5951/users/ede70d91a75b4c35bbe10431be9ed46c/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:51.996223 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8022ac8-18a1-4c42-a926-f25525c9de5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d66e6ff8934f91bd6aa6634b9d5951, user_id=ede70d91a75b4c35bbe10431be9ed46c, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:51.998878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8022ac8-18a1-4c42-a926-f25525c9de5c admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:52.010205 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1180/2383] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:41:51 2022] PUT /identity/v3/projects/89d66e6ff8934f91bd6aa6634b9d5951/users/ede70d91a75b4c35bbe10431be9ed46c/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:52.022083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d2e34-cdd8-48dc-a62d-1880f75a7ec5 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:52.022373 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d2e34-cdd8-48dc-a62d-1880f75a7ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:52.022652 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d2e34-cdd8-48dc-a62d-1880f75a7ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:52.050601 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-0d5d2e34-cdd8-48dc-a62d-1880f75a7ec5 None None] MFA Rules not processed for user `ede70d91a75b4c35bbe10431be9ed46c`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:41:52.051794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0d5d2e34-cdd8-48dc-a62d-1880f75a7ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:52.069816 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:52.125485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1204/2384] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:41:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:41:52.141247 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8022ac8-18a1-4c42-a926-f25525c9de5c admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:52.143574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c8022ac8-18a1-4c42-a926-f25525c9de5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:52.167281 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:52.204843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8022ac8-18a1-4c42-a926-f25525c9de5c admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:52.208963 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb048d3d-f8af-4601-b218-1c375dee4418 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:52.209561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb048d3d-f8af-4601-b218-1c375dee4418 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:52.209837 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb048d3d-f8af-4601-b218-1c375dee4418 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:52.210108 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb048d3d-f8af-4601-b218-1c375dee4418 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:52.218760 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb048d3d-f8af-4601-b218-1c375dee4418 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:52.220293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb048d3d-f8af-4601-b218-1c375dee4418 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:52.230389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1181/2385] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:41:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:41:53.266447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d2e34-cdd8-48dc-a62d-1880f75a7ec5 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:53.334352 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d2e34-cdd8-48dc-a62d-1880f75a7ec5 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:53.339069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91932a70-f7f8-4ecf-974b-bb058896906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:53.339719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91932a70-f7f8-4ecf-974b-bb058896906f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:53.340002 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91932a70-f7f8-4ecf-974b-bb058896906f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:53.340273 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91932a70-f7f8-4ecf-974b-bb058896906f admin admin] PATH_INFO: `/v3/users/aa7c8035cefa423882f3ee01a633d52d` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:53.341437 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91932a70-f7f8-4ecf-974b-bb058896906f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa7c8035cefa423882f3ee01a633d52d)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:53.343358 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91932a70-f7f8-4ecf-974b-bb058896906f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:53.502511 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-91932a70-f7f8-4ecf-974b-bb058896906f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa7c8035cefa423882f3ee01a633d52d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:53.503163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-91932a70-f7f8-4ecf-974b-bb058896906f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa7c8035cefa423882f3ee01a633d52d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:53.515703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-91932a70-f7f8-4ecf-974b-bb058896906f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa7c8035cefa423882f3ee01a633d52d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:53.628585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-91932a70-f7f8-4ecf-974b-bb058896906f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa7c8035cefa423882f3ee01a633d52d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:53.629201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-91932a70-f7f8-4ecf-974b-bb058896906f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa7c8035cefa423882f3ee01a633d52d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:53.642782 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1205/2386] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:41:53 2022] DELETE /identity/v3/users/aa7c8035cefa423882f3ee01a633d52d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:53.647294 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fa5f3-cc40-4a32-8a47-fd4c0b76ecee None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:53.647739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fa5f3-cc40-4a32-8a47-fd4c0b76ecee None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:53.647876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fa5f3-cc40-4a32-8a47-fd4c0b76ecee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:53.666420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-137fa5f3-cc40-4a32-8a47-fd4c0b76ecee None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:41:53.667654 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-137fa5f3-cc40-4a32-8a47-fd4c0b76ecee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:53.726773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1182/2387] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:41:53.737525 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91932a70-f7f8-4ecf-974b-bb058896906f admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:53.739095 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-91932a70-f7f8-4ecf-974b-bb058896906f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:53.776202 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:53.798035 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91932a70-f7f8-4ecf-974b-bb058896906f admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:53.802637 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298942a-2a10-427c-9917-259db67d57fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:53.803252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298942a-2a10-427c-9917-259db67d57fe service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:53.803533 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298942a-2a10-427c-9917-259db67d57fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:53.803807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298942a-2a10-427c-9917-259db67d57fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:53.813583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298942a-2a10-427c-9917-259db67d57fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:53.814995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298942a-2a10-427c-9917-259db67d57fe service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:53.825196 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1206/2388] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:41:54.201086 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fa5f3-cc40-4a32-8a47-fd4c0b76ecee None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:54.202614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-137fa5f3-cc40-4a32-8a47-fd4c0b76ecee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:54.214774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fa5f3-cc40-4a32-8a47-fd4c0b76ecee None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:54.219776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66fac9-77d4-4e24-96dc-9c87b4ecfdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:54.220424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66fac9-77d4-4e24-96dc-9c87b4ecfdf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:54.220694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66fac9-77d4-4e24-96dc-9c87b4ecfdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:54.221011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66fac9-77d4-4e24-96dc-9c87b4ecfdf4 admin admin] PATH_INFO: `/v3/projects/3cfabc6c4c004bafbad24c8165002169` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:54.222170 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66fac9-77d4-4e24-96dc-9c87b4ecfdf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cfabc6c4c004bafbad24c8165002169)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:54.224554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66fac9-77d4-4e24-96dc-9c87b4ecfdf4 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:54.320556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2b66fac9-77d4-4e24-96dc-9c87b4ecfdf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cfabc6c4c004bafbad24c8165002169', 'request_id': 'req-2b66fac9-77d4-4e24-96dc-9c87b4ecfdf4'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:54.326958 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2b66fac9-77d4-4e24-96dc-9c87b4ecfdf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cfabc6c4c004bafbad24c8165002169', 'request_id': 'req-2b66fac9-77d4-4e24-96dc-9c87b4ecfdf4'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:54.398334 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2b66fac9-77d4-4e24-96dc-9c87b4ecfdf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cfabc6c4c004bafbad24c8165002169', 'request_id': 'req-2b66fac9-77d4-4e24-96dc-9c87b4ecfdf4'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:54.412599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2b66fac9-77d4-4e24-96dc-9c87b4ecfdf4 admin admin] The token cache is being invalidate because project 3cfabc6c4c004bafbad24c8165002169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:41:54.412895 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2b66fac9-77d4-4e24-96dc-9c87b4ecfdf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:54.413581 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2b66fac9-77d4-4e24-96dc-9c87b4ecfdf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:54.415095 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1183/2389] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:41:54 2022] DELETE /identity/v3/projects/3cfabc6c4c004bafbad24c8165002169 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:54.419335 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298942a-2a10-427c-9917-259db67d57fe service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:54.431449 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298942a-2a10-427c-9917-259db67d57fe service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:54.486092 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c7428-78c6-411c-b4fe-5d116ff92935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:54.486846 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c7428-78c6-411c-b4fe-5d116ff92935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:54.487137 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c7428-78c6-411c-b4fe-5d116ff92935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:54.487405 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c7428-78c6-411c-b4fe-5d116ff92935 admin admin] PATH_INFO: `/v3/users/ede70d91a75b4c35bbe10431be9ed46c` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:54.488640 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c7428-78c6-411c-b4fe-5d116ff92935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ede70d91a75b4c35bbe10431be9ed46c)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:54.490488 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c7428-78c6-411c-b4fe-5d116ff92935 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:54.707188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-db8c7428-78c6-411c-b4fe-5d116ff92935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ede70d91a75b4c35bbe10431be9ed46c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:54.707188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-db8c7428-78c6-411c-b4fe-5d116ff92935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ede70d91a75b4c35bbe10431be9ed46c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:54.720978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-db8c7428-78c6-411c-b4fe-5d116ff92935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ede70d91a75b4c35bbe10431be9ed46c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:54.787089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-db8c7428-78c6-411c-b4fe-5d116ff92935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ede70d91a75b4c35bbe10431be9ed46c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:54.787720 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-db8c7428-78c6-411c-b4fe-5d116ff92935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ede70d91a75b4c35bbe10431be9ed46c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:54.805809 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1207/2390] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:41:54 2022] DELETE /identity/v3/users/ede70d91a75b4c35bbe10431be9ed46c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:41:55.242117 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66fac9-77d4-4e24-96dc-9c87b4ecfdf4 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:55.246641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-2b66fac9-77d4-4e24-96dc-9c87b4ecfdf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:55.258893 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66fac9-77d4-4e24-96dc-9c87b4ecfdf4 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:55.307897 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:55.324100 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3dc88e-bb9f-4d0c-a08b-1c766163ddf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:55.324762 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dc88e-bb9f-4d0c-a08b-1c766163ddf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:55.325050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dc88e-bb9f-4d0c-a08b-1c766163ddf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:55.325324 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dc88e-bb9f-4d0c-a08b-1c766163ddf9 admin admin] PATH_INFO: `/v3/projects/89d66e6ff8934f91bd6aa6634b9d5951` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:55.326489 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3dc88e-bb9f-4d0c-a08b-1c766163ddf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d66e6ff8934f91bd6aa6634b9d5951)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:55.328453 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3dc88e-bb9f-4d0c-a08b-1c766163ddf9 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:55.440042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-eb3dc88e-bb9f-4d0c-a08b-1c766163ddf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d66e6ff8934f91bd6aa6634b9d5951', 'request_id': 'req-eb3dc88e-bb9f-4d0c-a08b-1c766163ddf9'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:55.447295 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-eb3dc88e-bb9f-4d0c-a08b-1c766163ddf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d66e6ff8934f91bd6aa6634b9d5951', 'request_id': 'req-eb3dc88e-bb9f-4d0c-a08b-1c766163ddf9'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:55.571337 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-eb3dc88e-bb9f-4d0c-a08b-1c766163ddf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d66e6ff8934f91bd6aa6634b9d5951', 'request_id': 'req-eb3dc88e-bb9f-4d0c-a08b-1c766163ddf9'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:55.584091 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-eb3dc88e-bb9f-4d0c-a08b-1c766163ddf9 admin admin] The token cache is being invalidate because project 89d66e6ff8934f91bd6aa6634b9d5951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:41:55.584501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-eb3dc88e-bb9f-4d0c-a08b-1c766163ddf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:55.585167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-eb3dc88e-bb9f-4d0c-a08b-1c766163ddf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:41:55.586670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1184/2391] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:41:55 2022] DELETE /identity/v3/projects/89d66e6ff8934f91bd6aa6634b9d5951 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:55.591769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f57c5-15c5-4c28-8d56-d9190e056ee3 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:55.592256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f57c5-15c5-4c28-8d56-d9190e056ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:55.592372 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f57c5-15c5-4c28-8d56-d9190e056ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:55.613320 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-2a7f57c5-15c5-4c28-8d56-d9190e056ee3 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:41:55.614554 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2a7f57c5-15c5-4c28-8d56-d9190e056ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:55.664077 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:55.675863 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1208/2392] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:41:55.684065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2f240-be40-4a00-9280-5c586b93ab16 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:55.684378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2f240-be40-4a00-9280-5c586b93ab16 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:55.684665 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2f240-be40-4a00-9280-5c586b93ab16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:55.705960 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-00f2f240-be40-4a00-9280-5c586b93ab16 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:41:55.707556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-00f2f240-be40-4a00-9280-5c586b93ab16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:55.716279 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1185/2393] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:41:55.720377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f57c5-15c5-4c28-8d56-d9190e056ee3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:55.731730 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f57c5-15c5-4c28-8d56-d9190e056ee3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:55.736691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fc5d4-4b9b-4067-ad1f-77daa5e92cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:55.737292 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fc5d4-4b9b-4067-ad1f-77daa5e92cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:55.738091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fc5d4-4b9b-4067-ad1f-77daa5e92cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:55.738091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fc5d4-4b9b-4067-ad1f-77daa5e92cf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:55.738612 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120fc5d4-4b9b-4067-ad1f-77daa5e92cf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:41:55.738913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120fc5d4-4b9b-4067-ad1f-77daa5e92cf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:55.740560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120fc5d4-4b9b-4067-ad1f-77daa5e92cf2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:55.753925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1209/2394] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:41:55.758193 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2f240-be40-4a00-9280-5c586b93ab16 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:55.767917 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2f240-be40-4a00-9280-5c586b93ab16 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:55.773204 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13683e-4140-4a9b-8eda-8cb9f1840790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:55.773801 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13683e-4140-4a9b-8eda-8cb9f1840790 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:55.774080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13683e-4140-4a9b-8eda-8cb9f1840790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:55.774350 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13683e-4140-4a9b-8eda-8cb9f1840790 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:55.774992 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13683e-4140-4a9b-8eda-8cb9f1840790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:55.777003 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13683e-4140-4a9b-8eda-8cb9f1840790 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:55.898617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1186/2395] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:41:55 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:41:55.902762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fc5d4-4b9b-4067-ad1f-77daa5e92cf2 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:55.912663 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fc5d4-4b9b-4067-ad1f-77daa5e92cf2 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:55.971682 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a47a8-30e3-4b39-859d-6765b10eee24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:55.975561 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a47a8-30e3-4b39-859d-6765b10eee24 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:55.975561 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a47a8-30e3-4b39-859d-6765b10eee24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:55.975561 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a47a8-30e3-4b39-859d-6765b10eee24 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:55.975561 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a47a8-30e3-4b39-859d-6765b10eee24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:55.975561 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a47a8-30e3-4b39-859d-6765b10eee24 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:56.051373 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1210/2396] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:41:55 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:41:56.056012 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13683e-4140-4a9b-8eda-8cb9f1840790 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:56.066423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13683e-4140-4a9b-8eda-8cb9f1840790 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:56.071689 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdb97e-1401-4e8e-9f3c-b893682a9a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:56.072279 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb97e-1401-4e8e-9f3c-b893682a9a54 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:56.072646 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb97e-1401-4e8e-9f3c-b893682a9a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:56.072915 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb97e-1401-4e8e-9f3c-b893682a9a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:56.073554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdb97e-1401-4e8e-9f3c-b893682a9a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:56.075141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdb97e-1401-4e8e-9f3c-b893682a9a54 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:56.085148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1187/2397] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:41:56.097948 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a47a8-30e3-4b39-859d-6765b10eee24 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:56.108101 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a47a8-30e3-4b39-859d-6765b10eee24 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:56.112717 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f6cf0-bde7-4cbf-b266-24300583e7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:56.113752 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f6cf0-bde7-4cbf-b266-24300583e7ce admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:56.114030 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f6cf0-bde7-4cbf-b266-24300583e7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:56.114303 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f6cf0-bde7-4cbf-b266-24300583e7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:56.115438 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f6cf0-bde7-4cbf-b266-24300583e7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:56.117044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f6cf0-bde7-4cbf-b266-24300583e7ce admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:56.127550 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1211/2398] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:41:56.132324 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdb97e-1401-4e8e-9f3c-b893682a9a54 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:56.142235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdb97e-1401-4e8e-9f3c-b893682a9a54 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:56.146729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e824dbc-068f-4d84-90e6-f3433a38a9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:56.147397 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e824dbc-068f-4d84-90e6-f3433a38a9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:56.147673 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e824dbc-068f-4d84-90e6-f3433a38a9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:56.147942 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e824dbc-068f-4d84-90e6-f3433a38a9b5 admin admin] PATH_INFO: `/v3/projects/9f026b79cf38483bb7849a2ff9f81179/users/31d796a0f0664b498bf45a3d23d0a8e4/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:56.163044 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e824dbc-068f-4d84-90e6-f3433a38a9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f026b79cf38483bb7849a2ff9f81179, user_id=31d796a0f0664b498bf45a3d23d0a8e4, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:56.165987 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e824dbc-068f-4d84-90e6-f3433a38a9b5 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:56.269164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1188/2399] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:41:56 2022] PUT /identity/v3/projects/9f026b79cf38483bb7849a2ff9f81179/users/31d796a0f0664b498bf45a3d23d0a8e4/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:56.280632 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d388ea-0c1e-466b-bea8-bf3c34d27537 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:56.281018 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d388ea-0c1e-466b-bea8-bf3c34d27537 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:56.281369 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d388ea-0c1e-466b-bea8-bf3c34d27537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:56.310572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-50d388ea-0c1e-466b-bea8-bf3c34d27537 None None] MFA Rules not processed for user `31d796a0f0664b498bf45a3d23d0a8e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:41:56.311780 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-50d388ea-0c1e-466b-bea8-bf3c34d27537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:56.378061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1212/2400] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:41:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:41:56.382600 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e824dbc-068f-4d84-90e6-f3433a38a9b5 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:56.444324 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e824dbc-068f-4d84-90e6-f3433a38a9b5 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:56.448915 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bdbd9-7bda-42b2-b96b-da5463c572b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:56.449529 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bdbd9-7bda-42b2-b96b-da5463c572b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:56.449814 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bdbd9-7bda-42b2-b96b-da5463c572b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:56.450086 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bdbd9-7bda-42b2-b96b-da5463c572b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:56.450743 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bdbd9-7bda-42b2-b96b-da5463c572b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:56.452758 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bdbd9-7bda-42b2-b96b-da5463c572b6 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:56.467594 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:56.588614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1189/2401] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:41:56 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:41:56.591983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d388ea-0c1e-466b-bea8-bf3c34d27537 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:56.603242 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d388ea-0c1e-466b-bea8-bf3c34d27537 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:56.648973 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:56.658419 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9764f-081b-48c3-85db-a0b61250dcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:56.663446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9764f-081b-48c3-85db-a0b61250dcf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:56.663446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9764f-081b-48c3-85db-a0b61250dcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:56.663446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9764f-081b-48c3-85db-a0b61250dcf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:56.663446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9764f-081b-48c3-85db-a0b61250dcf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:56.663446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9764f-081b-48c3-85db-a0b61250dcf1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:56.774510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1213/2402] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:41:56 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:41:56.776722 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bdbd9-7bda-42b2-b96b-da5463c572b6 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:56.786921 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bdbd9-7bda-42b2-b96b-da5463c572b6 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:56.792212 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1e8aa-c552-4db0-8c84-3e97a369b052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:56.792866 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1e8aa-c552-4db0-8c84-3e97a369b052 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:56.793145 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1e8aa-c552-4db0-8c84-3e97a369b052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:56.793415 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1e8aa-c552-4db0-8c84-3e97a369b052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:56.794173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1e8aa-c552-4db0-8c84-3e97a369b052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:56.795685 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1e8aa-c552-4db0-8c84-3e97a369b052 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:56.807379 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1190/2403] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:41:56.811805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9764f-081b-48c3-85db-a0b61250dcf1 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:56.822870 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9764f-081b-48c3-85db-a0b61250dcf1 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:56.828018 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cec43-4916-4199-a446-2bf07b042a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:56.828763 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cec43-4916-4199-a446-2bf07b042a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:56.829079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cec43-4916-4199-a446-2bf07b042a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:56.829329 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cec43-4916-4199-a446-2bf07b042a56 admin admin] PATH_INFO: `/v3/projects/4d5776512c6a4fd3a6841b927e2ed887/users/756e0d2b226940058defb4939a89f20e/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:56.844691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cec43-4916-4199-a446-2bf07b042a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5776512c6a4fd3a6841b927e2ed887, user_id=756e0d2b226940058defb4939a89f20e, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:56.847332 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cec43-4916-4199-a446-2bf07b042a56 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:56.908735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1214/2404] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:41:56 2022] PUT /identity/v3/projects/4d5776512c6a4fd3a6841b927e2ed887/users/756e0d2b226940058defb4939a89f20e/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:56.913134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1e8aa-c552-4db0-8c84-3e97a369b052 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:56.922924 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1e8aa-c552-4db0-8c84-3e97a369b052 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:56.977680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d187c2-6fc0-4154-bed6-24f79f1dd0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:56.978275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d187c2-6fc0-4154-bed6-24f79f1dd0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:56.978553 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d187c2-6fc0-4154-bed6-24f79f1dd0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:56.978828 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d187c2-6fc0-4154-bed6-24f79f1dd0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:56.979451 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d187c2-6fc0-4154-bed6-24f79f1dd0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:56.981068 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d187c2-6fc0-4154-bed6-24f79f1dd0d9 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:56.991026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1191/2405] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:41:56.995005 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cec43-4916-4199-a446-2bf07b042a56 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:57.005061 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cec43-4916-4199-a446-2bf07b042a56 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:57.009780 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdb96c-74ca-4fd5-b689-514cab361e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:57.010417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdb96c-74ca-4fd5-b689-514cab361e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:57.010694 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdb96c-74ca-4fd5-b689-514cab361e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:57.010965 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdb96c-74ca-4fd5-b689-514cab361e55 admin admin] PATH_INFO: `/v3/projects/4d5776512c6a4fd3a6841b927e2ed887/users/756e0d2b226940058defb4939a89f20e/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:57.012911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdb96c-74ca-4fd5-b689-514cab361e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5776512c6a4fd3a6841b927e2ed887, user_id=756e0d2b226940058defb4939a89f20e, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:57.015498 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdb96c-74ca-4fd5-b689-514cab361e55 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:57.025525 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1215/2406] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:41:56 2022] PUT /identity/v3/projects/4d5776512c6a4fd3a6841b927e2ed887/users/756e0d2b226940058defb4939a89f20e/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:41:57.035190 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d256417-9cca-4d3b-9c68-bc921968b8c3 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:57.035475 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d256417-9cca-4d3b-9c68-bc921968b8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:57.035748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d256417-9cca-4d3b-9c68-bc921968b8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:57.063238 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-3d256417-9cca-4d3b-9c68-bc921968b8c3 None None] MFA Rules not processed for user `756e0d2b226940058defb4939a89f20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:41:57.064456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3d256417-9cca-4d3b-9c68-bc921968b8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:57.130396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1192/2407] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:41:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:41:57.141119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdb96c-74ca-4fd5-b689-514cab361e55 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:41:57.142793 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-90cdb96c-74ca-4fd5-b689-514cab361e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:41:57.201330 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdb96c-74ca-4fd5-b689-514cab361e55 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:41:57.210043 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682dc68-522a-4384-b8aa-e497821a46a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:41:57.210619 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682dc68-522a-4384-b8aa-e497821a46a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:41:57.210892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682dc68-522a-4384-b8aa-e497821a46a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:41:57.211158 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682dc68-522a-4384-b8aa-e497821a46a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:41:57.268657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682dc68-522a-4384-b8aa-e497821a46a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:41:57.270077 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682dc68-522a-4384-b8aa-e497821a46a3 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:41:57.279406 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1216/2408] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:41:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:42:00.577021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d256417-9cca-4d3b-9c68-bc921968b8c3 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:00.587349 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d256417-9cca-4d3b-9c68-bc921968b8c3 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:00.590929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd86b3a-3921-4996-a9c6-78e0c1162969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:00.591622 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd86b3a-3921-4996-a9c6-78e0c1162969 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:00.591905 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd86b3a-3921-4996-a9c6-78e0c1162969 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:00.592179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd86b3a-3921-4996-a9c6-78e0c1162969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:00.602029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd86b3a-3921-4996-a9c6-78e0c1162969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:00.603513 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd86b3a-3921-4996-a9c6-78e0c1162969 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:00.613952 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1193/2409] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:42:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:42:02.719048 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682dc68-522a-4384-b8aa-e497821a46a3 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:02.721086 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2682dc68-522a-4384-b8aa-e497821a46a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:02.725231 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd86b3a-3921-4996-a9c6-78e0c1162969 service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:02.727501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-0cd86b3a-3921-4996-a9c6-78e0c1162969 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:02.811212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682dc68-522a-4384-b8aa-e497821a46a3 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:02.818889 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb6fe3-076a-414b-b3f0-910dd4bdee78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:02.818889 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb6fe3-076a-414b-b3f0-910dd4bdee78 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:02.818889 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb6fe3-076a-414b-b3f0-910dd4bdee78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:02.818889 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb6fe3-076a-414b-b3f0-910dd4bdee78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:02.820965 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6bdb6fe3-076a-414b-b3f0-910dd4bdee78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:02.834730 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:02.835582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd86b3a-3921-4996-a9c6-78e0c1162969 service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:02.855330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6d50a-4030-4798-9e8d-49c0de56c154 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e15cb1d012934ebeac53af885ca65f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:02.855330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6d50a-4030-4798-9e8d-49c0de56c154 service glance] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:02.855330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6d50a-4030-4798-9e8d-49c0de56c154 service glance] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:02.855330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6d50a-4030-4798-9e8d-49c0de56c154 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:02.859766 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-36c6d50a-4030-4798-9e8d-49c0de56c154 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:02.860640 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:02.904810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb6fe3-076a-414b-b3f0-910dd4bdee78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:02.905211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb6fe3-076a-414b-b3f0-910dd4bdee78 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:02.915844 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1217/2410] 10.222.0.26 () {60 vars in 1396 bytes} [Tue Sep 27 16:42:02 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3266 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:42:02.937481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6d50a-4030-4798-9e8d-49c0de56c154 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:02.939214 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6d50a-4030-4798-9e8d-49c0de56c154 service glance] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:02.950462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1194/2411] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:42:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:42:03.122790 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e4e8b-1a4c-4616-85ae-b14c0770a75c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:03.123076 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e4e8b-1a4c-4616-85ae-b14c0770a75c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:03.123354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e4e8b-1a4c-4616-85ae-b14c0770a75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:03.144545 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-2c8e4e8b-1a4c-4616-85ae-b14c0770a75c None None] MFA Rules not processed for user `0c8d0a718e8347b5af397f866056266e`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:42:03.145697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2c8e4e8b-1a4c-4616-85ae-b14c0770a75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:03.202768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1218/2412] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 27 16:42:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:42:03.381649 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6d50a-4030-4798-9e8d-49c0de56c154 service glance] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:03.383193 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-36c6d50a-4030-4798-9e8d-49c0de56c154 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:03.453703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6d50a-4030-4798-9e8d-49c0de56c154 service glance] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:03.458888 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eadc2-2eb8-4c52-8b20-e83aec6c2e48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b85e430004a8b865622354c1d1ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:03.459492 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eadc2-2eb8-4c52-8b20-e83aec6c2e48 service swift] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:03.459771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eadc2-2eb8-4c52-8b20-e83aec6c2e48 service swift] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:03.460042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eadc2-2eb8-4c52-8b20-e83aec6c2e48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:03.469050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564eadc2-2eb8-4c52-8b20-e83aec6c2e48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:03.470712 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564eadc2-2eb8-4c52-8b20-e83aec6c2e48 service swift] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:03.483081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1195/2413] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 27 16:42:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 16:42:06.672156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ea376-d5bc-47cb-aba7-a2af0d7c976f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:06.672703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ea376-d5bc-47cb-aba7-a2af0d7c976f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:06.672805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ea376-d5bc-47cb-aba7-a2af0d7c976f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:06.692478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-771ea376-d5bc-47cb-aba7-a2af0d7c976f None None] MFA Rules not processed for user `a6507ed9a47848c29d72fd9af71e2cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:42:06.693719 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-771ea376-d5bc-47cb-aba7-a2af0d7c976f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:06.768224 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1219/2414] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:42:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:42:07.158430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eadc2-2eb8-4c52-8b20-e83aec6c2e48 service swift] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:07.159890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-564eadc2-2eb8-4c52-8b20-e83aec6c2e48 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:07.176279 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eadc2-2eb8-4c52-8b20-e83aec6c2e48 service swift] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:07.181976 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befd1c3-8015-4018-bcee-548311e3a8d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:07.183117 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befd1c3-8015-4018-bcee-548311e3a8d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:07.183504 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befd1c3-8015-4018-bcee-548311e3a8d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:07.184255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befd1c3-8015-4018-bcee-548311e3a8d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:07.186641 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-2befd1c3-8015-4018-bcee-548311e3a8d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:07.201192 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befd1c3-8015-4018-bcee-548311e3a8d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:07.203199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befd1c3-8015-4018-bcee-548311e3a8d5 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:07.214447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1196/2415] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:42:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:42:07.686330 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ea376-d5bc-47cb-aba7-a2af0d7c976f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:07.688220 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-771ea376-d5bc-47cb-aba7-a2af0d7c976f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:07.811822 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:07.823737 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ea376-d5bc-47cb-aba7-a2af0d7c976f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:07.830204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca991a-e740-45fc-b316-7747eb75fa80 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5deb7370bc3045c5be2d391d3b1dbd82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:07.830842 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca991a-e740-45fc-b316-7747eb75fa80 service placement] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:07.831119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca991a-e740-45fc-b316-7747eb75fa80 service placement] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:07.831393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca991a-e740-45fc-b316-7747eb75fa80 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:07.839157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e9ca991a-e740-45fc-b316-7747eb75fa80 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:07.852967 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca991a-e740-45fc-b316-7747eb75fa80 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:07.854917 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca991a-e740-45fc-b316-7747eb75fa80 service placement] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:07.867665 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1220/2416] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:42:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:42:11.919684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befd1c3-8015-4018-bcee-548311e3a8d5 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:11.933046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befd1c3-8015-4018-bcee-548311e3a8d5 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:11.939186 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f207f5-a4d0-45d9-812e-49f15e66f8c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:11.942560 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f207f5-a4d0-45d9-812e-49f15e66f8c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:11.943063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f207f5-a4d0-45d9-812e-49f15e66f8c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:11.943557 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f207f5-a4d0-45d9-812e-49f15e66f8c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:11.946074 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-14f207f5-a4d0-45d9-812e-49f15e66f8c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:11.958542 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f207f5-a4d0-45d9-812e-49f15e66f8c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:11.960087 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f207f5-a4d0-45d9-812e-49f15e66f8c9 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:11.974761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1197/2417] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:42:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:42:16.279705 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca991a-e740-45fc-b316-7747eb75fa80 service placement] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:16.281289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e9ca991a-e740-45fc-b316-7747eb75fa80 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:16.366673 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca991a-e740-45fc-b316-7747eb75fa80 service placement] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:16.372609 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f697f3-0d48-49ae-a071-548abe571ba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:16.373282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f697f3-0d48-49ae-a071-548abe571ba2 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:16.373567 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f697f3-0d48-49ae-a071-548abe571ba2 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:16.373872 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f697f3-0d48-49ae-a071-548abe571ba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:16.375857 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-47f697f3-0d48-49ae-a071-548abe571ba2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:16.438113 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f697f3-0d48-49ae-a071-548abe571ba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:16.439712 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f697f3-0d48-49ae-a071-548abe571ba2 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:16.450603 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1221/2418] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:42:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:42:16.609439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f207f5-a4d0-45d9-812e-49f15e66f8c9 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:16.687985 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f207f5-a4d0-45d9-812e-49f15e66f8c9 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:16.693044 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e6361-a9be-497b-8acd-f8e20d6fb87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:16.693676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e6361-a9be-497b-8acd-f8e20d6fb87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:16.693955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e6361-a9be-497b-8acd-f8e20d6fb87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:16.694232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e6361-a9be-497b-8acd-f8e20d6fb87b admin admin] PATH_INFO: `/v3/users/31d796a0f0664b498bf45a3d23d0a8e4` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:16.695370 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e6361-a9be-497b-8acd-f8e20d6fb87b admin admin] RBAC: Authorizing `identity:delete_user(user_id=31d796a0f0664b498bf45a3d23d0a8e4)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:16.697482 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e6361-a9be-497b-8acd-f8e20d6fb87b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:16.710361 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:16.905867 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-c12e6361-a9be-497b-8acd-f8e20d6fb87b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31d796a0f0664b498bf45a3d23d0a8e4'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:16.906520 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-c12e6361-a9be-497b-8acd-f8e20d6fb87b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31d796a0f0664b498bf45a3d23d0a8e4'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:16.918355 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-c12e6361-a9be-497b-8acd-f8e20d6fb87b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31d796a0f0664b498bf45a3d23d0a8e4'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:17.029196 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-c12e6361-a9be-497b-8acd-f8e20d6fb87b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31d796a0f0664b498bf45a3d23d0a8e4'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:17.030324 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-c12e6361-a9be-497b-8acd-f8e20d6fb87b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31d796a0f0664b498bf45a3d23d0a8e4'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:17.062033 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1198/2419] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:42:16 2022] DELETE /identity/v3/users/31d796a0f0664b498bf45a3d23d0a8e4 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:42:17.068672 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78e8b2-e8c1-49b8-b92c-5910f543d331 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:17.069880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78e8b2-e8c1-49b8-b92c-5910f543d331 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:17.070596 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78e8b2-e8c1-49b8-b92c-5910f543d331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:17.097797 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3b78e8b2-e8c1-49b8-b92c-5910f543d331 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:42:17.099415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3b78e8b2-e8c1-49b8-b92c-5910f543d331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:17.181752 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1222/2420] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:42:17.193610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e6361-a9be-497b-8acd-f8e20d6fb87b admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:17.195040 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c12e6361-a9be-497b-8acd-f8e20d6fb87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:17.257382 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e6361-a9be-497b-8acd-f8e20d6fb87b admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:17.261303 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4a4d6-a1b0-4651-84d0-1a4c8d489a02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:17.261974 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4a4d6-a1b0-4651-84d0-1a4c8d489a02 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:17.262257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4a4d6-a1b0-4651-84d0-1a4c8d489a02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:17.262532 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4a4d6-a1b0-4651-84d0-1a4c8d489a02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:17.271720 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4a4d6-a1b0-4651-84d0-1a4c8d489a02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:17.273199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4a4d6-a1b0-4651-84d0-1a4c8d489a02 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:17.283351 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1199/2421] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:42:17.737326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78e8b2-e8c1-49b8-b92c-5910f543d331 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:17.742445 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3b78e8b2-e8c1-49b8-b92c-5910f543d331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:17.757474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78e8b2-e8c1-49b8-b92c-5910f543d331 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:17.770339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f50ece-8cf2-4c89-9738-53a593470fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:17.771095 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f50ece-8cf2-4c89-9738-53a593470fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:17.771514 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f50ece-8cf2-4c89-9738-53a593470fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:17.771792 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f50ece-8cf2-4c89-9738-53a593470fc0 admin admin] PATH_INFO: `/v3/projects/9f026b79cf38483bb7849a2ff9f81179` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:17.773808 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f50ece-8cf2-4c89-9738-53a593470fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f026b79cf38483bb7849a2ff9f81179)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:17.777713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f50ece-8cf2-4c89-9738-53a593470fc0 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:17.807270 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:17.893622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d1f50ece-8cf2-4c89-9738-53a593470fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f026b79cf38483bb7849a2ff9f81179', 'request_id': 'req-d1f50ece-8cf2-4c89-9738-53a593470fc0'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:17.899558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d1f50ece-8cf2-4c89-9738-53a593470fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f026b79cf38483bb7849a2ff9f81179', 'request_id': 'req-d1f50ece-8cf2-4c89-9738-53a593470fc0'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:17.988626 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d1f50ece-8cf2-4c89-9738-53a593470fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f026b79cf38483bb7849a2ff9f81179', 'request_id': 'req-d1f50ece-8cf2-4c89-9738-53a593470fc0'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:18.000294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d1f50ece-8cf2-4c89-9738-53a593470fc0 admin admin] The token cache is being invalidate because project 9f026b79cf38483bb7849a2ff9f81179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:42:18.000614 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d1f50ece-8cf2-4c89-9738-53a593470fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:18.001281 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d1f50ece-8cf2-4c89-9738-53a593470fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:18.002768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1223/2422] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:42:17 2022] DELETE /identity/v3/projects/9f026b79cf38483bb7849a2ff9f81179 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:42:18.006816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4a4d6-a1b0-4651-84d0-1a4c8d489a02 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:18.017130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4a4d6-a1b0-4651-84d0-1a4c8d489a02 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:18.073699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc3a61-b105-477a-a8f1-8ed6a46a06d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:18.074249 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc3a61-b105-477a-a8f1-8ed6a46a06d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:18.074528 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc3a61-b105-477a-a8f1-8ed6a46a06d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:18.074830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc3a61-b105-477a-a8f1-8ed6a46a06d7 admin admin] PATH_INFO: `/v3/users/756e0d2b226940058defb4939a89f20e` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:18.075979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc3a61-b105-477a-a8f1-8ed6a46a06d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=756e0d2b226940058defb4939a89f20e)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:18.077946 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc3a61-b105-477a-a8f1-8ed6a46a06d7 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:18.239891 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:18.253081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-9efc3a61-b105-477a-a8f1-8ed6a46a06d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756e0d2b226940058defb4939a89f20e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:18.253797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-9efc3a61-b105-477a-a8f1-8ed6a46a06d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756e0d2b226940058defb4939a89f20e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:18.269180 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-9efc3a61-b105-477a-a8f1-8ed6a46a06d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756e0d2b226940058defb4939a89f20e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:18.355764 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-9efc3a61-b105-477a-a8f1-8ed6a46a06d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756e0d2b226940058defb4939a89f20e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:18.355764 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-9efc3a61-b105-477a-a8f1-8ed6a46a06d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756e0d2b226940058defb4939a89f20e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:18.363255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1200/2423] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:42:18 2022] DELETE /identity/v3/users/756e0d2b226940058defb4939a89f20e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:42:18.894356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f50ece-8cf2-4c89-9738-53a593470fc0 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:18.895849 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d1f50ece-8cf2-4c89-9738-53a593470fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:18.913163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f50ece-8cf2-4c89-9738-53a593470fc0 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:18.979799 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367bd7a-5788-4294-aed9-183c5f4ef3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:18.994942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367bd7a-5788-4294-aed9-183c5f4ef3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:18.994942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367bd7a-5788-4294-aed9-183c5f4ef3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:18.994942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367bd7a-5788-4294-aed9-183c5f4ef3cf admin admin] PATH_INFO: `/v3/projects/4d5776512c6a4fd3a6841b927e2ed887` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:18.994942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367bd7a-5788-4294-aed9-183c5f4ef3cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d5776512c6a4fd3a6841b927e2ed887)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:18.994942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367bd7a-5788-4294-aed9-183c5f4ef3cf admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:19.117205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c367bd7a-5788-4294-aed9-183c5f4ef3cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d5776512c6a4fd3a6841b927e2ed887', 'request_id': 'req-c367bd7a-5788-4294-aed9-183c5f4ef3cf'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:19.126451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c367bd7a-5788-4294-aed9-183c5f4ef3cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d5776512c6a4fd3a6841b927e2ed887', 'request_id': 'req-c367bd7a-5788-4294-aed9-183c5f4ef3cf'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:19.210158 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c367bd7a-5788-4294-aed9-183c5f4ef3cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d5776512c6a4fd3a6841b927e2ed887', 'request_id': 'req-c367bd7a-5788-4294-aed9-183c5f4ef3cf'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:19.237499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c367bd7a-5788-4294-aed9-183c5f4ef3cf admin admin] The token cache is being invalidate because project 4d5776512c6a4fd3a6841b927e2ed887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:42:19.237749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c367bd7a-5788-4294-aed9-183c5f4ef3cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:19.238646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c367bd7a-5788-4294-aed9-183c5f4ef3cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:19.240480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1224/2424] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:42:18 2022] DELETE /identity/v3/projects/4d5776512c6a4fd3a6841b927e2ed887 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:42:19.247113 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488644d-7e60-45d2-934b-08219fe1f8e3 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:19.247634 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488644d-7e60-45d2-934b-08219fe1f8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:19.247895 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488644d-7e60-45d2-934b-08219fe1f8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:19.274720 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-c488644d-7e60-45d2-934b-08219fe1f8e3 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:42:19.276726 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c488644d-7e60-45d2-934b-08219fe1f8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:19.363989 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1201/2425] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:42:19.372898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ece810-bac1-4f76-969c-69fa07961d9a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:19.373291 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ece810-bac1-4f76-969c-69fa07961d9a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:19.373597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ece810-bac1-4f76-969c-69fa07961d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:19.396436 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-22ece810-bac1-4f76-969c-69fa07961d9a None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:42:19.397814 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-22ece810-bac1-4f76-969c-69fa07961d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:19.408458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1225/2426] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:42:19.412889 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488644d-7e60-45d2-934b-08219fe1f8e3 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:19.423266 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488644d-7e60-45d2-934b-08219fe1f8e3 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:19.429314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc309b8-1042-498d-ab74-2a25c6792fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:19.429957 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc309b8-1042-498d-ab74-2a25c6792fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:19.430234 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc309b8-1042-498d-ab74-2a25c6792fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:19.430507 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc309b8-1042-498d-ab74-2a25c6792fd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:19.431235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc309b8-1042-498d-ab74-2a25c6792fd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:42:19.431511 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc309b8-1042-498d-ab74-2a25c6792fd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:19.433172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc309b8-1042-498d-ab74-2a25c6792fd8 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:19.445597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1202/2427] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:42:19.450041 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ece810-bac1-4f76-969c-69fa07961d9a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:19.459597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ece810-bac1-4f76-969c-69fa07961d9a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:19.464874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fce04-5799-4761-b889-361baf2b4312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:19.465477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fce04-5799-4761-b889-361baf2b4312 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:19.465751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fce04-5799-4761-b889-361baf2b4312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:19.466020 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fce04-5799-4761-b889-361baf2b4312 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:19.466655 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fce04-5799-4761-b889-361baf2b4312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:19.468752 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fce04-5799-4761-b889-361baf2b4312 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:19.577269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1226/2428] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:42:19 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:42:19.578429 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc309b8-1042-498d-ab74-2a25c6792fd8 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:19.601194 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc309b8-1042-498d-ab74-2a25c6792fd8 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:19.670475 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9aa04-a449-40a8-b79d-cfbabe7cd9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:19.671146 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9aa04-a449-40a8-b79d-cfbabe7cd9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:19.671354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9aa04-a449-40a8-b79d-cfbabe7cd9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:19.671623 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9aa04-a449-40a8-b79d-cfbabe7cd9b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:19.672256 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9aa04-a449-40a8-b79d-cfbabe7cd9b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:19.674180 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9aa04-a449-40a8-b79d-cfbabe7cd9b7 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:19.765160 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1203/2429] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:42:19 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:42:19.769354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fce04-5799-4761-b889-361baf2b4312 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:19.780875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fce04-5799-4761-b889-361baf2b4312 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:19.785866 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c34786-825c-4b5f-aaff-ccffb4ac686d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:19.786474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c34786-825c-4b5f-aaff-ccffb4ac686d admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:19.786753 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c34786-825c-4b5f-aaff-ccffb4ac686d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:19.787058 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c34786-825c-4b5f-aaff-ccffb4ac686d admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:19.787657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c34786-825c-4b5f-aaff-ccffb4ac686d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:19.789498 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c34786-825c-4b5f-aaff-ccffb4ac686d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:19.800602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1227/2430] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:42:19.804705 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9aa04-a449-40a8-b79d-cfbabe7cd9b7 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:19.815183 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9aa04-a449-40a8-b79d-cfbabe7cd9b7 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:19.820377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a956d-f014-4780-96f4-2776822d9ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:19.820979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a956d-f014-4780-96f4-2776822d9ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:19.821259 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a956d-f014-4780-96f4-2776822d9ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:19.821659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a956d-f014-4780-96f4-2776822d9ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:19.822848 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a956d-f014-4780-96f4-2776822d9ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:19.824531 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a956d-f014-4780-96f4-2776822d9ddb admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:19.835499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1204/2431] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:42:19.840479 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c34786-825c-4b5f-aaff-ccffb4ac686d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:19.846022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:19.851499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c34786-825c-4b5f-aaff-ccffb4ac686d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:19.856554 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466e2ee-49bf-4485-a562-ab085e79c52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:19.857203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466e2ee-49bf-4485-a562-ab085e79c52b admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:19.857478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466e2ee-49bf-4485-a562-ab085e79c52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:19.857749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466e2ee-49bf-4485-a562-ab085e79c52b admin admin] PATH_INFO: `/v3/projects/155093b39b8047d386d9ed0e5d1c214c/users/eeb3abe800c744b39356db954d6ef3c5/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:19.871930 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466e2ee-49bf-4485-a562-ab085e79c52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=155093b39b8047d386d9ed0e5d1c214c, user_id=eeb3abe800c744b39356db954d6ef3c5, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:19.874572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466e2ee-49bf-4485-a562-ab085e79c52b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:19.960439 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1228/2432] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:42:19 2022] PUT /identity/v3/projects/155093b39b8047d386d9ed0e5d1c214c/users/eeb3abe800c744b39356db954d6ef3c5/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:42:19.966100 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafde2b9-8ec7-4a83-8df3-342438955183 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:19.966365 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafde2b9-8ec7-4a83-8df3-342438955183 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:19.966714 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafde2b9-8ec7-4a83-8df3-342438955183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:19.985850 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-cafde2b9-8ec7-4a83-8df3-342438955183 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:42:19.987067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-cafde2b9-8ec7-4a83-8df3-342438955183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:19.998969 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:20.047585 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1205/2433] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:42:20.057966 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466e2ee-49bf-4485-a562-ab085e79c52b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:20.059694 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1466e2ee-49bf-4485-a562-ab085e79c52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:20.119064 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466e2ee-49bf-4485-a562-ab085e79c52b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:20.122925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19098c4a-0220-431d-8426-dda3705b3286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:20.123536 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19098c4a-0220-431d-8426-dda3705b3286 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:20.124009 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19098c4a-0220-431d-8426-dda3705b3286 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:20.124295 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19098c4a-0220-431d-8426-dda3705b3286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:20.140970 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19098c4a-0220-431d-8426-dda3705b3286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:20.142525 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19098c4a-0220-431d-8426-dda3705b3286 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:20.153164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1229/2434] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:42:21.166912 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafde2b9-8ec7-4a83-8df3-342438955183 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:21.168607 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-cafde2b9-8ec7-4a83-8df3-342438955183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:21.242361 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafde2b9-8ec7-4a83-8df3-342438955183 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:21.248464 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6d49d-9675-4f38-81d1-e8b95e9b2c6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:21.249060 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6d49d-9675-4f38-81d1-e8b95e9b2c6a service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:21.249337 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6d49d-9675-4f38-81d1-e8b95e9b2c6a service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:21.249606 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6d49d-9675-4f38-81d1-e8b95e9b2c6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:21.251284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-bdf6d49d-9675-4f38-81d1-e8b95e9b2c6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:21.263993 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6d49d-9675-4f38-81d1-e8b95e9b2c6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:21.265620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6d49d-9675-4f38-81d1-e8b95e9b2c6a service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:21.276307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1206/2435] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:42:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:42:23.598039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19098c4a-0220-431d-8426-dda3705b3286 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:23.600194 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-19098c4a-0220-431d-8426-dda3705b3286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:23.618800 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19098c4a-0220-431d-8426-dda3705b3286 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:23.627635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7117318-2f8c-4741-809d-ff8030994b47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:23.628259 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7117318-2f8c-4741-809d-ff8030994b47 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:23.628721 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7117318-2f8c-4741-809d-ff8030994b47 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:23.629004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7117318-2f8c-4741-809d-ff8030994b47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:23.630840 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c7117318-2f8c-4741-809d-ff8030994b47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:23.644047 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7117318-2f8c-4741-809d-ff8030994b47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:23.645918 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7117318-2f8c-4741-809d-ff8030994b47 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:23.657257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1230/2436] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:42:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:42:26.656769 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb290d1-6d8f-4dfb-96b1-a3d73c36b65f None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:26.657256 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb290d1-6d8f-4dfb-96b1-a3d73c36b65f None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:26.657376 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb290d1-6d8f-4dfb-96b1-a3d73c36b65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:26.688713 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-4fb290d1-6d8f-4dfb-96b1-a3d73c36b65f None None] MFA Rules not processed for user `eeb3abe800c744b39356db954d6ef3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:42:26.690141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4fb290d1-6d8f-4dfb-96b1-a3d73c36b65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:26.761396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1207/2437] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:42:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:42:26.766093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7117318-2f8c-4741-809d-ff8030994b47 service nova] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:26.778357 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7117318-2f8c-4741-809d-ff8030994b47 service nova] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:26.783864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f188e-55b4-43f9-a3e9-dd3931dd2845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:26.784614 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f188e-55b4-43f9-a3e9-dd3931dd2845 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:26.784967 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f188e-55b4-43f9-a3e9-dd3931dd2845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:26.785313 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f188e-55b4-43f9-a3e9-dd3931dd2845 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:26.786366 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f188e-55b4-43f9-a3e9-dd3931dd2845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:26.788583 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f188e-55b4-43f9-a3e9-dd3931dd2845 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:26.827983 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ddbc2-f130-4546-8453-2d1c36144e4b None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:26.828296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ddbc2-f130-4546-8453-2d1c36144e4b None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:26.828607 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ddbc2-f130-4546-8453-2d1c36144e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:26.850901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-4d1ddbc2-f130-4546-8453-2d1c36144e4b None None] MFA Rules not processed for user `0c8d0a718e8347b5af397f866056266e`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:42:26.852101 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4d1ddbc2-f130-4546-8453-2d1c36144e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:26.884069 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:26.912551 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1208/2438] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 27 16:42:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:42:26.934667 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ddbc2-f130-4546-8453-2d1c36144e4b None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:26.934837 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1231/2439] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:42:26 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:42:26.937793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4d1ddbc2-f130-4546-8453-2d1c36144e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:26.938417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f188e-55b4-43f9-a3e9-dd3931dd2845 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:27.012199 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f188e-55b4-43f9-a3e9-dd3931dd2845 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:27.018614 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdae3f-6d3b-45eb-81da-41287a3b0335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:27.019433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdae3f-6d3b-45eb-81da-41287a3b0335 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:27.019760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdae3f-6d3b-45eb-81da-41287a3b0335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:27.020046 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdae3f-6d3b-45eb-81da-41287a3b0335 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:27.020728 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdae3f-6d3b-45eb-81da-41287a3b0335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:27.022928 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdae3f-6d3b-45eb-81da-41287a3b0335 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:27.023596 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ddbc2-f130-4546-8453-2d1c36144e4b None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:27.098206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab3445-b918-4439-bcad-87a47978c657 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b85e430004a8b865622354c1d1ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:27.098817 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab3445-b918-4439-bcad-87a47978c657 service swift] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:27.099100 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab3445-b918-4439-bcad-87a47978c657 service swift] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:27.099371 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab3445-b918-4439-bcad-87a47978c657 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:27.113436 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1232/2440] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:42:26 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:42:27.117057 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdae3f-6d3b-45eb-81da-41287a3b0335 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:27.127364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdae3f-6d3b-45eb-81da-41287a3b0335 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:27.132129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82580140-693b-42d1-a503-132b30efbafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:27.132955 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82580140-693b-42d1-a503-132b30efbafd admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:27.133399 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82580140-693b-42d1-a503-132b30efbafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:27.133932 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82580140-693b-42d1-a503-132b30efbafd admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:27.135338 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82580140-693b-42d1-a503-132b30efbafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:27.137004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82580140-693b-42d1-a503-132b30efbafd admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:27.149424 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1233/2441] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:42:27.153438 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82580140-693b-42d1-a503-132b30efbafd admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:27.164011 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82580140-693b-42d1-a503-132b30efbafd admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:27.169345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1172ec5-7bb4-4fa6-a360-91cc166e5723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:27.170339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1172ec5-7bb4-4fa6-a360-91cc166e5723 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:27.171195 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1172ec5-7bb4-4fa6-a360-91cc166e5723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:27.171642 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1172ec5-7bb4-4fa6-a360-91cc166e5723 admin admin] PATH_INFO: `/v3/projects/13a435383de04ea4a8c1dd7ec9a416a7/users/d7d5e7a57b864dd1a483b729dc91fdcf/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:27.173505 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab3445-b918-4439-bcad-87a47978c657 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:27.175282 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab3445-b918-4439-bcad-87a47978c657 service swift] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:27.185060 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1209/2442] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 27 16:42:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 16:42:27.198021 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1172ec5-7bb4-4fa6-a360-91cc166e5723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a435383de04ea4a8c1dd7ec9a416a7, user_id=d7d5e7a57b864dd1a483b729dc91fdcf, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:27.200777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1172ec5-7bb4-4fa6-a360-91cc166e5723 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:27.288043 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:27.293249 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1234/2443] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:42:27 2022] PUT /identity/v3/projects/13a435383de04ea4a8c1dd7ec9a416a7/users/d7d5e7a57b864dd1a483b729dc91fdcf/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:42:27.297325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab3445-b918-4439-bcad-87a47978c657 service swift] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:27.308206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab3445-b918-4439-bcad-87a47978c657 service swift] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:27.338422 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:27.385160 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d67e1-2d16-4d85-b7b0-f0c9dea1d8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:27.386636 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d67e1-2d16-4d85-b7b0-f0c9dea1d8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:27.386969 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d67e1-2d16-4d85-b7b0-f0c9dea1d8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:27.387328 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d67e1-2d16-4d85-b7b0-f0c9dea1d8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:27.388312 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d67e1-2d16-4d85-b7b0-f0c9dea1d8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:27.390376 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d67e1-2d16-4d85-b7b0-f0c9dea1d8f0 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:27.408905 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1210/2444] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:42:27.411268 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1172ec5-7bb4-4fa6-a360-91cc166e5723 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:27.424526 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1172ec5-7bb4-4fa6-a360-91cc166e5723 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:27.429822 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378dfdc-ff37-460a-938f-9154df20eba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:27.431904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378dfdc-ff37-460a-938f-9154df20eba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:27.431904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378dfdc-ff37-460a-938f-9154df20eba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:27.431904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378dfdc-ff37-460a-938f-9154df20eba2 admin admin] PATH_INFO: `/v3/projects/13a435383de04ea4a8c1dd7ec9a416a7/users/d7d5e7a57b864dd1a483b729dc91fdcf/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:27.433535 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378dfdc-ff37-460a-938f-9154df20eba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a435383de04ea4a8c1dd7ec9a416a7, user_id=d7d5e7a57b864dd1a483b729dc91fdcf, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:27.436432 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378dfdc-ff37-460a-938f-9154df20eba2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:27.449005 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1235/2445] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:42:27 2022] PUT /identity/v3/projects/13a435383de04ea4a8c1dd7ec9a416a7/users/d7d5e7a57b864dd1a483b729dc91fdcf/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:42:35.938121 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945350c4-69af-45ee-8829-fb85959e65a4 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:35.938761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945350c4-69af-45ee-8829-fb85959e65a4 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:35.938761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945350c4-69af-45ee-8829-fb85959e65a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:35.992499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-945350c4-69af-45ee-8829-fb85959e65a4 None None] MFA Rules not processed for user `d7d5e7a57b864dd1a483b729dc91fdcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:42:35.993663 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-945350c4-69af-45ee-8829-fb85959e65a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:36.118016 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1211/2446] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:42:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:42:36.131904 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378dfdc-ff37-460a-938f-9154df20eba2 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:36.134692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5378dfdc-ff37-460a-938f-9154df20eba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:36.249416 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378dfdc-ff37-460a-938f-9154df20eba2 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:36.253058 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ef413-f970-4107-819d-136f6146bff8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e15cb1d012934ebeac53af885ca65f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:36.253679 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ef413-f970-4107-819d-136f6146bff8 service glance] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:36.253956 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ef413-f970-4107-819d-136f6146bff8 service glance] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:36.254229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ef413-f970-4107-819d-136f6146bff8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:36.340015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ef413-f970-4107-819d-136f6146bff8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:36.341485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ef413-f970-4107-819d-136f6146bff8 service glance] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:36.364217 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1236/2447] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:42:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:42:36.676375 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba0cd4-a30f-4e06-b4f9-d0ab52e179e4 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:36.676666 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba0cd4-a30f-4e06-b4f9-d0ab52e179e4 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:36.676940 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba0cd4-a30f-4e06-b4f9-d0ab52e179e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:36.697365 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-05ba0cd4-a30f-4e06-b4f9-d0ab52e179e4 None None] MFA Rules not processed for user `0c8d0a718e8347b5af397f866056266e`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:42:36.698654 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-05ba0cd4-a30f-4e06-b4f9-d0ab52e179e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:36.762936 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1212/2448] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 27 16:42:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:42:36.775861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ef413-f970-4107-819d-136f6146bff8 service glance] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:36.852316 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ef413-f970-4107-819d-136f6146bff8 service glance] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:36.857230 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8acea-6be9-4992-94d8-1837e3313778 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b85e430004a8b865622354c1d1ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:36.857829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8acea-6be9-4992-94d8-1837e3313778 service swift] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:36.858107 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8acea-6be9-4992-94d8-1837e3313778 service swift] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:36.858378 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8acea-6be9-4992-94d8-1837e3313778 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:36.866204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8acea-6be9-4992-94d8-1837e3313778 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:36.867771 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8acea-6be9-4992-94d8-1837e3313778 service swift] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:36.876974 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1237/2449] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 27 16:42:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 27 16:42:44.401775 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba0cd4-a30f-4e06-b4f9-d0ab52e179e4 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:44.505006 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:44.544864 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba0cd4-a30f-4e06-b4f9-d0ab52e179e4 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:44.550767 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540e5a7-3ff5-4c4b-a99b-06ab988c9eab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:44.551556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540e5a7-3ff5-4c4b-a99b-06ab988c9eab service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:44.553202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540e5a7-3ff5-4c4b-a99b-06ab988c9eab service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:44.553607 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540e5a7-3ff5-4c4b-a99b-06ab988c9eab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:44.555692 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b540e5a7-3ff5-4c4b-a99b-06ab988c9eab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:44.584601 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540e5a7-3ff5-4c4b-a99b-06ab988c9eab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:44.587588 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540e5a7-3ff5-4c4b-a99b-06ab988c9eab service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:44.604227 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1213/2450] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:42:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:42:44.839792 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb7b2b-879b-4122-b10a-47c0b094bd45 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:44.840303 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb7b2b-879b-4122-b10a-47c0b094bd45 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:44.840449 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb7b2b-879b-4122-b10a-47c0b094bd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:44.868146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-62fb7b2b-879b-4122-b10a-47c0b094bd45 None None] MFA Rules not processed for user `0c8d0a718e8347b5af397f866056266e`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:42:44.870161 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-62fb7b2b-879b-4122-b10a-47c0b094bd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:44.880788 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1238/2451] 10.222.0.26 () {58 vars in 967 bytes} [Tue Sep 27 16:42:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:42:44.905988 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540e5a7-3ff5-4c4b-a99b-06ab988c9eab service nova] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:44.928651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540e5a7-3ff5-4c4b-a99b-06ab988c9eab service nova] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:44.950876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2962f85-ddc7-4f25-a8be-31bdfcfe6851 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b85e430004a8b865622354c1d1ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:44.951540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2962f85-ddc7-4f25-a8be-31bdfcfe6851 service swift] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:44.956191 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2962f85-ddc7-4f25-a8be-31bdfcfe6851 service swift] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:44.956191 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2962f85-ddc7-4f25-a8be-31bdfcfe6851 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:44.965578 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2962f85-ddc7-4f25-a8be-31bdfcfe6851 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:44.970091 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2962f85-ddc7-4f25-a8be-31bdfcfe6851 service swift] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:44.990786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1214/2452] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 27 16:42:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 16:42:48.833735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13e61-44ff-4d20-9fc8-3fd5ee519899 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:48.834316 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13e61-44ff-4d20-9fc8-3fd5ee519899 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:48.834316 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13e61-44ff-4d20-9fc8-3fd5ee519899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:48.854503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-20c13e61-44ff-4d20-9fc8-3fd5ee519899 None None] MFA Rules not processed for user `eeb3abe800c744b39356db954d6ef3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:42:48.855765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-20c13e61-44ff-4d20-9fc8-3fd5ee519899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:48.862908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1239/2453] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:42:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:42:51.533277 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2962f85-ddc7-4f25-a8be-31bdfcfe6851 service swift] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:51.537960 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a2962f85-ddc7-4f25-a8be-31bdfcfe6851 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:51.596728 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2962f85-ddc7-4f25-a8be-31bdfcfe6851 service swift] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:51.600246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe083c-0637-4cf5-ad7b-9ba9984ffec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:51.606771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe083c-0637-4cf5-ad7b-9ba9984ffec8 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:51.606771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe083c-0637-4cf5-ad7b-9ba9984ffec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:51.606771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe083c-0637-4cf5-ad7b-9ba9984ffec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:51.606771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-8dfe083c-0637-4cf5-ad7b-9ba9984ffec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:51.667894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe083c-0637-4cf5-ad7b-9ba9984ffec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:51.669364 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe083c-0637-4cf5-ad7b-9ba9984ffec8 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:51.679441 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1215/2454] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:42:52.952810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6de79-daf9-476d-987a-4d4d976431a8 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:52.953742 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6de79-daf9-476d-987a-4d4d976431a8 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:52.954358 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6de79-daf9-476d-987a-4d4d976431a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:52.982442 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3ff6de79-daf9-476d-987a-4d4d976431a8 None None] MFA Rules not processed for user `0c8d0a718e8347b5af397f866056266e`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:42:52.984855 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3ff6de79-daf9-476d-987a-4d4d976431a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:52.994357 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1240/2455] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 27 16:42:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:42:53.008062 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe083c-0637-4cf5-ad7b-9ba9984ffec8 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:53.020397 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe083c-0637-4cf5-ad7b-9ba9984ffec8 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:53.025360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5907e-4e61-4859-b8ca-bbc1ee733ed1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b85e430004a8b865622354c1d1ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:53.025967 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5907e-4e61-4859-b8ca-bbc1ee733ed1 service swift] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:53.026246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5907e-4e61-4859-b8ca-bbc1ee733ed1 service swift] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:53.026514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5907e-4e61-4859-b8ca-bbc1ee733ed1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:53.035694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5907e-4e61-4859-b8ca-bbc1ee733ed1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:53.037322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5907e-4e61-4859-b8ca-bbc1ee733ed1 service swift] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:53.048904 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1216/2456] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 27 16:42:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 16:42:55.976446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6de79-daf9-476d-987a-4d4d976431a8 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:55.978410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3ff6de79-daf9-476d-987a-4d4d976431a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:56.003893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:56.122812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5907e-4e61-4859-b8ca-bbc1ee733ed1 service swift] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:56.126166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-0bc5907e-4e61-4859-b8ca-bbc1ee733ed1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:56.150830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5907e-4e61-4859-b8ca-bbc1ee733ed1 service swift] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:56.155105 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a314e74-341d-4f7d-8c08-51909e4ce597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:56.155417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6de79-daf9-476d-987a-4d4d976431a8 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:56.156409 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a314e74-341d-4f7d-8c08-51909e4ce597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:56.157031 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a314e74-341d-4f7d-8c08-51909e4ce597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:56.157759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a314e74-341d-4f7d-8c08-51909e4ce597 admin admin] PATH_INFO: `/v3/users/6d32130690454568b620faa8957ce111` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:56.159389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a314e74-341d-4f7d-8c08-51909e4ce597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d32130690454568b620faa8957ce111)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:56.161742 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f967e-8302-4519-bf40-c07a551cee9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5deb7370bc3045c5be2d391d3b1dbd82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:56.162281 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a314e74-341d-4f7d-8c08-51909e4ce597 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:56.162785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f967e-8302-4519-bf40-c07a551cee9e service placement] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:56.163201 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f967e-8302-4519-bf40-c07a551cee9e service placement] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:56.163556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f967e-8302-4519-bf40-c07a551cee9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:56.165828 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-149f967e-8302-4519-bf40-c07a551cee9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:56.187743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f967e-8302-4519-bf40-c07a551cee9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:56.189474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f967e-8302-4519-bf40-c07a551cee9e service placement] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:56.204751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1241/2457] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:42:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:42:56.363048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-1a314e74-341d-4f7d-8c08-51909e4ce597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d32130690454568b620faa8957ce111'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:56.365837 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-1a314e74-341d-4f7d-8c08-51909e4ce597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d32130690454568b620faa8957ce111'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:56.371701 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:56.378225 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-1a314e74-341d-4f7d-8c08-51909e4ce597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d32130690454568b620faa8957ce111'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:56.469139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-1a314e74-341d-4f7d-8c08-51909e4ce597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d32130690454568b620faa8957ce111'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:56.469829 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-1a314e74-341d-4f7d-8c08-51909e4ce597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d32130690454568b620faa8957ce111'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:56.484816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1217/2458] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:42:56 2022] DELETE /identity/v3/users/6d32130690454568b620faa8957ce111 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:42:56.769935 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f967e-8302-4519-bf40-c07a551cee9e service placement] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:56.787634 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f967e-8302-4519-bf40-c07a551cee9e service placement] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:56.865658 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b066f-91e8-4eb5-a5bb-a10f84ab7b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:56.866335 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b066f-91e8-4eb5-a5bb-a10f84ab7b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:56.866632 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b066f-91e8-4eb5-a5bb-a10f84ab7b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:56.866897 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b066f-91e8-4eb5-a5bb-a10f84ab7b48 admin admin] PATH_INFO: `/v3/projects/c57d03b9536e4d969de4427689f62b9f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:56.868025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b066f-91e8-4eb5-a5bb-a10f84ab7b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c57d03b9536e4d969de4427689f62b9f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:56.869986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b066f-91e8-4eb5-a5bb-a10f84ab7b48 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:56.997708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a05b066f-91e8-4eb5-a5bb-a10f84ab7b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c57d03b9536e4d969de4427689f62b9f', 'request_id': 'req-a05b066f-91e8-4eb5-a5bb-a10f84ab7b48'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:57.005056 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a05b066f-91e8-4eb5-a5bb-a10f84ab7b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c57d03b9536e4d969de4427689f62b9f', 'request_id': 'req-a05b066f-91e8-4eb5-a5bb-a10f84ab7b48'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:57.057584 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a05b066f-91e8-4eb5-a5bb-a10f84ab7b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c57d03b9536e4d969de4427689f62b9f', 'request_id': 'req-a05b066f-91e8-4eb5-a5bb-a10f84ab7b48'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:57.070692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a05b066f-91e8-4eb5-a5bb-a10f84ab7b48 admin admin] The token cache is being invalidate because project c57d03b9536e4d969de4427689f62b9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:42:57.071005 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a05b066f-91e8-4eb5-a5bb-a10f84ab7b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:57.071683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a05b066f-91e8-4eb5-a5bb-a10f84ab7b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:42:57.073649 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1242/2459] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:42:56 2022] DELETE /identity/v3/projects/c57d03b9536e4d969de4427689f62b9f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:42:57.078703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5eaa1-afe8-4a5c-b489-475f1aeb4a60 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:57.079020 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5eaa1-afe8-4a5c-b489-475f1aeb4a60 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:57.079319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5eaa1-afe8-4a5c-b489-475f1aeb4a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:57.099750 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-33b5eaa1-afe8-4a5c-b489-475f1aeb4a60 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:42:57.101125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-33b5eaa1-afe8-4a5c-b489-475f1aeb4a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:57.167153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1218/2460] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:42:57.175069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96582e0c-333e-4076-ae92-06d907a49bca None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:57.175363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96582e0c-333e-4076-ae92-06d907a49bca None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:57.175660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96582e0c-333e-4076-ae92-06d907a49bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:57.201384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-96582e0c-333e-4076-ae92-06d907a49bca None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:42:57.202990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-96582e0c-333e-4076-ae92-06d907a49bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:57.215656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1243/2461] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:42:57.219537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5eaa1-afe8-4a5c-b489-475f1aeb4a60 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:57.229464 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5eaa1-afe8-4a5c-b489-475f1aeb4a60 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:57.234560 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbdbd6-dbc6-4ec0-8aad-05a8450be59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:57.235160 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbdbd6-dbc6-4ec0-8aad-05a8450be59e admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:57.235434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbdbd6-dbc6-4ec0-8aad-05a8450be59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:57.235696 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbdbd6-dbc6-4ec0-8aad-05a8450be59e admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:57.236360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbdbd6-dbc6-4ec0-8aad-05a8450be59e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:42:57.236660 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbdbd6-dbc6-4ec0-8aad-05a8450be59e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:57.238246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbdbd6-dbc6-4ec0-8aad-05a8450be59e admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:57.254070 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1219/2462] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:42:57.255248 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96582e0c-333e-4076-ae92-06d907a49bca None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:57.266495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96582e0c-333e-4076-ae92-06d907a49bca None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:57.271316 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0444c8f-a146-44e3-acdb-dddd5550eb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:57.271928 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0444c8f-a146-44e3-acdb-dddd5550eb24 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:57.272210 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0444c8f-a146-44e3-acdb-dddd5550eb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:57.272532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0444c8f-a146-44e3-acdb-dddd5550eb24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:57.273169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0444c8f-a146-44e3-acdb-dddd5550eb24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:57.275293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0444c8f-a146-44e3-acdb-dddd5550eb24 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:57.456060 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1244/2463] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:42:57 2022] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:42:57.457219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbdbd6-dbc6-4ec0-8aad-05a8450be59e admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:57.468381 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbdbd6-dbc6-4ec0-8aad-05a8450be59e admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:57.534392 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dbe25-8d33-4c8b-af09-1b60dc6b0f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:57.534894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dbe25-8d33-4c8b-af09-1b60dc6b0f0b admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:57.535184 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dbe25-8d33-4c8b-af09-1b60dc6b0f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:57.535466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dbe25-8d33-4c8b-af09-1b60dc6b0f0b admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:57.536138 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dbe25-8d33-4c8b-af09-1b60dc6b0f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:57.538172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dbe25-8d33-4c8b-af09-1b60dc6b0f0b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:57.614155 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1220/2464] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:42:57 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:42:57.618811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0444c8f-a146-44e3-acdb-dddd5550eb24 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:57.624477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:57.631247 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0444c8f-a146-44e3-acdb-dddd5550eb24 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:57.636317 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6198d72-e30a-4deb-b9e0-07222a3b5cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:57.637550 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6198d72-e30a-4deb-b9e0-07222a3b5cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:57.637834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6198d72-e30a-4deb-b9e0-07222a3b5cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:57.638121 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6198d72-e30a-4deb-b9e0-07222a3b5cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:57.638756 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6198d72-e30a-4deb-b9e0-07222a3b5cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:57.640395 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6198d72-e30a-4deb-b9e0-07222a3b5cf8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:57.651517 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1245/2465] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:42:57.656632 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dbe25-8d33-4c8b-af09-1b60dc6b0f0b admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:57.667761 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dbe25-8d33-4c8b-af09-1b60dc6b0f0b admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:57.672783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5787dcb-d7f1-4836-a15c-48babaf4f741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:57.673397 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5787dcb-d7f1-4836-a15c-48babaf4f741 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:57.673679 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5787dcb-d7f1-4836-a15c-48babaf4f741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:57.673955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5787dcb-d7f1-4836-a15c-48babaf4f741 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:57.674664 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5787dcb-d7f1-4836-a15c-48babaf4f741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:57.676410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5787dcb-d7f1-4836-a15c-48babaf4f741 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:57.691832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1221/2466] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:42:57.693169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6198d72-e30a-4deb-b9e0-07222a3b5cf8 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:57.705705 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6198d72-e30a-4deb-b9e0-07222a3b5cf8 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:57.710621 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695fcb4-6311-4b0d-9889-5bcb1d6cf5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:57.711273 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695fcb4-6311-4b0d-9889-5bcb1d6cf5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:57.711554 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695fcb4-6311-4b0d-9889-5bcb1d6cf5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:57.711978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695fcb4-6311-4b0d-9889-5bcb1d6cf5d9 admin admin] PATH_INFO: `/v3/projects/b4a23789b1964bb69ac5bb958a289fde/users/838ed80cfc744564bb6a34a8d900f980/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:57.731128 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695fcb4-6311-4b0d-9889-5bcb1d6cf5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4a23789b1964bb69ac5bb958a289fde, user_id=838ed80cfc744564bb6a34a8d900f980, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:57.733838 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695fcb4-6311-4b0d-9889-5bcb1d6cf5d9 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:57.836381 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1246/2467] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:42:57 2022] PUT /identity/v3/projects/b4a23789b1964bb69ac5bb958a289fde/users/838ed80cfc744564bb6a34a8d900f980/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:42:57.858655 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370622a-a31a-4eda-a74d-7ef356b7f38d None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:57.859056 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370622a-a31a-4eda-a74d-7ef356b7f38d None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:57.859424 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370622a-a31a-4eda-a74d-7ef356b7f38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:57.898470 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-9370622a-a31a-4eda-a74d-7ef356b7f38d None None] MFA Rules not processed for user `838ed80cfc744564bb6a34a8d900f980`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:42:57.905844 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-9370622a-a31a-4eda-a74d-7ef356b7f38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:57.937805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:58.005155 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1222/2468] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:42:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:42:58.021635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695fcb4-6311-4b0d-9889-5bcb1d6cf5d9 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:42:58.023812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a695fcb4-6311-4b0d-9889-5bcb1d6cf5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:42:58.102815 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695fcb4-6311-4b0d-9889-5bcb1d6cf5d9 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:42:58.109296 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c9371-e8f1-4895-812c-9fc48540208e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:42:58.109902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c9371-e8f1-4895-812c-9fc48540208e service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:42:58.110184 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c9371-e8f1-4895-812c-9fc48540208e service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:42:58.110462 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c9371-e8f1-4895-812c-9fc48540208e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:42:58.118227 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c9371-e8f1-4895-812c-9fc48540208e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:42:58.119806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c9371-e8f1-4895-812c-9fc48540208e service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:42:58.129249 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1247/2469] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:42:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:01.751870 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370622a-a31a-4eda-a74d-7ef356b7f38d None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:01.753590 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-9370622a-a31a-4eda-a74d-7ef356b7f38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:01.771586 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370622a-a31a-4eda-a74d-7ef356b7f38d None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:01.777354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cba84b-5dc4-4dd7-9c61-3ea737306102 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:01.778046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cba84b-5dc4-4dd7-9c61-3ea737306102 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:01.778325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cba84b-5dc4-4dd7-9c61-3ea737306102 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:01.778600 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cba84b-5dc4-4dd7-9c61-3ea737306102 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:01.780349 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-d0cba84b-5dc4-4dd7-9c61-3ea737306102 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:01.850202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cba84b-5dc4-4dd7-9c61-3ea737306102 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:01.852468 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cba84b-5dc4-4dd7-9c61-3ea737306102 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:01.861616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1223/2470] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:05.938618 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c9371-e8f1-4895-812c-9fc48540208e service nova] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:06.003127 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c9371-e8f1-4895-812c-9fc48540208e service nova] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:06.007948 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9e70e-2dfa-43a0-aad8-794f9fa1b39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:06.008601 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9e70e-2dfa-43a0-aad8-794f9fa1b39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:06.008880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9e70e-2dfa-43a0-aad8-794f9fa1b39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:06.009152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9e70e-2dfa-43a0-aad8-794f9fa1b39e admin admin] PATH_INFO: `/v3/users/838ed80cfc744564bb6a34a8d900f980` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:06.010591 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9e70e-2dfa-43a0-aad8-794f9fa1b39e admin admin] RBAC: Authorizing `identity:delete_user(user_id=838ed80cfc744564bb6a34a8d900f980)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:06.012531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9e70e-2dfa-43a0-aad8-794f9fa1b39e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:06.237080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-33a9e70e-2dfa-43a0-aad8-794f9fa1b39e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '838ed80cfc744564bb6a34a8d900f980'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:06.237765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-33a9e70e-2dfa-43a0-aad8-794f9fa1b39e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '838ed80cfc744564bb6a34a8d900f980'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:06.243143 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:06.250686 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-33a9e70e-2dfa-43a0-aad8-794f9fa1b39e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '838ed80cfc744564bb6a34a8d900f980'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:06.343842 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-33a9e70e-2dfa-43a0-aad8-794f9fa1b39e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '838ed80cfc744564bb6a34a8d900f980'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:06.344524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-33a9e70e-2dfa-43a0-aad8-794f9fa1b39e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '838ed80cfc744564bb6a34a8d900f980'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:06.357394 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1248/2471] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:43:05 2022] DELETE /identity/v3/users/838ed80cfc744564bb6a34a8d900f980 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:06.362009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e613dfc-dcb7-4e71-8033-e83ffe36d434 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:06.362494 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e613dfc-dcb7-4e71-8033-e83ffe36d434 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:06.362602 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e613dfc-dcb7-4e71-8033-e83ffe36d434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:06.390824 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-4e613dfc-dcb7-4e71-8033-e83ffe36d434 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:06.391944 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4e613dfc-dcb7-4e71-8033-e83ffe36d434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:06.450927 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1224/2472] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:06.461738 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9e70e-2dfa-43a0-aad8-794f9fa1b39e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:06.463196 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-33a9e70e-2dfa-43a0-aad8-794f9fa1b39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:06.521294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9e70e-2dfa-43a0-aad8-794f9fa1b39e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:06.524932 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0ce42-a931-4d6a-8659-325591757ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:06.525537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0ce42-a931-4d6a-8659-325591757ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:06.525820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0ce42-a931-4d6a-8659-325591757ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:06.526098 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0ce42-a931-4d6a-8659-325591757ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:06.535623 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0ce42-a931-4d6a-8659-325591757ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:06.540541 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0ce42-a931-4d6a-8659-325591757ee8 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:06.546567 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1249/2473] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:07.099536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e613dfc-dcb7-4e71-8033-e83ffe36d434 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:07.103635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4e613dfc-dcb7-4e71-8033-e83ffe36d434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:07.113835 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e613dfc-dcb7-4e71-8033-e83ffe36d434 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:07.118776 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27db892-c6df-4b77-8c3a-16b70d701dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:07.119618 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27db892-c6df-4b77-8c3a-16b70d701dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:07.119900 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27db892-c6df-4b77-8c3a-16b70d701dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:07.120203 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27db892-c6df-4b77-8c3a-16b70d701dc2 admin admin] PATH_INFO: `/v3/projects/b4a23789b1964bb69ac5bb958a289fde` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:07.121364 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27db892-c6df-4b77-8c3a-16b70d701dc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4a23789b1964bb69ac5bb958a289fde)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:07.123297 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27db892-c6df-4b77-8c3a-16b70d701dc2 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:07.275994 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f27db892-c6df-4b77-8c3a-16b70d701dc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4a23789b1964bb69ac5bb958a289fde', 'request_id': 'req-f27db892-c6df-4b77-8c3a-16b70d701dc2'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:07.283054 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f27db892-c6df-4b77-8c3a-16b70d701dc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4a23789b1964bb69ac5bb958a289fde', 'request_id': 'req-f27db892-c6df-4b77-8c3a-16b70d701dc2'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:07.286861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:07.376748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f27db892-c6df-4b77-8c3a-16b70d701dc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4a23789b1964bb69ac5bb958a289fde', 'request_id': 'req-f27db892-c6df-4b77-8c3a-16b70d701dc2'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:07.387426 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f27db892-c6df-4b77-8c3a-16b70d701dc2 admin admin] The token cache is being invalidate because project b4a23789b1964bb69ac5bb958a289fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:43:07.392968 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f27db892-c6df-4b77-8c3a-16b70d701dc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:07.392968 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f27db892-c6df-4b77-8c3a-16b70d701dc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:07.392968 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1225/2474] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:43:07 2022] DELETE /identity/v3/projects/b4a23789b1964bb69ac5bb958a289fde => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:07.395202 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0325f6-d623-4408-8649-84b6b71a639d None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:07.395645 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0325f6-d623-4408-8649-84b6b71a639d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:07.395748 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0325f6-d623-4408-8649-84b6b71a639d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:07.415340 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-bf0325f6-d623-4408-8649-84b6b71a639d None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:07.416561 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-bf0325f6-d623-4408-8649-84b6b71a639d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:07.476853 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1250/2475] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:07.485377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b31cef-9018-4d38-ab7b-df76ce6552f7 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:07.485673 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b31cef-9018-4d38-ab7b-df76ce6552f7 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:07.485934 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b31cef-9018-4d38-ab7b-df76ce6552f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:07.507093 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-65b31cef-9018-4d38-ab7b-df76ce6552f7 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:07.508355 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-65b31cef-9018-4d38-ab7b-df76ce6552f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:07.518444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1226/2476] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:07.522788 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0325f6-d623-4408-8649-84b6b71a639d None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:07.533219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0325f6-d623-4408-8649-84b6b71a639d None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:07.537806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad670f2-bbe0-4390-a2eb-26e8a7c3d9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:07.538396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad670f2-bbe0-4390-a2eb-26e8a7c3d9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:07.538699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad670f2-bbe0-4390-a2eb-26e8a7c3d9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:07.538971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad670f2-bbe0-4390-a2eb-26e8a7c3d9d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:07.539614 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad670f2-bbe0-4390-a2eb-26e8a7c3d9d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:43:07.539916 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad670f2-bbe0-4390-a2eb-26e8a7c3d9d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:07.541573 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad670f2-bbe0-4390-a2eb-26e8a7c3d9d2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:07.552888 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1251/2477] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:43:07.557174 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b31cef-9018-4d38-ab7b-df76ce6552f7 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:07.566089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b31cef-9018-4d38-ab7b-df76ce6552f7 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:07.570887 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ef042-bb7a-441f-b20f-faa0737d60ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:07.571476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ef042-bb7a-441f-b20f-faa0737d60ea admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:07.571757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ef042-bb7a-441f-b20f-faa0737d60ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:07.572025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ef042-bb7a-441f-b20f-faa0737d60ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:07.572691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ef042-bb7a-441f-b20f-faa0737d60ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:07.574565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ef042-bb7a-441f-b20f-faa0737d60ea admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:07.727780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1227/2478] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:07 2022] POST /identity/v3/projects => generated 365 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:07.742027 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad670f2-bbe0-4390-a2eb-26e8a7c3d9d2 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:07.742027 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad670f2-bbe0-4390-a2eb-26e8a7c3d9d2 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:07.839568 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825b14a-039b-4d38-b995-2f0daa08acf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:07.841011 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825b14a-039b-4d38-b995-2f0daa08acf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:07.841461 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825b14a-039b-4d38-b995-2f0daa08acf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:07.841915 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825b14a-039b-4d38-b995-2f0daa08acf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:07.843277 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825b14a-039b-4d38-b995-2f0daa08acf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:07.846322 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825b14a-039b-4d38-b995-2f0daa08acf9 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:07.857313 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:08.008079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1252/2479] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:07 2022] POST /identity/v3/users => generated 283 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:08.011397 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ef042-bb7a-441f-b20f-faa0737d60ea admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:08.023046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ef042-bb7a-441f-b20f-faa0737d60ea admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:08.027860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f68fd4-065c-4b2c-8476-b021adb43c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:08.028520 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f68fd4-065c-4b2c-8476-b021adb43c12 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:08.028814 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f68fd4-065c-4b2c-8476-b021adb43c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:08.029093 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f68fd4-065c-4b2c-8476-b021adb43c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:08.029743 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f68fd4-065c-4b2c-8476-b021adb43c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:08.031372 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f68fd4-065c-4b2c-8476-b021adb43c12 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:08.043769 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1228/2480] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:08.048626 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825b14a-039b-4d38-b995-2f0daa08acf9 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:08.059731 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825b14a-039b-4d38-b995-2f0daa08acf9 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:08.065944 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccef7f-7cc5-4c5e-b9a2-ac4df53237aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:08.066595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccef7f-7cc5-4c5e-b9a2-ac4df53237aa admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:08.067094 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccef7f-7cc5-4c5e-b9a2-ac4df53237aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:08.067524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccef7f-7cc5-4c5e-b9a2-ac4df53237aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:08.068438 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccef7f-7cc5-4c5e-b9a2-ac4df53237aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:08.070629 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccef7f-7cc5-4c5e-b9a2-ac4df53237aa admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:08.081392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1253/2481] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:08.085605 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f68fd4-065c-4b2c-8476-b021adb43c12 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:08.095627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f68fd4-065c-4b2c-8476-b021adb43c12 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:08.100137 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8fc70-659f-48a1-b96c-a97eaf34caf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:08.100838 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8fc70-659f-48a1-b96c-a97eaf34caf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:08.101107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8fc70-659f-48a1-b96c-a97eaf34caf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:08.101379 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8fc70-659f-48a1-b96c-a97eaf34caf9 admin admin] PATH_INFO: `/v3/projects/df9ab5aa62a94497ac63603c08b5c83f/users/b975b0df39fb47bbb507a0197365d8f4/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:08.116439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8fc70-659f-48a1-b96c-a97eaf34caf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9ab5aa62a94497ac63603c08b5c83f, user_id=b975b0df39fb47bbb507a0197365d8f4, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:08.119083 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8fc70-659f-48a1-b96c-a97eaf34caf9 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:08.245548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1229/2482] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:08 2022] PUT /identity/v3/projects/df9ab5aa62a94497ac63603c08b5c83f/users/b975b0df39fb47bbb507a0197365d8f4/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:08.255886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c27412-ec89-40d5-a914-cd7607bcb297 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:08.256215 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c27412-ec89-40d5-a914-cd7607bcb297 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:08.256536 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c27412-ec89-40d5-a914-cd7607bcb297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:08.285151 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-45c27412-ec89-40d5-a914-cd7607bcb297 None None] MFA Rules not processed for user `b975b0df39fb47bbb507a0197365d8f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:08.286382 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-45c27412-ec89-40d5-a914-cd7607bcb297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:08.351445 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1254/2483] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:08.356208 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8fc70-659f-48a1-b96c-a97eaf34caf9 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:08.417349 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8fc70-659f-48a1-b96c-a97eaf34caf9 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:08.421999 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501df83-16f2-4a18-8f09-24e62705b4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:08.422596 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501df83-16f2-4a18-8f09-24e62705b4ed admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:08.422877 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501df83-16f2-4a18-8f09-24e62705b4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:08.423153 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501df83-16f2-4a18-8f09-24e62705b4ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:08.423777 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501df83-16f2-4a18-8f09-24e62705b4ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:08.425868 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501df83-16f2-4a18-8f09-24e62705b4ed admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:08.635879 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1230/2484] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:08 2022] POST /identity/v3/projects => generated 365 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:08.639771 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c27412-ec89-40d5-a914-cd7607bcb297 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:08.650958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c27412-ec89-40d5-a914-cd7607bcb297 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:08.706697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a261090-f8c8-4d96-a924-142d60c1c961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:08.707334 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a261090-f8c8-4d96-a924-142d60c1c961 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:08.707602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a261090-f8c8-4d96-a924-142d60c1c961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:08.707876 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a261090-f8c8-4d96-a924-142d60c1c961 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:08.708534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a261090-f8c8-4d96-a924-142d60c1c961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:08.710483 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a261090-f8c8-4d96-a924-142d60c1c961 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:08.812873 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1255/2485] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:08 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:08.816745 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501df83-16f2-4a18-8f09-24e62705b4ed admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:08.827444 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501df83-16f2-4a18-8f09-24e62705b4ed admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:08.832104 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8c00d-eb75-4cc5-8c45-034eb7be6f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:08.832726 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8c00d-eb75-4cc5-8c45-034eb7be6f78 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:08.833010 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8c00d-eb75-4cc5-8c45-034eb7be6f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:08.833288 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8c00d-eb75-4cc5-8c45-034eb7be6f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:08.833927 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8c00d-eb75-4cc5-8c45-034eb7be6f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:08.835533 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8c00d-eb75-4cc5-8c45-034eb7be6f78 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:08.846199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1231/2486] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:08.850193 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a261090-f8c8-4d96-a924-142d60c1c961 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:08.860503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a261090-f8c8-4d96-a924-142d60c1c961 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:08.865142 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630a138-3cd6-42ed-af3f-41f2fcde5376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:08.865787 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630a138-3cd6-42ed-af3f-41f2fcde5376 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:08.866064 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630a138-3cd6-42ed-af3f-41f2fcde5376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:08.866340 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630a138-3cd6-42ed-af3f-41f2fcde5376 admin admin] PATH_INFO: `/v3/projects/cba15ab25e3e4cb2bc9608cea03838e8/users/42a372bfd46a4763babbca8b1721c791/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:08.883594 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630a138-3cd6-42ed-af3f-41f2fcde5376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba15ab25e3e4cb2bc9608cea03838e8, user_id=42a372bfd46a4763babbca8b1721c791, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:08.886367 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630a138-3cd6-42ed-af3f-41f2fcde5376 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:09.018379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1256/2487] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:08 2022] PUT /identity/v3/projects/cba15ab25e3e4cb2bc9608cea03838e8/users/42a372bfd46a4763babbca8b1721c791/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:09.022528 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8c00d-eb75-4cc5-8c45-034eb7be6f78 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:09.033306 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8c00d-eb75-4cc5-8c45-034eb7be6f78 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:09.096530 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:09.104895 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7112f43-cf57-4ca9-9118-318c8b0bfaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:09.105751 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7112f43-cf57-4ca9-9118-318c8b0bfaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:09.106100 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7112f43-cf57-4ca9-9118-318c8b0bfaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:09.106462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7112f43-cf57-4ca9-9118-318c8b0bfaf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:09.107189 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7112f43-cf57-4ca9-9118-318c8b0bfaf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:09.109453 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7112f43-cf57-4ca9-9118-318c8b0bfaf8 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:09.122503 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1232/2488] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:09.128012 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630a138-3cd6-42ed-af3f-41f2fcde5376 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:09.138558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630a138-3cd6-42ed-af3f-41f2fcde5376 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:09.143998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0c8d1-3417-405b-9826-a362b89ba2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:09.144698 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0c8d1-3417-405b-9826-a362b89ba2f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:09.145003 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0c8d1-3417-405b-9826-a362b89ba2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:09.145253 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0c8d1-3417-405b-9826-a362b89ba2f4 admin admin] PATH_INFO: `/v3/projects/cba15ab25e3e4cb2bc9608cea03838e8/users/42a372bfd46a4763babbca8b1721c791/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:09.147464 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0c8d1-3417-405b-9826-a362b89ba2f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba15ab25e3e4cb2bc9608cea03838e8, user_id=42a372bfd46a4763babbca8b1721c791, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:09.150275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0c8d1-3417-405b-9826-a362b89ba2f4 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:09.172655 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1257/2489] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:09 2022] PUT /identity/v3/projects/cba15ab25e3e4cb2bc9608cea03838e8/users/42a372bfd46a4763babbca8b1721c791/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:09.173909 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b821e-785e-4869-a5f8-d6ecaf8d928e None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:09.174199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b821e-785e-4869-a5f8-d6ecaf8d928e None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:09.174480 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b821e-785e-4869-a5f8-d6ecaf8d928e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:09.204729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-3a2b821e-785e-4869-a5f8-d6ecaf8d928e None None] MFA Rules not processed for user `42a372bfd46a4763babbca8b1721c791`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:09.205925 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3a2b821e-785e-4869-a5f8-d6ecaf8d928e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:09.274675 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1233/2490] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:43:09.286115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0c8d1-3417-405b-9826-a362b89ba2f4 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:09.287811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-51a0c8d1-3417-405b-9826-a362b89ba2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:09.314832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:09.347807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0c8d1-3417-405b-9826-a362b89ba2f4 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:09.351533 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b3d57-af04-40ed-be04-12c375ea0639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:09.352143 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b3d57-af04-40ed-be04-12c375ea0639 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:09.352467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b3d57-af04-40ed-be04-12c375ea0639 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:09.352744 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b3d57-af04-40ed-be04-12c375ea0639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:09.362146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b3d57-af04-40ed-be04-12c375ea0639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:09.363566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b3d57-af04-40ed-be04-12c375ea0639 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:09.373165 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1258/2491] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:09.735177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b821e-785e-4869-a5f8-d6ecaf8d928e None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:09.737420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3a2b821e-785e-4869-a5f8-d6ecaf8d928e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:09.751347 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b821e-785e-4869-a5f8-d6ecaf8d928e None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:09.755410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6033a4-da26-4340-b801-ebe4b1bc03f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:09.756023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6033a4-da26-4340-b801-ebe4b1bc03f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:09.756308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6033a4-da26-4340-b801-ebe4b1bc03f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:09.756619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6033a4-da26-4340-b801-ebe4b1bc03f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:09.813893 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6033a4-da26-4340-b801-ebe4b1bc03f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:09.815354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6033a4-da26-4340-b801-ebe4b1bc03f0 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:09.824422 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1234/2492] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:13.650306 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b3d57-af04-40ed-be04-12c375ea0639 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:13.711402 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b3d57-af04-40ed-be04-12c375ea0639 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:13.718569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ff795-f25f-4d36-a011-b9caa61f0ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:13.718569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ff795-f25f-4d36-a011-b9caa61f0ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:13.718569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ff795-f25f-4d36-a011-b9caa61f0ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:13.718569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ff795-f25f-4d36-a011-b9caa61f0ab6 admin admin] PATH_INFO: `/v3/users/b975b0df39fb47bbb507a0197365d8f4` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:13.719083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ff795-f25f-4d36-a011-b9caa61f0ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b975b0df39fb47bbb507a0197365d8f4)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:13.720038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ff795-f25f-4d36-a011-b9caa61f0ab6 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:14.065482 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f19ff795-f25f-4d36-a011-b9caa61f0ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b975b0df39fb47bbb507a0197365d8f4'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:14.066152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f19ff795-f25f-4d36-a011-b9caa61f0ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b975b0df39fb47bbb507a0197365d8f4'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:14.078738 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f19ff795-f25f-4d36-a011-b9caa61f0ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b975b0df39fb47bbb507a0197365d8f4'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:14.212568 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f19ff795-f25f-4d36-a011-b9caa61f0ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b975b0df39fb47bbb507a0197365d8f4'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:14.212727 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f19ff795-f25f-4d36-a011-b9caa61f0ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b975b0df39fb47bbb507a0197365d8f4'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:14.226096 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1259/2493] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:43:13 2022] DELETE /identity/v3/users/b975b0df39fb47bbb507a0197365d8f4 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:14.230751 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18cc3a-4f02-434e-b1b8-d830f028b381 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:14.231250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18cc3a-4f02-434e-b1b8-d830f028b381 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:14.231351 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18cc3a-4f02-434e-b1b8-d830f028b381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:14.252074 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-6f18cc3a-4f02-434e-b1b8-d830f028b381 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:14.253392 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6f18cc3a-4f02-434e-b1b8-d830f028b381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:14.320129 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1235/2494] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:14.336245 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ff795-f25f-4d36-a011-b9caa61f0ab6 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:14.337736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f19ff795-f25f-4d36-a011-b9caa61f0ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:14.386457 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:14.397187 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ff795-f25f-4d36-a011-b9caa61f0ab6 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:14.400830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c8520-f125-449c-aaf8-b8b59e8e4e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:14.401432 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c8520-f125-449c-aaf8-b8b59e8e4e73 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:14.401712 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c8520-f125-449c-aaf8-b8b59e8e4e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:14.401985 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c8520-f125-449c-aaf8-b8b59e8e4e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:14.412185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c8520-f125-449c-aaf8-b8b59e8e4e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:14.413661 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c8520-f125-449c-aaf8-b8b59e8e4e73 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:14.424366 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1260/2495] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:43:15.043132 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18cc3a-4f02-434e-b1b8-d830f028b381 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:15.045107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6f18cc3a-4f02-434e-b1b8-d830f028b381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:15.063745 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18cc3a-4f02-434e-b1b8-d830f028b381 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:15.070010 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b14e0-368c-48e2-865b-feef523b002a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:15.070874 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b14e0-368c-48e2-865b-feef523b002a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:15.071222 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b14e0-368c-48e2-865b-feef523b002a admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:15.071568 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b14e0-368c-48e2-865b-feef523b002a admin admin] PATH_INFO: `/v3/projects/df9ab5aa62a94497ac63603c08b5c83f` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:15.073413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b14e0-368c-48e2-865b-feef523b002a admin admin] RBAC: Authorizing `identity:delete_project(project_id=df9ab5aa62a94497ac63603c08b5c83f)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:15.075162 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b14e0-368c-48e2-865b-feef523b002a admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:15.102944 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:15.309368 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-735b14e0-368c-48e2-865b-feef523b002a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df9ab5aa62a94497ac63603c08b5c83f', 'request_id': 'req-735b14e0-368c-48e2-865b-feef523b002a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:15.316465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-735b14e0-368c-48e2-865b-feef523b002a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df9ab5aa62a94497ac63603c08b5c83f', 'request_id': 'req-735b14e0-368c-48e2-865b-feef523b002a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:15.407986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-735b14e0-368c-48e2-865b-feef523b002a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df9ab5aa62a94497ac63603c08b5c83f', 'request_id': 'req-735b14e0-368c-48e2-865b-feef523b002a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:15.421337 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-735b14e0-368c-48e2-865b-feef523b002a admin admin] The token cache is being invalidate because project df9ab5aa62a94497ac63603c08b5c83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:43:15.421700 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-735b14e0-368c-48e2-865b-feef523b002a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:15.422521 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-735b14e0-368c-48e2-865b-feef523b002a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:15.424192 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1236/2496] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:43:15 2022] DELETE /identity/v3/projects/df9ab5aa62a94497ac63603c08b5c83f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:15.428380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c8520-f125-449c-aaf8-b8b59e8e4e73 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:15.440456 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c8520-f125-449c-aaf8-b8b59e8e4e73 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:15.511705 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28682c14-7923-46b1-bcc9-6a3f3f4870f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:15.512369 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28682c14-7923-46b1-bcc9-6a3f3f4870f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:15.512655 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28682c14-7923-46b1-bcc9-6a3f3f4870f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:15.512975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28682c14-7923-46b1-bcc9-6a3f3f4870f4 admin admin] PATH_INFO: `/v3/users/42a372bfd46a4763babbca8b1721c791` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:15.514403 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28682c14-7923-46b1-bcc9-6a3f3f4870f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a372bfd46a4763babbca8b1721c791)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:15.516401 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28682c14-7923-46b1-bcc9-6a3f3f4870f4 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:15.803112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-28682c14-7923-46b1-bcc9-6a3f3f4870f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a372bfd46a4763babbca8b1721c791'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:15.803998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-28682c14-7923-46b1-bcc9-6a3f3f4870f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a372bfd46a4763babbca8b1721c791'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:15.823972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-28682c14-7923-46b1-bcc9-6a3f3f4870f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a372bfd46a4763babbca8b1721c791'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:15.995306 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-28682c14-7923-46b1-bcc9-6a3f3f4870f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a372bfd46a4763babbca8b1721c791'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:15.995944 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-28682c14-7923-46b1-bcc9-6a3f3f4870f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a372bfd46a4763babbca8b1721c791'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:16.013599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1261/2497] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:43:15 2022] DELETE /identity/v3/users/42a372bfd46a4763babbca8b1721c791 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:16.557083 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b14e0-368c-48e2-865b-feef523b002a admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:16.558646 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-735b14e0-368c-48e2-865b-feef523b002a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:16.577085 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b14e0-368c-48e2-865b-feef523b002a admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:16.643601 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6b66d-31cf-487e-be14-318f7c4e2a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:16.644235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6b66d-31cf-487e-be14-318f7c4e2a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:16.644542 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6b66d-31cf-487e-be14-318f7c4e2a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:16.644839 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6b66d-31cf-487e-be14-318f7c4e2a1e admin admin] PATH_INFO: `/v3/projects/cba15ab25e3e4cb2bc9608cea03838e8` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:16.645954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6b66d-31cf-487e-be14-318f7c4e2a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cba15ab25e3e4cb2bc9608cea03838e8)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:16.647876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6b66d-31cf-487e-be14-318f7c4e2a1e admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:16.788749 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-87b6b66d-31cf-487e-be14-318f7c4e2a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cba15ab25e3e4cb2bc9608cea03838e8', 'request_id': 'req-87b6b66d-31cf-487e-be14-318f7c4e2a1e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:16.795164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-87b6b66d-31cf-487e-be14-318f7c4e2a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cba15ab25e3e4cb2bc9608cea03838e8', 'request_id': 'req-87b6b66d-31cf-487e-be14-318f7c4e2a1e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:16.898525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-87b6b66d-31cf-487e-be14-318f7c4e2a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cba15ab25e3e4cb2bc9608cea03838e8', 'request_id': 'req-87b6b66d-31cf-487e-be14-318f7c4e2a1e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:16.909717 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-87b6b66d-31cf-487e-be14-318f7c4e2a1e admin admin] The token cache is being invalidate because project cba15ab25e3e4cb2bc9608cea03838e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:43:16.910041 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-87b6b66d-31cf-487e-be14-318f7c4e2a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:16.910628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-87b6b66d-31cf-487e-be14-318f7c4e2a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:16.912250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1237/2498] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:43:16 2022] DELETE /identity/v3/projects/cba15ab25e3e4cb2bc9608cea03838e8 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:16.917261 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69607f-d68f-4e66-a1f2-725268e7d93f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:16.917932 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69607f-d68f-4e66-a1f2-725268e7d93f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:16.917932 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69607f-d68f-4e66-a1f2-725268e7d93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:16.937087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-8b69607f-d68f-4e66-a1f2-725268e7d93f None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:16.938284 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8b69607f-d68f-4e66-a1f2-725268e7d93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:17.004509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1262/2499] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:17.012262 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3054bc-1fbb-48eb-8f9a-ae9491631b12 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:17.012581 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3054bc-1fbb-48eb-8f9a-ae9491631b12 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:17.012861 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3054bc-1fbb-48eb-8f9a-ae9491631b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:17.035623 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-2b3054bc-1fbb-48eb-8f9a-ae9491631b12 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:17.037045 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-2b3054bc-1fbb-48eb-8f9a-ae9491631b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:17.048682 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1238/2500] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:43:17.053134 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69607f-d68f-4e66-a1f2-725268e7d93f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:17.062993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69607f-d68f-4e66-a1f2-725268e7d93f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:17.068553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf421342-7877-42d4-ac4a-fc1472e770bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:17.070028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf421342-7877-42d4-ac4a-fc1472e770bc admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:17.070312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf421342-7877-42d4-ac4a-fc1472e770bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:17.070585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf421342-7877-42d4-ac4a-fc1472e770bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:17.071237 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf421342-7877-42d4-ac4a-fc1472e770bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:43:17.071597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf421342-7877-42d4-ac4a-fc1472e770bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:17.073256 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf421342-7877-42d4-ac4a-fc1472e770bc admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:17.074957 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:17.089189 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1263/2501] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:43:17.090586 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3054bc-1fbb-48eb-8f9a-ae9491631b12 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:17.100281 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3054bc-1fbb-48eb-8f9a-ae9491631b12 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:17.107791 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775d888-a3bb-418d-900a-85f03a83d730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:17.108430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775d888-a3bb-418d-900a-85f03a83d730 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:17.108716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775d888-a3bb-418d-900a-85f03a83d730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:17.108986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775d888-a3bb-418d-900a-85f03a83d730 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:17.109624 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775d888-a3bb-418d-900a-85f03a83d730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:17.112065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775d888-a3bb-418d-900a-85f03a83d730 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:17.236182 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1239/2502] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:17 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:17.240422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf421342-7877-42d4-ac4a-fc1472e770bc admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:17.250576 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf421342-7877-42d4-ac4a-fc1472e770bc admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:17.307463 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5021a5-dcc0-45c3-8b84-faa14c8e0851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:17.308268 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5021a5-dcc0-45c3-8b84-faa14c8e0851 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:17.308422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5021a5-dcc0-45c3-8b84-faa14c8e0851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:17.308673 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5021a5-dcc0-45c3-8b84-faa14c8e0851 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:17.309317 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5021a5-dcc0-45c3-8b84-faa14c8e0851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:17.320701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5021a5-dcc0-45c3-8b84-faa14c8e0851 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:17.444423 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1264/2503] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:17 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:43:17.445955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775d888-a3bb-418d-900a-85f03a83d730 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:17.452098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:17.462587 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775d888-a3bb-418d-900a-85f03a83d730 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:17.467747 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c24e9-18f7-40c1-a28f-c921bcc7f3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:17.468302 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c24e9-18f7-40c1-a28f-c921bcc7f3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:17.468779 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c24e9-18f7-40c1-a28f-c921bcc7f3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:17.469076 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c24e9-18f7-40c1-a28f-c921bcc7f3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:17.469723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c24e9-18f7-40c1-a28f-c921bcc7f3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:17.471824 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c24e9-18f7-40c1-a28f-c921bcc7f3e2 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:17.485111 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1240/2504] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:17.490535 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5021a5-dcc0-45c3-8b84-faa14c8e0851 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:17.497362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5021a5-dcc0-45c3-8b84-faa14c8e0851 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:17.502076 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa456c70-a82e-4d1b-9641-8a0ab084a5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:17.502679 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa456c70-a82e-4d1b-9641-8a0ab084a5ef admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:17.502961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa456c70-a82e-4d1b-9641-8a0ab084a5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:17.503234 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa456c70-a82e-4d1b-9641-8a0ab084a5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:17.503871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa456c70-a82e-4d1b-9641-8a0ab084a5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:17.505622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa456c70-a82e-4d1b-9641-8a0ab084a5ef admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:17.516794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1265/2505] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:17.521135 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c24e9-18f7-40c1-a28f-c921bcc7f3e2 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:17.531161 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c24e9-18f7-40c1-a28f-c921bcc7f3e2 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:17.536314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe62d6c-adfa-431f-8b03-2cb8c3f7a041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:17.537000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe62d6c-adfa-431f-8b03-2cb8c3f7a041 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:17.537276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe62d6c-adfa-431f-8b03-2cb8c3f7a041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:17.537550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe62d6c-adfa-431f-8b03-2cb8c3f7a041 admin admin] PATH_INFO: `/v3/projects/87da016901c54a5f8436e04474260116/users/0571d6a9a63241df9543a66568338f24/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:17.552868 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe62d6c-adfa-431f-8b03-2cb8c3f7a041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87da016901c54a5f8436e04474260116, user_id=0571d6a9a63241df9543a66568338f24, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:17.555652 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe62d6c-adfa-431f-8b03-2cb8c3f7a041 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:17.624171 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1241/2506] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:17 2022] PUT /identity/v3/projects/87da016901c54a5f8436e04474260116/users/0571d6a9a63241df9543a66568338f24/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:17.636385 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b709b4-6059-45b5-a929-7b9d422260ad None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:17.636697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b709b4-6059-45b5-a929-7b9d422260ad None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:17.636972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b709b4-6059-45b5-a929-7b9d422260ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:17.666803 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-09b709b4-6059-45b5-a929-7b9d422260ad None None] MFA Rules not processed for user `0571d6a9a63241df9543a66568338f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:17.668022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-09b709b4-6059-45b5-a929-7b9d422260ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:17.731157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1266/2507] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:17.736563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe62d6c-adfa-431f-8b03-2cb8c3f7a041 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:17.805789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe62d6c-adfa-431f-8b03-2cb8c3f7a041 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:17.810670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be455d-618d-479b-8946-97cb59685134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:17.811311 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be455d-618d-479b-8946-97cb59685134 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:17.811571 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be455d-618d-479b-8946-97cb59685134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:17.811843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be455d-618d-479b-8946-97cb59685134 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:17.812511 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be455d-618d-479b-8946-97cb59685134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:17.814445 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be455d-618d-479b-8946-97cb59685134 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:17.932447 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1242/2508] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:17 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:17.936543 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b709b4-6059-45b5-a929-7b9d422260ad None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:17.947296 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b709b4-6059-45b5-a929-7b9d422260ad None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:18.003093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9ebaf-37ce-4cce-9e10-7a4b771cf005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:18.003695 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9ebaf-37ce-4cce-9e10-7a4b771cf005 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:18.004025 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9ebaf-37ce-4cce-9e10-7a4b771cf005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:18.004309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9ebaf-37ce-4cce-9e10-7a4b771cf005 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:18.004972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9ebaf-37ce-4cce-9e10-7a4b771cf005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:18.006905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9ebaf-37ce-4cce-9e10-7a4b771cf005 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:18.016456 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:18.150766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1267/2509] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:17 2022] POST /identity/v3/users => generated 299 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:18.154391 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be455d-618d-479b-8946-97cb59685134 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:18.166733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be455d-618d-479b-8946-97cb59685134 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:18.171367 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443a817-8981-4a15-9c7b-8e1815f59ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:18.172102 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443a817-8981-4a15-9c7b-8e1815f59ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:18.172470 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443a817-8981-4a15-9c7b-8e1815f59ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:18.172830 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443a817-8981-4a15-9c7b-8e1815f59ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:18.173537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443a817-8981-4a15-9c7b-8e1815f59ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:18.175143 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443a817-8981-4a15-9c7b-8e1815f59ac2 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:18.189605 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1243/2510] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:18.191103 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9ebaf-37ce-4cce-9e10-7a4b771cf005 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:18.201524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9ebaf-37ce-4cce-9e10-7a4b771cf005 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:18.206756 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca81a3-897f-4eb3-af1b-a4dfc6898240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:18.207414 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca81a3-897f-4eb3-af1b-a4dfc6898240 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:18.207699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca81a3-897f-4eb3-af1b-a4dfc6898240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:18.207972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca81a3-897f-4eb3-af1b-a4dfc6898240 admin admin] PATH_INFO: `/v3/projects/2373fb5ad0fc4810bca2fbbebace0bed/users/dbdec8fe92a843478cb70a85fa7dec7e/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:18.222503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca81a3-897f-4eb3-af1b-a4dfc6898240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2373fb5ad0fc4810bca2fbbebace0bed, user_id=dbdec8fe92a843478cb70a85fa7dec7e, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:18.225170 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca81a3-897f-4eb3-af1b-a4dfc6898240 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:18.297154 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1268/2511] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:18 2022] PUT /identity/v3/projects/2373fb5ad0fc4810bca2fbbebace0bed/users/dbdec8fe92a843478cb70a85fa7dec7e/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:18.301051 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443a817-8981-4a15-9c7b-8e1815f59ac2 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:18.310995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443a817-8981-4a15-9c7b-8e1815f59ac2 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:18.368081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6d1b2-e09c-40d8-bac4-5d15782a75df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:18.368731 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6d1b2-e09c-40d8-bac4-5d15782a75df admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:18.369013 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6d1b2-e09c-40d8-bac4-5d15782a75df admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:18.369341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6d1b2-e09c-40d8-bac4-5d15782a75df admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:18.369998 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6d1b2-e09c-40d8-bac4-5d15782a75df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:18.371602 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6d1b2-e09c-40d8-bac4-5d15782a75df admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:18.382581 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1244/2512] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:18.386801 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca81a3-897f-4eb3-af1b-a4dfc6898240 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:18.397898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca81a3-897f-4eb3-af1b-a4dfc6898240 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:18.403021 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc98178-db14-4601-87e6-28f8d7a4e080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:18.403703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc98178-db14-4601-87e6-28f8d7a4e080 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:18.403980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc98178-db14-4601-87e6-28f8d7a4e080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:18.404274 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc98178-db14-4601-87e6-28f8d7a4e080 admin admin] PATH_INFO: `/v3/projects/2373fb5ad0fc4810bca2fbbebace0bed/users/dbdec8fe92a843478cb70a85fa7dec7e/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:18.406432 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc98178-db14-4601-87e6-28f8d7a4e080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2373fb5ad0fc4810bca2fbbebace0bed, user_id=dbdec8fe92a843478cb70a85fa7dec7e, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:18.409194 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc98178-db14-4601-87e6-28f8d7a4e080 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:18.419753 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1269/2513] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:18 2022] PUT /identity/v3/projects/2373fb5ad0fc4810bca2fbbebace0bed/users/dbdec8fe92a843478cb70a85fa7dec7e/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:18.432413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3938d-b70c-4eec-b35d-f6d4ae0e8cf8 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:18.432710 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3938d-b70c-4eec-b35d-f6d4ae0e8cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:18.433005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3938d-b70c-4eec-b35d-f6d4ae0e8cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:18.461727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-70c3938d-b70c-4eec-b35d-f6d4ae0e8cf8 None None] MFA Rules not processed for user `dbdec8fe92a843478cb70a85fa7dec7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:18.462957 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-70c3938d-b70c-4eec-b35d-f6d4ae0e8cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:18.489733 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:18.530846 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1245/2514] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:18.542308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc98178-db14-4601-87e6-28f8d7a4e080 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:18.543987 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-bcc98178-db14-4601-87e6-28f8d7a4e080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:18.603736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc98178-db14-4601-87e6-28f8d7a4e080 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:18.607408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567433d-302a-4ee2-a88d-22416da4ecb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:18.608033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567433d-302a-4ee2-a88d-22416da4ecb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:18.608314 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567433d-302a-4ee2-a88d-22416da4ecb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:18.608619 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567433d-302a-4ee2-a88d-22416da4ecb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:18.621232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567433d-302a-4ee2-a88d-22416da4ecb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:18.621232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567433d-302a-4ee2-a88d-22416da4ecb4 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:18.629901 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1270/2515] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:18.696820 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3938d-b70c-4eec-b35d-f6d4ae0e8cf8 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:18.764552 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3938d-b70c-4eec-b35d-f6d4ae0e8cf8 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:18.769403 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cda2b4-2de3-4bce-a5ed-84674d148800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:18.770089 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cda2b4-2de3-4bce-a5ed-84674d148800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:18.770373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cda2b4-2de3-4bce-a5ed-84674d148800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:18.770682 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cda2b4-2de3-4bce-a5ed-84674d148800 admin admin] PATH_INFO: `/v3/users/0571d6a9a63241df9543a66568338f24` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:18.771818 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cda2b4-2de3-4bce-a5ed-84674d148800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0571d6a9a63241df9543a66568338f24)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:18.773800 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cda2b4-2de3-4bce-a5ed-84674d148800 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:19.085978 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-89cda2b4-2de3-4bce-a5ed-84674d148800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0571d6a9a63241df9543a66568338f24'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:19.086903 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-89cda2b4-2de3-4bce-a5ed-84674d148800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0571d6a9a63241df9543a66568338f24'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:19.101741 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-89cda2b4-2de3-4bce-a5ed-84674d148800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0571d6a9a63241df9543a66568338f24'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:19.195271 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-89cda2b4-2de3-4bce-a5ed-84674d148800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0571d6a9a63241df9543a66568338f24'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:19.196603 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-89cda2b4-2de3-4bce-a5ed-84674d148800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0571d6a9a63241df9543a66568338f24'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:19.212166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1246/2516] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:43:18 2022] DELETE /identity/v3/users/0571d6a9a63241df9543a66568338f24 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:19.217245 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49b2d1-2519-4d6a-a63d-ff128ae674a0 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:19.217689 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49b2d1-2519-4d6a-a63d-ff128ae674a0 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:19.218005 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49b2d1-2519-4d6a-a63d-ff128ae674a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:19.247870 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ce49b2d1-2519-4d6a-a63d-ff128ae674a0 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:19.249742 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ce49b2d1-2519-4d6a-a63d-ff128ae674a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:19.330422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1271/2517] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:19.341586 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cda2b4-2de3-4bce-a5ed-84674d148800 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:19.343477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-89cda2b4-2de3-4bce-a5ed-84674d148800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:19.393101 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:19.406078 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cda2b4-2de3-4bce-a5ed-84674d148800 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:19.410629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bdd51-9eef-4694-a432-7ece681c349a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:19.412453 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bdd51-9eef-4694-a432-7ece681c349a service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:19.412453 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bdd51-9eef-4694-a432-7ece681c349a service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:19.412453 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bdd51-9eef-4694-a432-7ece681c349a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:19.422250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bdd51-9eef-4694-a432-7ece681c349a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:19.424026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bdd51-9eef-4694-a432-7ece681c349a service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:19.435295 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1247/2518] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:19.448982 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49b2d1-2519-4d6a-a63d-ff128ae674a0 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:19.450768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ce49b2d1-2519-4d6a-a63d-ff128ae674a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:19.463989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49b2d1-2519-4d6a-a63d-ff128ae674a0 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:19.468053 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c2e9f-b661-4b9e-a73c-c0d9222ff308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:19.468700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c2e9f-b661-4b9e-a73c-c0d9222ff308 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:19.468984 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c2e9f-b661-4b9e-a73c-c0d9222ff308 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:19.469260 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c2e9f-b661-4b9e-a73c-c0d9222ff308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:19.471657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-168c2e9f-b661-4b9e-a73c-c0d9222ff308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:19.526052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:19.538191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c2e9f-b661-4b9e-a73c-c0d9222ff308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:19.539705 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c2e9f-b661-4b9e-a73c-c0d9222ff308 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:19.549838 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1272/2519] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:19.887744 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bdd51-9eef-4694-a432-7ece681c349a service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:19.889331 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ad0bdd51-9eef-4694-a432-7ece681c349a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:19.904228 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bdd51-9eef-4694-a432-7ece681c349a service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:19.910875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc721c-d8ae-4da1-b7dd-47b6f1776ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:19.911768 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc721c-d8ae-4da1-b7dd-47b6f1776ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:19.912099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc721c-d8ae-4da1-b7dd-47b6f1776ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:19.914255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc721c-d8ae-4da1-b7dd-47b6f1776ace admin admin] PATH_INFO: `/v3/projects/87da016901c54a5f8436e04474260116` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:19.914255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc721c-d8ae-4da1-b7dd-47b6f1776ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=87da016901c54a5f8436e04474260116)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:19.916598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc721c-d8ae-4da1-b7dd-47b6f1776ace admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:20.020053 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-38cc721c-d8ae-4da1-b7dd-47b6f1776ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87da016901c54a5f8436e04474260116', 'request_id': 'req-38cc721c-d8ae-4da1-b7dd-47b6f1776ace'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:20.026788 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-38cc721c-d8ae-4da1-b7dd-47b6f1776ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87da016901c54a5f8436e04474260116', 'request_id': 'req-38cc721c-d8ae-4da1-b7dd-47b6f1776ace'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:20.142896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-38cc721c-d8ae-4da1-b7dd-47b6f1776ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87da016901c54a5f8436e04474260116', 'request_id': 'req-38cc721c-d8ae-4da1-b7dd-47b6f1776ace'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:20.154476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-38cc721c-d8ae-4da1-b7dd-47b6f1776ace admin admin] The token cache is being invalidate because project 87da016901c54a5f8436e04474260116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:43:20.154764 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-38cc721c-d8ae-4da1-b7dd-47b6f1776ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:20.155382 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-38cc721c-d8ae-4da1-b7dd-47b6f1776ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:20.156887 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1248/2520] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:43:19 2022] DELETE /identity/v3/projects/87da016901c54a5f8436e04474260116 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:20.161479 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c2e9f-b661-4b9e-a73c-c0d9222ff308 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:20.173552 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c2e9f-b661-4b9e-a73c-c0d9222ff308 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:20.229718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b086a5-d3c6-4e77-b669-08e80b710517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:20.230414 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b086a5-d3c6-4e77-b669-08e80b710517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:20.230720 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b086a5-d3c6-4e77-b669-08e80b710517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:20.230982 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b086a5-d3c6-4e77-b669-08e80b710517 admin admin] PATH_INFO: `/v3/users/dbdec8fe92a843478cb70a85fa7dec7e` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:20.232842 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b086a5-d3c6-4e77-b669-08e80b710517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbdec8fe92a843478cb70a85fa7dec7e)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:20.234781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b086a5-d3c6-4e77-b669-08e80b710517 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:20.546723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e8b086a5-d3c6-4e77-b669-08e80b710517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbdec8fe92a843478cb70a85fa7dec7e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:20.547364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e8b086a5-d3c6-4e77-b669-08e80b710517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbdec8fe92a843478cb70a85fa7dec7e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:20.560659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e8b086a5-d3c6-4e77-b669-08e80b710517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbdec8fe92a843478cb70a85fa7dec7e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:20.642768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e8b086a5-d3c6-4e77-b669-08e80b710517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbdec8fe92a843478cb70a85fa7dec7e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:20.643289 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e8b086a5-d3c6-4e77-b669-08e80b710517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbdec8fe92a843478cb70a85fa7dec7e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:20.659132 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1273/2521] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:43:20 2022] DELETE /identity/v3/users/dbdec8fe92a843478cb70a85fa7dec7e => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:21.207930 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc721c-d8ae-4da1-b7dd-47b6f1776ace admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:21.214101 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-38cc721c-d8ae-4da1-b7dd-47b6f1776ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:21.223063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc721c-d8ae-4da1-b7dd-47b6f1776ace admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:21.285935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249c94d-281b-4b7f-9249-9eae650e62cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:21.286633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249c94d-281b-4b7f-9249-9eae650e62cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:21.286911 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249c94d-281b-4b7f-9249-9eae650e62cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:21.287309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249c94d-281b-4b7f-9249-9eae650e62cc admin admin] PATH_INFO: `/v3/projects/2373fb5ad0fc4810bca2fbbebace0bed` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:21.288563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249c94d-281b-4b7f-9249-9eae650e62cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2373fb5ad0fc4810bca2fbbebace0bed)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:21.290573 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249c94d-281b-4b7f-9249-9eae650e62cc admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:21.455556 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f249c94d-281b-4b7f-9249-9eae650e62cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2373fb5ad0fc4810bca2fbbebace0bed', 'request_id': 'req-f249c94d-281b-4b7f-9249-9eae650e62cc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:21.462174 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f249c94d-281b-4b7f-9249-9eae650e62cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2373fb5ad0fc4810bca2fbbebace0bed', 'request_id': 'req-f249c94d-281b-4b7f-9249-9eae650e62cc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:21.600558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f249c94d-281b-4b7f-9249-9eae650e62cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2373fb5ad0fc4810bca2fbbebace0bed', 'request_id': 'req-f249c94d-281b-4b7f-9249-9eae650e62cc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:21.608794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:21.615072 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f249c94d-281b-4b7f-9249-9eae650e62cc admin admin] The token cache is being invalidate because project 2373fb5ad0fc4810bca2fbbebace0bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:43:21.615422 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f249c94d-281b-4b7f-9249-9eae650e62cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:21.616351 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-f249c94d-281b-4b7f-9249-9eae650e62cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:21.617904 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1249/2522] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:43:21 2022] DELETE /identity/v3/projects/2373fb5ad0fc4810bca2fbbebace0bed => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:21.622869 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf78ca-570c-439d-9ba1-b38212ba872b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:21.623338 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf78ca-570c-439d-9ba1-b38212ba872b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:21.623582 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf78ca-570c-439d-9ba1-b38212ba872b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:21.643715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a4bf78ca-570c-439d-9ba1-b38212ba872b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:21.644958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a4bf78ca-570c-439d-9ba1-b38212ba872b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:21.706641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1274/2523] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:43:21.714271 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b60b6-dafb-4884-9c05-2de6ff4227c4 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:21.714553 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b60b6-dafb-4884-9c05-2de6ff4227c4 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:21.714829 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b60b6-dafb-4884-9c05-2de6ff4227c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:21.735459 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-a62b60b6-dafb-4884-9c05-2de6ff4227c4 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:21.737254 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a62b60b6-dafb-4884-9c05-2de6ff4227c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:21.746442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1250/2524] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:21.752260 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf78ca-570c-439d-9ba1-b38212ba872b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:21.762543 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf78ca-570c-439d-9ba1-b38212ba872b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:21.767440 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859396d-0fdf-4b32-b699-81774f560906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:21.768070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859396d-0fdf-4b32-b699-81774f560906 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:21.768396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859396d-0fdf-4b32-b699-81774f560906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:21.768703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859396d-0fdf-4b32-b699-81774f560906 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:21.769381 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859396d-0fdf-4b32-b699-81774f560906 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:43:21.769691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859396d-0fdf-4b32-b699-81774f560906 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:21.771381 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859396d-0fdf-4b32-b699-81774f560906 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:21.778913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:21.784237 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1275/2525] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:43:21.788764 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b60b6-dafb-4884-9c05-2de6ff4227c4 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:21.805135 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b60b6-dafb-4884-9c05-2de6ff4227c4 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:21.810240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d908e-7445-4862-8865-9f76d6c093da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:21.810855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d908e-7445-4862-8865-9f76d6c093da admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:21.811134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d908e-7445-4862-8865-9f76d6c093da admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:21.811566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d908e-7445-4862-8865-9f76d6c093da admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:21.812263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d908e-7445-4862-8865-9f76d6c093da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:21.815270 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d908e-7445-4862-8865-9f76d6c093da admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:21.985314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1251/2526] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:21 2022] POST /identity/v3/projects => generated 381 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:43:21.990034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859396d-0fdf-4b32-b699-81774f560906 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:22.000579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859396d-0fdf-4b32-b699-81774f560906 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:22.065587 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79ff74-4d90-4374-acb8-f1cc0148fc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:22.066372 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79ff74-4d90-4374-acb8-f1cc0148fc40 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:22.066755 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79ff74-4d90-4374-acb8-f1cc0148fc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:22.067131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79ff74-4d90-4374-acb8-f1cc0148fc40 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:22.067879 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79ff74-4d90-4374-acb8-f1cc0148fc40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:22.070234 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79ff74-4d90-4374-acb8-f1cc0148fc40 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:22.154953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d908e-7445-4862-8865-9f76d6c093da admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:22.164073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1276/2527] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:21 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:22.170562 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d908e-7445-4862-8865-9f76d6c093da admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:22.179065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ac620-5ccc-4df4-8f83-1f19107a82f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:22.182841 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ac620-5ccc-4df4-8f83-1f19107a82f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:22.182841 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ac620-5ccc-4df4-8f83-1f19107a82f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:22.182841 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ac620-5ccc-4df4-8f83-1f19107a82f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:22.182841 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ac620-5ccc-4df4-8f83-1f19107a82f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:22.182841 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ac620-5ccc-4df4-8f83-1f19107a82f4 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:22.198027 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1252/2528] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:43:22.199178 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79ff74-4d90-4374-acb8-f1cc0148fc40 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:22.219393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79ff74-4d90-4374-acb8-f1cc0148fc40 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:22.230525 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c544b41-ddae-4bb0-8a12-d8f83aa26049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:22.231148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c544b41-ddae-4bb0-8a12-d8f83aa26049 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:22.231423 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c544b41-ddae-4bb0-8a12-d8f83aa26049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:22.231697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c544b41-ddae-4bb0-8a12-d8f83aa26049 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:22.232379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c544b41-ddae-4bb0-8a12-d8f83aa26049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:22.233971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c544b41-ddae-4bb0-8a12-d8f83aa26049 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:22.254520 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ac620-5ccc-4df4-8f83-1f19107a82f4 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:22.256423 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1277/2529] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:22.270090 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ac620-5ccc-4df4-8f83-1f19107a82f4 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:22.276382 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121fa8f-6fb4-409c-bc4d-b0619ad28e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:22.277107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121fa8f-6fb4-409c-bc4d-b0619ad28e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:22.277563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121fa8f-6fb4-409c-bc4d-b0619ad28e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:22.278071 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121fa8f-6fb4-409c-bc4d-b0619ad28e90 admin admin] PATH_INFO: `/v3/projects/aaf7c3a782b8414d9fe96bd14dc4d7c0/users/f537d623115d41b9be88d4618799f1b6/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:22.299810 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121fa8f-6fb4-409c-bc4d-b0619ad28e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf7c3a782b8414d9fe96bd14dc4d7c0, user_id=f537d623115d41b9be88d4618799f1b6, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:22.303186 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121fa8f-6fb4-409c-bc4d-b0619ad28e90 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:22.320708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c544b41-ddae-4bb0-8a12-d8f83aa26049 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:22.322931 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2c544b41-ddae-4bb0-8a12-d8f83aa26049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:22.390926 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1253/2530] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:22 2022] PUT /identity/v3/projects/aaf7c3a782b8414d9fe96bd14dc4d7c0/users/f537d623115d41b9be88d4618799f1b6/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:22.395576 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c544b41-ddae-4bb0-8a12-d8f83aa26049 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:22.402912 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d02347-8aba-4ddf-80b2-8acb6feaa53d None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:22.403205 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d02347-8aba-4ddf-80b2-8acb6feaa53d None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:22.409124 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d02347-8aba-4ddf-80b2-8acb6feaa53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:22.463806 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-31d02347-8aba-4ddf-80b2-8acb6feaa53d None None] MFA Rules not processed for user `f537d623115d41b9be88d4618799f1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:22.472843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-31d02347-8aba-4ddf-80b2-8acb6feaa53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:22.522584 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b909d44-8d84-44b6-9efe-d48aaed9d9a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:22.523787 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b909d44-8d84-44b6-9efe-d48aaed9d9a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:22.524172 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b909d44-8d84-44b6-9efe-d48aaed9d9a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:22.524582 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b909d44-8d84-44b6-9efe-d48aaed9d9a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:22.527505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3b909d44-8d84-44b6-9efe-d48aaed9d9a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:22.592620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1254/2531] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:43:22.596148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d02347-8aba-4ddf-80b2-8acb6feaa53d None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:22.616974 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b909d44-8d84-44b6-9efe-d48aaed9d9a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:22.618924 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:22.626971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b909d44-8d84-44b6-9efe-d48aaed9d9a4 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:22.636225 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1278/2532] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:43:22.681182 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d02347-8aba-4ddf-80b2-8acb6feaa53d None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:22.686185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037182cc-5388-4fa4-9c4a-ec7100635920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:22.686892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037182cc-5388-4fa4-9c4a-ec7100635920 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:22.687240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037182cc-5388-4fa4-9c4a-ec7100635920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:22.687581 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037182cc-5388-4fa4-9c4a-ec7100635920 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:22.688288 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037182cc-5388-4fa4-9c4a-ec7100635920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:22.690403 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037182cc-5388-4fa4-9c4a-ec7100635920 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:22.844368 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1255/2533] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:22 2022] POST /identity/v3/projects => generated 381 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:22.846212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b909d44-8d84-44b6-9efe-d48aaed9d9a4 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:22.859232 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b909d44-8d84-44b6-9efe-d48aaed9d9a4 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:22.920497 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5620a97-1338-4bef-a912-393debaecb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:22.921108 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5620a97-1338-4bef-a912-393debaecb1a admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:22.921394 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5620a97-1338-4bef-a912-393debaecb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:22.921666 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5620a97-1338-4bef-a912-393debaecb1a admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:22.922377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5620a97-1338-4bef-a912-393debaecb1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:22.924966 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5620a97-1338-4bef-a912-393debaecb1a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:23.066902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1279/2534] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:22 2022] POST /identity/v3/users => generated 297 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:43:23.068481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037182cc-5388-4fa4-9c4a-ec7100635920 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:23.078931 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037182cc-5388-4fa4-9c4a-ec7100635920 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:23.084180 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fba4b-91a7-4574-982c-8154d2a1a24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:23.084812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fba4b-91a7-4574-982c-8154d2a1a24b admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:23.085091 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fba4b-91a7-4574-982c-8154d2a1a24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:23.085366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fba4b-91a7-4574-982c-8154d2a1a24b admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:23.086007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fba4b-91a7-4574-982c-8154d2a1a24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:23.087626 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fba4b-91a7-4574-982c-8154d2a1a24b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:23.089933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:23.098815 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1256/2535] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:23.103105 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5620a97-1338-4bef-a912-393debaecb1a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:23.113400 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5620a97-1338-4bef-a912-393debaecb1a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:23.118129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67023f54-17e9-464f-b346-25c19f767019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:23.118916 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67023f54-17e9-464f-b346-25c19f767019 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:23.119204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67023f54-17e9-464f-b346-25c19f767019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:23.119483 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67023f54-17e9-464f-b346-25c19f767019 admin admin] PATH_INFO: `/v3/projects/c2052ca735924af6ba85443ac04f512b/users/e509a537d4c24cd6b68721807390694d/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:23.135380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67023f54-17e9-464f-b346-25c19f767019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2052ca735924af6ba85443ac04f512b, user_id=e509a537d4c24cd6b68721807390694d, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:23.137774 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67023f54-17e9-464f-b346-25c19f767019 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:23.252788 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1280/2536] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:23 2022] PUT /identity/v3/projects/c2052ca735924af6ba85443ac04f512b/users/e509a537d4c24cd6b68721807390694d/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:23.256714 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fba4b-91a7-4574-982c-8154d2a1a24b admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:23.268302 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fba4b-91a7-4574-982c-8154d2a1a24b admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:23.333884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4283f-bdfb-4a60-8363-f8b3f263839b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:23.334791 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4283f-bdfb-4a60-8363-f8b3f263839b admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:23.335071 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4283f-bdfb-4a60-8363-f8b3f263839b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:23.335342 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4283f-bdfb-4a60-8363-f8b3f263839b admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:23.336037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4283f-bdfb-4a60-8363-f8b3f263839b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:23.337666 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4283f-bdfb-4a60-8363-f8b3f263839b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:23.352058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1257/2537] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:23.353337 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67023f54-17e9-464f-b346-25c19f767019 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:23.364279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67023f54-17e9-464f-b346-25c19f767019 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:23.369333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8eb819-eeb4-4b47-b4f5-c7f80392e4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:23.376038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eb819-eeb4-4b47-b4f5-c7f80392e4c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:23.376038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eb819-eeb4-4b47-b4f5-c7f80392e4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:23.376038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eb819-eeb4-4b47-b4f5-c7f80392e4c0 admin admin] PATH_INFO: `/v3/projects/c2052ca735924af6ba85443ac04f512b/users/e509a537d4c24cd6b68721807390694d/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:23.376038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8eb819-eeb4-4b47-b4f5-c7f80392e4c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2052ca735924af6ba85443ac04f512b, user_id=e509a537d4c24cd6b68721807390694d, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:23.376038 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8eb819-eeb4-4b47-b4f5-c7f80392e4c0 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:23.386729 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1281/2538] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:23 2022] PUT /identity/v3/projects/c2052ca735924af6ba85443ac04f512b/users/e509a537d4c24cd6b68721807390694d/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:23.397880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4608b-1fbb-4657-bd5c-aa64f8248466 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:23.398413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4608b-1fbb-4657-bd5c-aa64f8248466 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:23.398689 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4608b-1fbb-4657-bd5c-aa64f8248466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:23.429691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-3fb4608b-1fbb-4657-bd5c-aa64f8248466 None None] MFA Rules not processed for user `e509a537d4c24cd6b68721807390694d`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:23.431383 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3fb4608b-1fbb-4657-bd5c-aa64f8248466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:23.505016 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1258/2539] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:23.529965 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8eb819-eeb4-4b47-b4f5-c7f80392e4c0 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:23.531688 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1f8eb819-eeb4-4b47-b4f5-c7f80392e4c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:23.592829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8eb819-eeb4-4b47-b4f5-c7f80392e4c0 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:23.597069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae085f3-dc1a-42f9-9901-24ed5e3917d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:23.597675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae085f3-dc1a-42f9-9901-24ed5e3917d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:23.597953 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae085f3-dc1a-42f9-9901-24ed5e3917d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:23.598251 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae085f3-dc1a-42f9-9901-24ed5e3917d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:23.607104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae085f3-dc1a-42f9-9901-24ed5e3917d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:23.608584 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae085f3-dc1a-42f9-9901-24ed5e3917d5 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:23.618683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1282/2540] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:25.002640 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4608b-1fbb-4657-bd5c-aa64f8248466 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:25.017979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4608b-1fbb-4657-bd5c-aa64f8248466 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:25.024559 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f8b46-0f75-4f0f-a407-794e58e668aa tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e509a537d4c24cd6b68721807390694d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2052ca735924af6ba85443ac04f512b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:25.025189 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f8b46-0f75-4f0f-a407-794e58e668aa tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:25.025478 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f8b46-0f75-4f0f-a407-794e58e668aa tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:25.026295 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f8b46-0f75-4f0f-a407-794e58e668aa tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:25.027219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f8b46-0f75-4f0f-a407-794e58e668aa tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:43:25.027353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f8b46-0f75-4f0f-a407-794e58e668aa tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:25.029448 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f8b46-0f75-4f0f-a407-794e58e668aa tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:25.042499 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1259/2541] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:43:25.046627 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae085f3-dc1a-42f9-9901-24ed5e3917d5 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:25.056595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae085f3-dc1a-42f9-9901-24ed5e3917d5 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:25.063057 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89872b26-ef13-4ade-8799-1a6a59d91c00 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e509a537d4c24cd6b68721807390694d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2052ca735924af6ba85443ac04f512b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:25.063057 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89872b26-ef13-4ade-8799-1a6a59d91c00 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:25.063340 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89872b26-ef13-4ade-8799-1a6a59d91c00 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:25.063523 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89872b26-ef13-4ade-8799-1a6a59d91c00 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:25.064782 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89872b26-ef13-4ade-8799-1a6a59d91c00 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:25.067398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89872b26-ef13-4ade-8799-1a6a59d91c00 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:25.192085 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1283/2542] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:25 2022] POST /identity/v3/projects => generated 353 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:43:25.196366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f8b46-0f75-4f0f-a407-794e58e668aa tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:25.207074 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f8b46-0f75-4f0f-a407-794e58e668aa tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:25.262513 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc1bb9-3b44-4713-a153-d6a98504559e tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e509a537d4c24cd6b68721807390694d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2052ca735924af6ba85443ac04f512b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:25.263108 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc1bb9-3b44-4713-a153-d6a98504559e tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:25.263391 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc1bb9-3b44-4713-a153-d6a98504559e tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:25.263663 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc1bb9-3b44-4713-a153-d6a98504559e tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:25.264292 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc1bb9-3b44-4713-a153-d6a98504559e tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:43:25.264627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc1bb9-3b44-4713-a153-d6a98504559e tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:25.266212 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc1bb9-3b44-4713-a153-d6a98504559e tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:25.274601 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:25.278396 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1260/2543] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:43:25.315967 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89872b26-ef13-4ade-8799-1a6a59d91c00 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:25.328057 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89872b26-ef13-4ade-8799-1a6a59d91c00 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:25.332827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2e4f1-fe56-4521-8d4f-dec42db5b6b3 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e509a537d4c24cd6b68721807390694d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2052ca735924af6ba85443ac04f512b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:25.333467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2e4f1-fe56-4521-8d4f-dec42db5b6b3 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:25.333880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2e4f1-fe56-4521-8d4f-dec42db5b6b3 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:25.334132 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2e4f1-fe56-4521-8d4f-dec42db5b6b3 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] PATH_INFO: `/v3/projects/2561a92bcc904550953ef8efbca5eac6` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:25.335267 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2e4f1-fe56-4521-8d4f-dec42db5b6b3 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2561a92bcc904550953ef8efbca5eac6)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:25.337233 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2e4f1-fe56-4521-8d4f-dec42db5b6b3 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:25.349484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:25.560485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3fa2e4f1-fe56-4521-8d4f-dec42db5b6b3 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2561a92bcc904550953ef8efbca5eac6', 'request_id': 'req-3fa2e4f1-fe56-4521-8d4f-dec42db5b6b3'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:25.567453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3fa2e4f1-fe56-4521-8d4f-dec42db5b6b3 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2561a92bcc904550953ef8efbca5eac6', 'request_id': 'req-3fa2e4f1-fe56-4521-8d4f-dec42db5b6b3'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:25.681009 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3fa2e4f1-fe56-4521-8d4f-dec42db5b6b3 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2561a92bcc904550953ef8efbca5eac6', 'request_id': 'req-3fa2e4f1-fe56-4521-8d4f-dec42db5b6b3'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:25.697261 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3fa2e4f1-fe56-4521-8d4f-dec42db5b6b3 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] The token cache is being invalidate because project 2561a92bcc904550953ef8efbca5eac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:43:25.699172 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3fa2e4f1-fe56-4521-8d4f-dec42db5b6b3 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:25.699597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3fa2e4f1-fe56-4521-8d4f-dec42db5b6b3 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:25.701254 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1284/2544] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:43:25 2022] DELETE /identity/v3/projects/2561a92bcc904550953ef8efbca5eac6 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:26.653049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc1bb9-3b44-4713-a153-d6a98504559e tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:26.655048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4bbc1bb9-3b44-4713-a153-d6a98504559e tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:26.860939 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc1bb9-3b44-4713-a153-d6a98504559e tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:26.944888 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdad37b-8182-4923-8bab-8fa6144aa81d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5deb7370bc3045c5be2d391d3b1dbd82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:26.944888 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdad37b-8182-4923-8bab-8fa6144aa81d service placement] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:26.944888 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdad37b-8182-4923-8bab-8fa6144aa81d service placement] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:26.945247 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdad37b-8182-4923-8bab-8fa6144aa81d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:26.947318 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-dfdad37b-8182-4923-8bab-8fa6144aa81d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:26.960250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdad37b-8182-4923-8bab-8fa6144aa81d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:26.961975 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdad37b-8182-4923-8bab-8fa6144aa81d service placement] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:26.975907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1261/2545] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:27.004565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2e4f1-fe56-4521-8d4f-dec42db5b6b3 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:27.006702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3fa2e4f1-fe56-4521-8d4f-dec42db5b6b3 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:27.091554 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2e4f1-fe56-4521-8d4f-dec42db5b6b3 tempest-VolumeQuotaClassesTest-1267919713 tempest-VolumeQuotaClassesTest-1267919713-project-admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:27.097043 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89d04d-ce2e-40a2-b620-9b5c6bbc0066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:27.097453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89d04d-ce2e-40a2-b620-9b5c6bbc0066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:27.097734 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89d04d-ce2e-40a2-b620-9b5c6bbc0066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:27.098009 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89d04d-ce2e-40a2-b620-9b5c6bbc0066 admin admin] PATH_INFO: `/v3/users/f537d623115d41b9be88d4618799f1b6` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:27.099534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89d04d-ce2e-40a2-b620-9b5c6bbc0066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f537d623115d41b9be88d4618799f1b6)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:27.101203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89d04d-ce2e-40a2-b620-9b5c6bbc0066 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:27.157962 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdad37b-8182-4923-8bab-8fa6144aa81d service placement] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:27.159519 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-dfdad37b-8182-4923-8bab-8fa6144aa81d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:27.178800 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdad37b-8182-4923-8bab-8fa6144aa81d service placement] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:27.183696 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e7765-4849-4a21-a78e-a998d6b894e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:27.184443 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e7765-4849-4a21-a78e-a998d6b894e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:27.184841 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e7765-4849-4a21-a78e-a998d6b894e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:27.185178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e7765-4849-4a21-a78e-a998d6b894e4 admin admin] PATH_INFO: `/v3/users/a6507ed9a47848c29d72fd9af71e2cbc` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:27.186436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e7765-4849-4a21-a78e-a998d6b894e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6507ed9a47848c29d72fd9af71e2cbc)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:27.188527 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e7765-4849-4a21-a78e-a998d6b894e4 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:27.391709 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ee89d04d-ce2e-40a2-b620-9b5c6bbc0066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f537d623115d41b9be88d4618799f1b6'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:27.392412 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ee89d04d-ce2e-40a2-b620-9b5c6bbc0066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f537d623115d41b9be88d4618799f1b6'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:27.404888 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ee89d04d-ce2e-40a2-b620-9b5c6bbc0066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f537d623115d41b9be88d4618799f1b6'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:27.476460 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-476e7765-4849-4a21-a78e-a998d6b894e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6507ed9a47848c29d72fd9af71e2cbc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:27.477108 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-476e7765-4849-4a21-a78e-a998d6b894e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6507ed9a47848c29d72fd9af71e2cbc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:27.493786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-476e7765-4849-4a21-a78e-a998d6b894e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6507ed9a47848c29d72fd9af71e2cbc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:27.599833 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ee89d04d-ce2e-40a2-b620-9b5c6bbc0066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f537d623115d41b9be88d4618799f1b6'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:27.600549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ee89d04d-ce2e-40a2-b620-9b5c6bbc0066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f537d623115d41b9be88d4618799f1b6'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:27.614065 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1285/2546] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:43:27 2022] DELETE /identity/v3/users/f537d623115d41b9be88d4618799f1b6 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:27.618329 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4593d61-c5d8-41a6-846e-e497422474be None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:27.618614 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4593d61-c5d8-41a6-846e-e497422474be None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:27.618890 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4593d61-c5d8-41a6-846e-e497422474be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:27.637539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b4593d61-c5d8-41a6-846e-e497422474be None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:27.638663 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b4593d61-c5d8-41a6-846e-e497422474be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:27.650912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:27.697508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1286/2547] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:43:27.707754 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4593d61-c5d8-41a6-846e-e497422474be None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:27.709083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b4593d61-c5d8-41a6-846e-e497422474be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:27.754004 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-476e7765-4849-4a21-a78e-a998d6b894e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6507ed9a47848c29d72fd9af71e2cbc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:27.754756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-476e7765-4849-4a21-a78e-a998d6b894e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6507ed9a47848c29d72fd9af71e2cbc'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:27.766336 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4593d61-c5d8-41a6-846e-e497422474be None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:27.768080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1262/2548] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:43:27 2022] DELETE /identity/v3/users/a6507ed9a47848c29d72fd9af71e2cbc => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:27.818506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338be08b-21c3-4e55-af63-407d6adc0497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:27.819152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338be08b-21c3-4e55-af63-407d6adc0497 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:27.819714 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338be08b-21c3-4e55-af63-407d6adc0497 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:27.819998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338be08b-21c3-4e55-af63-407d6adc0497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:27.884476 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338be08b-21c3-4e55-af63-407d6adc0497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:27.886022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338be08b-21c3-4e55-af63-407d6adc0497 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:27.897333 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1287/2549] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:43:28.091757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e7765-4849-4a21-a78e-a998d6b894e4 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:28.093264 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-476e7765-4849-4a21-a78e-a998d6b894e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:28.102784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:28.106601 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e7765-4849-4a21-a78e-a998d6b894e4 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:28.111433 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d340b7-8e24-4d1a-9b91-dc30d9051f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:28.112068 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d340b7-8e24-4d1a-9b91-dc30d9051f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:28.112828 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d340b7-8e24-4d1a-9b91-dc30d9051f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:28.112828 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d340b7-8e24-4d1a-9b91-dc30d9051f50 admin admin] PATH_INFO: `/v3/projects/b9b23b92fe4a4510be8a7c4921e0fc6b` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:28.113955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d340b7-8e24-4d1a-9b91-dc30d9051f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b23b92fe4a4510be8a7c4921e0fc6b)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:28.115876 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d340b7-8e24-4d1a-9b91-dc30d9051f50 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:28.271163 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-08d340b7-8e24-4d1a-9b91-dc30d9051f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b23b92fe4a4510be8a7c4921e0fc6b', 'request_id': 'req-08d340b7-8e24-4d1a-9b91-dc30d9051f50'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:28.278300 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-08d340b7-8e24-4d1a-9b91-dc30d9051f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b23b92fe4a4510be8a7c4921e0fc6b', 'request_id': 'req-08d340b7-8e24-4d1a-9b91-dc30d9051f50'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:28.332909 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-08d340b7-8e24-4d1a-9b91-dc30d9051f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b23b92fe4a4510be8a7c4921e0fc6b', 'request_id': 'req-08d340b7-8e24-4d1a-9b91-dc30d9051f50'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:28.346742 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-08d340b7-8e24-4d1a-9b91-dc30d9051f50 admin admin] The token cache is being invalidate because project b9b23b92fe4a4510be8a7c4921e0fc6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:43:28.347246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-08d340b7-8e24-4d1a-9b91-dc30d9051f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:28.348307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-08d340b7-8e24-4d1a-9b91-dc30d9051f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:28.350366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1263/2550] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:43:28 2022] DELETE /identity/v3/projects/b9b23b92fe4a4510be8a7c4921e0fc6b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:28.355292 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee383902-bf9e-4229-9b3e-30c42fda5d18 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:28.355906 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee383902-bf9e-4229-9b3e-30c42fda5d18 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:28.355906 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee383902-bf9e-4229-9b3e-30c42fda5d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:28.379779 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ee383902-bf9e-4229-9b3e-30c42fda5d18 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:28.381205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ee383902-bf9e-4229-9b3e-30c42fda5d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:28.447032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1288/2551] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:28.454986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe85bc8-7d32-47fe-be66-93b3a38fbea8 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:28.455291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe85bc8-7d32-47fe-be66-93b3a38fbea8 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:28.455569 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe85bc8-7d32-47fe-be66-93b3a38fbea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:28.475581 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-efe85bc8-7d32-47fe-be66-93b3a38fbea8 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:28.476842 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-efe85bc8-7d32-47fe-be66-93b3a38fbea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:28.485061 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1264/2552] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:28.489903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee383902-bf9e-4229-9b3e-30c42fda5d18 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:28.499540 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee383902-bf9e-4229-9b3e-30c42fda5d18 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:28.504919 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c90257-cc23-4ca1-96f8-86fb6f175dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:28.505692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90257-cc23-4ca1-96f8-86fb6f175dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:28.505974 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90257-cc23-4ca1-96f8-86fb6f175dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:28.506248 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90257-cc23-4ca1-96f8-86fb6f175dd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:28.506889 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c90257-cc23-4ca1-96f8-86fb6f175dd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:43:28.507194 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c90257-cc23-4ca1-96f8-86fb6f175dd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:28.508913 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c90257-cc23-4ca1-96f8-86fb6f175dd2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:28.517098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe85bc8-7d32-47fe-be66-93b3a38fbea8 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:28.518609 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-efe85bc8-7d32-47fe-be66-93b3a38fbea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:28.524647 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1289/2553] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:43:28.528523 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c90257-cc23-4ca1-96f8-86fb6f175dd2 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:28.532437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe85bc8-7d32-47fe-be66-93b3a38fbea8 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:28.538818 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682a90f-d470-47b6-9eb8-53b19e66eee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:28.539451 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682a90f-d470-47b6-9eb8-53b19e66eee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:28.539734 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682a90f-d470-47b6-9eb8-53b19e66eee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:28.540017 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682a90f-d470-47b6-9eb8-53b19e66eee7 admin admin] PATH_INFO: `/v3/projects/aaf7c3a782b8414d9fe96bd14dc4d7c0` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:28.541198 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c90257-cc23-4ca1-96f8-86fb6f175dd2 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:28.543232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682a90f-d470-47b6-9eb8-53b19e66eee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaf7c3a782b8414d9fe96bd14dc4d7c0)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:28.545581 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682a90f-d470-47b6-9eb8-53b19e66eee7 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:28.551042 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba50b3-e4c5-4589-b22c-6504aa4b31f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:28.551042 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba50b3-e4c5-4589-b22c-6504aa4b31f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:28.551042 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba50b3-e4c5-4589-b22c-6504aa4b31f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:28.551042 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba50b3-e4c5-4589-b22c-6504aa4b31f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:28.551435 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba50b3-e4c5-4589-b22c-6504aa4b31f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:28.551435 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba50b3-e4c5-4589-b22c-6504aa4b31f7 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:28.624973 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1290/2554] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:28 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:43:28.629578 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba50b3-e4c5-4589-b22c-6504aa4b31f7 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:28.659417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d682a90f-d470-47b6-9eb8-53b19e66eee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaf7c3a782b8414d9fe96bd14dc4d7c0', 'request_id': 'req-d682a90f-d470-47b6-9eb8-53b19e66eee7'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:28.665954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d682a90f-d470-47b6-9eb8-53b19e66eee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaf7c3a782b8414d9fe96bd14dc4d7c0', 'request_id': 'req-d682a90f-d470-47b6-9eb8-53b19e66eee7'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:28.694324 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba50b3-e4c5-4589-b22c-6504aa4b31f7 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:28.743247 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d682a90f-d470-47b6-9eb8-53b19e66eee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaf7c3a782b8414d9fe96bd14dc4d7c0', 'request_id': 'req-d682a90f-d470-47b6-9eb8-53b19e66eee7'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:28.754631 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d682a90f-d470-47b6-9eb8-53b19e66eee7 admin admin] The token cache is being invalidate because project aaf7c3a782b8414d9fe96bd14dc4d7c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:43:28.755257 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d682a90f-d470-47b6-9eb8-53b19e66eee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:28.755557 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d682a90f-d470-47b6-9eb8-53b19e66eee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:28.756393 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415c77e-21e9-4c15-b38b-204809a66266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:28.757057 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415c77e-21e9-4c15-b38b-204809a66266 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:28.757403 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1265/2555] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:43:28 2022] DELETE /identity/v3/projects/aaf7c3a782b8414d9fe96bd14dc4d7c0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:28.760217 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415c77e-21e9-4c15-b38b-204809a66266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:28.760570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415c77e-21e9-4c15-b38b-204809a66266 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:28.761249 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682a90f-d470-47b6-9eb8-53b19e66eee7 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:28.761370 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415c77e-21e9-4c15-b38b-204809a66266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:28.762797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-d682a90f-d470-47b6-9eb8-53b19e66eee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:28.763923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415c77e-21e9-4c15-b38b-204809a66266 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:28.777482 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682a90f-d470-47b6-9eb8-53b19e66eee7 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:28.783321 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b22a4e-2100-435a-ac42-9db1f4ef7523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:28.784130 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b22a4e-2100-435a-ac42-9db1f4ef7523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:28.784537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b22a4e-2100-435a-ac42-9db1f4ef7523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:28.784906 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b22a4e-2100-435a-ac42-9db1f4ef7523 admin admin] PATH_INFO: `/v3/users/e509a537d4c24cd6b68721807390694d` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:28.786408 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b22a4e-2100-435a-ac42-9db1f4ef7523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e509a537d4c24cd6b68721807390694d)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:28.788493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b22a4e-2100-435a-ac42-9db1f4ef7523 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:28.872634 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1291/2556] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:28 2022] POST /identity/v3/users => generated 284 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:43:28.874340 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415c77e-21e9-4c15-b38b-204809a66266 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:28.875562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1415c77e-21e9-4c15-b38b-204809a66266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:28.887329 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415c77e-21e9-4c15-b38b-204809a66266 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:28.892879 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a5245-8453-4cbf-a0e3-2171c18091ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:28.893494 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a5245-8453-4cbf-a0e3-2171c18091ac admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:28.893783 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a5245-8453-4cbf-a0e3-2171c18091ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:28.894059 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a5245-8453-4cbf-a0e3-2171c18091ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:28.894701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a5245-8453-4cbf-a0e3-2171c18091ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:28.896993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a5245-8453-4cbf-a0e3-2171c18091ac admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:28.908642 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1292/2557] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:28.912440 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a5245-8453-4cbf-a0e3-2171c18091ac admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:28.922021 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a5245-8453-4cbf-a0e3-2171c18091ac admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:28.927464 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf292e-e496-4e16-8d0c-7db66d075315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:28.928210 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf292e-e496-4e16-8d0c-7db66d075315 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:28.928563 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf292e-e496-4e16-8d0c-7db66d075315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:28.928861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf292e-e496-4e16-8d0c-7db66d075315 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:28.929491 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf292e-e496-4e16-8d0c-7db66d075315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:28.931052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf292e-e496-4e16-8d0c-7db66d075315 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:28.943017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1293/2558] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:28.947262 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf292e-e496-4e16-8d0c-7db66d075315 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:28.956628 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf292e-e496-4e16-8d0c-7db66d075315 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:28.961296 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deba08d-faa9-4b6b-b551-d6e65ffabeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:28.961965 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deba08d-faa9-4b6b-b551-d6e65ffabeb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:28.962244 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deba08d-faa9-4b6b-b551-d6e65ffabeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:28.962512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deba08d-faa9-4b6b-b551-d6e65ffabeb4 admin admin] PATH_INFO: `/v3/projects/bd17394419b94ad4917bb14a5247dc1d/users/bb2d0223971e4062b13922935a8de08a/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:28.977386 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deba08d-faa9-4b6b-b551-d6e65ffabeb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd17394419b94ad4917bb14a5247dc1d, user_id=bb2d0223971e4062b13922935a8de08a, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:28.980054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deba08d-faa9-4b6b-b551-d6e65ffabeb4 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:29.026557 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-28b22a4e-2100-435a-ac42-9db1f4ef7523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e509a537d4c24cd6b68721807390694d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:29.027217 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-28b22a4e-2100-435a-ac42-9db1f4ef7523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e509a537d4c24cd6b68721807390694d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:29.035304 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:29.040206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-28b22a4e-2100-435a-ac42-9db1f4ef7523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e509a537d4c24cd6b68721807390694d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:29.115293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1294/2559] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:28 2022] PUT /identity/v3/projects/bd17394419b94ad4917bb14a5247dc1d/users/bb2d0223971e4062b13922935a8de08a/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:29.126841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db74b0-f3e8-4eec-b129-f5e78eaacfc5 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:29.127158 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db74b0-f3e8-4eec-b129-f5e78eaacfc5 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:29.127461 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db74b0-f3e8-4eec-b129-f5e78eaacfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:29.154327 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-28b22a4e-2100-435a-ac42-9db1f4ef7523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e509a537d4c24cd6b68721807390694d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:29.156624 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-28b22a4e-2100-435a-ac42-9db1f4ef7523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e509a537d4c24cd6b68721807390694d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:29.159330 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-73db74b0-f3e8-4eec-b129-f5e78eaacfc5 None None] MFA Rules not processed for user `bb2d0223971e4062b13922935a8de08a`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:29.160658 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-73db74b0-f3e8-4eec-b129-f5e78eaacfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:29.175623 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1266/2560] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:43:28 2022] DELETE /identity/v3/users/e509a537d4c24cd6b68721807390694d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:29.242120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1295/2561] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:43:29.253422 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b22a4e-2100-435a-ac42-9db1f4ef7523 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:29.254839 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-28b22a4e-2100-435a-ac42-9db1f4ef7523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:29.317804 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b22a4e-2100-435a-ac42-9db1f4ef7523 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:29.322376 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898d769-434a-472e-9be9-c0be6589966f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:29.323622 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898d769-434a-472e-9be9-c0be6589966f service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:29.323903 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898d769-434a-472e-9be9-c0be6589966f service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:29.324175 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898d769-434a-472e-9be9-c0be6589966f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:29.396271 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898d769-434a-472e-9be9-c0be6589966f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:29.397829 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898d769-434a-472e-9be9-c0be6589966f service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:29.412958 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1267/2562] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:29.532204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:29.600580 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=76,keystone:DELETE=22,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:29.833585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db74b0-f3e8-4eec-b129-f5e78eaacfc5 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:29.835223 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-73db74b0-f3e8-4eec-b129-f5e78eaacfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:29.913131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db74b0-f3e8-4eec-b129-f5e78eaacfc5 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:29.992606 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bac820-7b64-41c1-8136-6e68ea5838dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:29.993258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bac820-7b64-41c1-8136-6e68ea5838dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:29.995926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bac820-7b64-41c1-8136-6e68ea5838dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:29.995926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bac820-7b64-41c1-8136-6e68ea5838dd admin admin] PATH_INFO: `/v3/projects/c2052ca735924af6ba85443ac04f512b` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:29.995926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bac820-7b64-41c1-8136-6e68ea5838dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2052ca735924af6ba85443ac04f512b)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:29.997031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bac820-7b64-41c1-8136-6e68ea5838dd admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:30.162099 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-18bac820-7b64-41c1-8136-6e68ea5838dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2052ca735924af6ba85443ac04f512b', 'request_id': 'req-18bac820-7b64-41c1-8136-6e68ea5838dd'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:30.169471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-18bac820-7b64-41c1-8136-6e68ea5838dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2052ca735924af6ba85443ac04f512b', 'request_id': 'req-18bac820-7b64-41c1-8136-6e68ea5838dd'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:30.269017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-18bac820-7b64-41c1-8136-6e68ea5838dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2052ca735924af6ba85443ac04f512b', 'request_id': 'req-18bac820-7b64-41c1-8136-6e68ea5838dd'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:30.281407 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-18bac820-7b64-41c1-8136-6e68ea5838dd admin admin] The token cache is being invalidate because project c2052ca735924af6ba85443ac04f512b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:43:30.281939 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-18bac820-7b64-41c1-8136-6e68ea5838dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:30.283280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-18bac820-7b64-41c1-8136-6e68ea5838dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:30.285564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1296/2563] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:43:29 2022] DELETE /identity/v3/projects/c2052ca735924af6ba85443ac04f512b => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:30.290906 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795a7b5-4da8-4c76-8298-800ff36bd472 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:30.291567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795a7b5-4da8-4c76-8298-800ff36bd472 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:30.291793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795a7b5-4da8-4c76-8298-800ff36bd472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:30.323251 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-8795a7b5-4da8-4c76-8298-800ff36bd472 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:30.324529 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-8795a7b5-4da8-4c76-8298-800ff36bd472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:30.395341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1268/2564] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:30.428011 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a812f7-8af7-467c-91bd-5044d7883272 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:30.428011 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a812f7-8af7-467c-91bd-5044d7883272 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:30.428011 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a812f7-8af7-467c-91bd-5044d7883272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:30.442952 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-70a812f7-8af7-467c-91bd-5044d7883272 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:30.444175 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-70a812f7-8af7-467c-91bd-5044d7883272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:30.452940 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1297/2565] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:30.457491 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795a7b5-4da8-4c76-8298-800ff36bd472 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:30.467667 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795a7b5-4da8-4c76-8298-800ff36bd472 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:30.473928 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4585ea0-b8ed-4f55-b8b1-138a4b821a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:30.474544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4585ea0-b8ed-4f55-b8b1-138a4b821a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:30.474888 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4585ea0-b8ed-4f55-b8b1-138a4b821a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:30.475333 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4585ea0-b8ed-4f55-b8b1-138a4b821a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:30.475989 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4585ea0-b8ed-4f55-b8b1-138a4b821a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:43:30.476291 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4585ea0-b8ed-4f55-b8b1-138a4b821a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:30.477924 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4585ea0-b8ed-4f55-b8b1-138a4b821a31 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:30.490832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1269/2566] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:43:30.495233 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a812f7-8af7-467c-91bd-5044d7883272 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:30.505089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a812f7-8af7-467c-91bd-5044d7883272 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:30.509786 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dcba4-bb29-41ae-8489-bbf85adc8b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:30.510440 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dcba4-bb29-41ae-8489-bbf85adc8b1c admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:30.510723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dcba4-bb29-41ae-8489-bbf85adc8b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:30.510995 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dcba4-bb29-41ae-8489-bbf85adc8b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:30.511705 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007dcba4-bb29-41ae-8489-bbf85adc8b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:30.513685 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007dcba4-bb29-41ae-8489-bbf85adc8b1c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:30.689113 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1298/2567] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:30 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:43:30.700033 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4585ea0-b8ed-4f55-b8b1-138a4b821a31 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:30.710954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4585ea0-b8ed-4f55-b8b1-138a4b821a31 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:30.770181 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b0879-e1c9-43ed-b970-baa072d4363a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:30.770858 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b0879-e1c9-43ed-b970-baa072d4363a admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:30.771217 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b0879-e1c9-43ed-b970-baa072d4363a admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:30.771561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b0879-e1c9-43ed-b970-baa072d4363a admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:30.772280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b0879-e1c9-43ed-b970-baa072d4363a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:30.774756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b0879-e1c9-43ed-b970-baa072d4363a admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:30.881060 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1270/2568] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:30 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:30.885313 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dcba4-bb29-41ae-8489-bbf85adc8b1c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:30.896438 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dcba4-bb29-41ae-8489-bbf85adc8b1c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:30.901610 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e849614-d518-473e-996c-899ddfda4239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:30.905344 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e849614-d518-473e-996c-899ddfda4239 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:30.905344 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e849614-d518-473e-996c-899ddfda4239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:30.905344 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e849614-d518-473e-996c-899ddfda4239 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:30.905344 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e849614-d518-473e-996c-899ddfda4239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:30.905344 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e849614-d518-473e-996c-899ddfda4239 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:30.916843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1299/2569] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:30.920947 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b0879-e1c9-43ed-b970-baa072d4363a admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:30.931121 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b0879-e1c9-43ed-b970-baa072d4363a admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:30.936034 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a5394-01e6-4e49-88e0-efa6e377f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:30.936675 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a5394-01e6-4e49-88e0-efa6e377f5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:30.936956 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a5394-01e6-4e49-88e0-efa6e377f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:30.937229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a5394-01e6-4e49-88e0-efa6e377f5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:30.937898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a5394-01e6-4e49-88e0-efa6e377f5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:30.940015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a5394-01e6-4e49-88e0-efa6e377f5a3 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:30.951284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1271/2570] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:30.956411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e849614-d518-473e-996c-899ddfda4239 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:30.967005 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e849614-d518-473e-996c-899ddfda4239 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:30.972468 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d81135-dfd7-4b5e-8298-e16798cd5a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:30.973262 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d81135-dfd7-4b5e-8298-e16798cd5a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:30.973967 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d81135-dfd7-4b5e-8298-e16798cd5a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:30.973967 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d81135-dfd7-4b5e-8298-e16798cd5a46 admin admin] PATH_INFO: `/v3/projects/b37885f52a774f0cbbbbdbe5b7c32acf/users/a4be4796e7a84fa7bee01e3bdb87247a/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:30.985380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:30.992481 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d81135-dfd7-4b5e-8298-e16798cd5a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b37885f52a774f0cbbbbdbe5b7c32acf, user_id=a4be4796e7a84fa7bee01e3bdb87247a, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:30.995196 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d81135-dfd7-4b5e-8298-e16798cd5a46 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:31.075484 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1300/2571] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:30 2022] PUT /identity/v3/projects/b37885f52a774f0cbbbbdbe5b7c32acf/users/a4be4796e7a84fa7bee01e3bdb87247a/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:31.087102 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c71e4c-af77-490d-99ce-60f31119df3f None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:31.087391 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c71e4c-af77-490d-99ce-60f31119df3f None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:31.087670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c71e4c-af77-490d-99ce-60f31119df3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:31.116198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-79c71e4c-af77-490d-99ce-60f31119df3f None None] MFA Rules not processed for user `a4be4796e7a84fa7bee01e3bdb87247a`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:31.117457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-79c71e4c-af77-490d-99ce-60f31119df3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:31.180814 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1272/2572] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:31.190037 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d81135-dfd7-4b5e-8298-e16798cd5a46 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:31.254194 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d81135-dfd7-4b5e-8298-e16798cd5a46 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:31.259668 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba834a-cb00-41b7-85f7-3a1ffde49328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:31.260317 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba834a-cb00-41b7-85f7-3a1ffde49328 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:31.260675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba834a-cb00-41b7-85f7-3a1ffde49328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:31.260974 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba834a-cb00-41b7-85f7-3a1ffde49328 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:31.261647 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba834a-cb00-41b7-85f7-3a1ffde49328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:31.263796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba834a-cb00-41b7-85f7-3a1ffde49328 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:31.656930 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1301/2573] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:31 2022] POST /identity/v3/projects => generated 377 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:31.658522 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c71e4c-af77-490d-99ce-60f31119df3f None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:31.670155 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c71e4c-af77-490d-99ce-60f31119df3f None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:31.733216 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c3673-67c6-4769-8943-a7ef3637197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:31.733835 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c3673-67c6-4769-8943-a7ef3637197b admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:31.734116 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c3673-67c6-4769-8943-a7ef3637197b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:31.734391 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c3673-67c6-4769-8943-a7ef3637197b admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:31.735099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c3673-67c6-4769-8943-a7ef3637197b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:31.737652 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c3673-67c6-4769-8943-a7ef3637197b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:31.857907 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1273/2574] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:31 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:31.860661 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba834a-cb00-41b7-85f7-3a1ffde49328 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:31.870930 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba834a-cb00-41b7-85f7-3a1ffde49328 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:31.875661 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac110ef6-3798-4f9f-b07d-7081956e9007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:31.876785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac110ef6-3798-4f9f-b07d-7081956e9007 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:31.877069 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac110ef6-3798-4f9f-b07d-7081956e9007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:31.877361 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac110ef6-3798-4f9f-b07d-7081956e9007 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:31.878037 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac110ef6-3798-4f9f-b07d-7081956e9007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:31.880265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac110ef6-3798-4f9f-b07d-7081956e9007 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:31.896002 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1302/2575] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:31.897266 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c3673-67c6-4769-8943-a7ef3637197b admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:31.907779 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c3673-67c6-4769-8943-a7ef3637197b admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:31.913883 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3943a-a3dc-4397-9790-97cf2f2cd262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:31.914814 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3943a-a3dc-4397-9790-97cf2f2cd262 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:31.915124 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3943a-a3dc-4397-9790-97cf2f2cd262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:31.915405 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3943a-a3dc-4397-9790-97cf2f2cd262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:31.916060 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3943a-a3dc-4397-9790-97cf2f2cd262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:31.917753 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3943a-a3dc-4397-9790-97cf2f2cd262 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:31.931901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1274/2576] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:43:31.933355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac110ef6-3798-4f9f-b07d-7081956e9007 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:31.948689 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac110ef6-3798-4f9f-b07d-7081956e9007 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:31.949431 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d66349-d2f4-4fcc-ae7d-339cb9b10d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:31.950101 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66349-d2f4-4fcc-ae7d-339cb9b10d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:31.950382 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66349-d2f4-4fcc-ae7d-339cb9b10d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:31.950660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66349-d2f4-4fcc-ae7d-339cb9b10d6b admin admin] PATH_INFO: `/v3/projects/34d8a119ef2942dda72ad9dbefba1ab6/users/f6ba3d34260f4ad394b0816624a008de/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:31.967202 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d66349-d2f4-4fcc-ae7d-339cb9b10d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d8a119ef2942dda72ad9dbefba1ab6, user_id=f6ba3d34260f4ad394b0816624a008de, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:31.969864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d66349-d2f4-4fcc-ae7d-339cb9b10d6b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:32.046337 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:32.080361 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1303/2577] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:31 2022] PUT /identity/v3/projects/34d8a119ef2942dda72ad9dbefba1ab6/users/f6ba3d34260f4ad394b0816624a008de/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:32.101973 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c5d7b-edee-48a7-8918-816f664f4bb0 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:32.102416 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c5d7b-edee-48a7-8918-816f664f4bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:32.102722 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c5d7b-edee-48a7-8918-816f664f4bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:32.133781 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-429c5d7b-edee-48a7-8918-816f664f4bb0 None None] MFA Rules not processed for user `f6ba3d34260f4ad394b0816624a008de`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:32.135048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-429c5d7b-edee-48a7-8918-816f664f4bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:32.201714 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1275/2578] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:32.206824 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d66349-d2f4-4fcc-ae7d-339cb9b10d6b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:32.362229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:32.416657 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d66349-d2f4-4fcc-ae7d-339cb9b10d6b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:32.421414 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5067b-fd32-4500-b098-857cd40498f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:32.422096 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5067b-fd32-4500-b098-857cd40498f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:32.422443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5067b-fd32-4500-b098-857cd40498f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:32.422784 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5067b-fd32-4500-b098-857cd40498f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:32.423636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5067b-fd32-4500-b098-857cd40498f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:32.425609 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5067b-fd32-4500-b098-857cd40498f3 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:32.428911 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:32.515943 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1304/2579] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:32 2022] POST /identity/v3/projects => generated 379 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:32.520882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c5d7b-edee-48a7-8918-816f664f4bb0 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:32.532141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c5d7b-edee-48a7-8918-816f664f4bb0 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:32.594505 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71825d-4faf-40cd-bc1b-07ef2a2c4c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:32.595152 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71825d-4faf-40cd-bc1b-07ef2a2c4c49 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:32.595436 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71825d-4faf-40cd-bc1b-07ef2a2c4c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:32.595722 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71825d-4faf-40cd-bc1b-07ef2a2c4c49 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:32.596417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71825d-4faf-40cd-bc1b-07ef2a2c4c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:32.598341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71825d-4faf-40cd-bc1b-07ef2a2c4c49 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:32.690655 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1276/2580] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:32 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:32.691950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5067b-fd32-4500-b098-857cd40498f3 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:32.702629 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5067b-fd32-4500-b098-857cd40498f3 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:32.711174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eefa9-4b12-44cf-a8be-a72b956cdba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:32.711174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eefa9-4b12-44cf-a8be-a72b956cdba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:32.711174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eefa9-4b12-44cf-a8be-a72b956cdba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:32.711174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eefa9-4b12-44cf-a8be-a72b956cdba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:32.711559 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80eefa9-4b12-44cf-a8be-a72b956cdba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:32.711559 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80eefa9-4b12-44cf-a8be-a72b956cdba4 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:32.721630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1305/2581] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:32.725916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71825d-4faf-40cd-bc1b-07ef2a2c4c49 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:32.736648 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71825d-4faf-40cd-bc1b-07ef2a2c4c49 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:32.741219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da5ac7-d1c7-4314-9e74-cc0c97ca4243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:32.741874 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da5ac7-d1c7-4314-9e74-cc0c97ca4243 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:32.742182 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da5ac7-d1c7-4314-9e74-cc0c97ca4243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:32.742460 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da5ac7-d1c7-4314-9e74-cc0c97ca4243 admin admin] PATH_INFO: `/v3/projects/1f46b0c041754d88b7e5ff623b5d2cb0/users/81038f98b09f4ea78e45fc2c40c92493/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:32.758271 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da5ac7-d1c7-4314-9e74-cc0c97ca4243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f46b0c041754d88b7e5ff623b5d2cb0, user_id=81038f98b09f4ea78e45fc2c40c92493, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:32.761118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da5ac7-d1c7-4314-9e74-cc0c97ca4243 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:32.830423 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1277/2582] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:32 2022] PUT /identity/v3/projects/1f46b0c041754d88b7e5ff623b5d2cb0/users/81038f98b09f4ea78e45fc2c40c92493/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:32.834473 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eefa9-4b12-44cf-a8be-a72b956cdba4 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:32.848437 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eefa9-4b12-44cf-a8be-a72b956cdba4 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:32.907321 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb6e07-8f16-49d3-9865-c436cc73750b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:32.908651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb6e07-8f16-49d3-9865-c436cc73750b admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:32.908926 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb6e07-8f16-49d3-9865-c436cc73750b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:32.909197 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb6e07-8f16-49d3-9865-c436cc73750b admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:32.909824 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb6e07-8f16-49d3-9865-c436cc73750b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:32.911504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb6e07-8f16-49d3-9865-c436cc73750b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:32.922835 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1306/2583] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:43:32.927176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da5ac7-d1c7-4314-9e74-cc0c97ca4243 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:32.938742 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da5ac7-d1c7-4314-9e74-cc0c97ca4243 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:32.944044 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870ff21-fcd0-4cb1-934b-71083775ed8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:32.945069 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870ff21-fcd0-4cb1-934b-71083775ed8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:32.945311 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870ff21-fcd0-4cb1-934b-71083775ed8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:32.945591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870ff21-fcd0-4cb1-934b-71083775ed8a admin admin] PATH_INFO: `/v3/projects/1f46b0c041754d88b7e5ff623b5d2cb0/users/81038f98b09f4ea78e45fc2c40c92493/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:32.947582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870ff21-fcd0-4cb1-934b-71083775ed8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f46b0c041754d88b7e5ff623b5d2cb0, user_id=81038f98b09f4ea78e45fc2c40c92493, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:32.950246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870ff21-fcd0-4cb1-934b-71083775ed8a admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:32.961773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1278/2584] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:32 2022] PUT /identity/v3/projects/1f46b0c041754d88b7e5ff623b5d2cb0/users/81038f98b09f4ea78e45fc2c40c92493/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:32.972362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6699-233b-47c5-924a-fd29e96076af None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:32.972679 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6699-233b-47c5-924a-fd29e96076af None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:32.972958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6699-233b-47c5-924a-fd29e96076af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:33.003113 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-0f0e6699-233b-47c5-924a-fd29e96076af None None] MFA Rules not processed for user `81038f98b09f4ea78e45fc2c40c92493`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:33.004439 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0f0e6699-233b-47c5-924a-fd29e96076af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:33.056567 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:33.075973 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1307/2585] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:33.088715 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870ff21-fcd0-4cb1-934b-71083775ed8a admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:33.090531 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-0870ff21-fcd0-4cb1-934b-71083775ed8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:33.144376 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:33.149577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870ff21-fcd0-4cb1-934b-71083775ed8a admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:33.156249 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81930fe-4cbb-4529-92f0-ae21a5a3ed07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:33.156249 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81930fe-4cbb-4529-92f0-ae21a5a3ed07 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:33.156249 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81930fe-4cbb-4529-92f0-ae21a5a3ed07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:33.156249 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81930fe-4cbb-4529-92f0-ae21a5a3ed07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:33.163987 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81930fe-4cbb-4529-92f0-ae21a5a3ed07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:33.165589 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81930fe-4cbb-4529-92f0-ae21a5a3ed07 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:33.175699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1279/2586] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:33.331000 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e6699-233b-47c5-924a-fd29e96076af None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:33.332427 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0f0e6699-233b-47c5-924a-fd29e96076af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:33.343979 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e6699-233b-47c5-924a-fd29e96076af None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:33.347554 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a4733-1672-4c41-b4a6-444d0db49e99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:33.348140 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a4733-1672-4c41-b4a6-444d0db49e99 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:33.353430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a4733-1672-4c41-b4a6-444d0db49e99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:33.353430 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a4733-1672-4c41-b4a6-444d0db49e99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:33.404148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a4733-1672-4c41-b4a6-444d0db49e99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:33.405710 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a4733-1672-4c41-b4a6-444d0db49e99 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:33.414290 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1308/2587] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:35.415972 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81930fe-4cbb-4529-92f0-ae21a5a3ed07 service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:35.424041 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-e81930fe-4cbb-4529-92f0-ae21a5a3ed07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:35.474495 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81930fe-4cbb-4529-92f0-ae21a5a3ed07 service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:35.478138 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8718de4-dbc3-4b23-91bf-5795e0d6de17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:35.478734 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8718de4-dbc3-4b23-91bf-5795e0d6de17 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:35.479063 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8718de4-dbc3-4b23-91bf-5795e0d6de17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:35.479338 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8718de4-dbc3-4b23-91bf-5795e0d6de17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:35.481118 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b8718de4-dbc3-4b23-91bf-5795e0d6de17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:35.546865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8718de4-dbc3-4b23-91bf-5795e0d6de17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:35.548216 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8718de4-dbc3-4b23-91bf-5795e0d6de17 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:35.558147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1280/2588] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:37.746543 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a4733-1672-4c41-b4a6-444d0db49e99 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:37.759126 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a4733-1672-4c41-b4a6-444d0db49e99 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:37.764052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47170c0b-6244-4baf-86c6-cc00ee3f16f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:37.765095 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47170c0b-6244-4baf-86c6-cc00ee3f16f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:37.765562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47170c0b-6244-4baf-86c6-cc00ee3f16f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:37.766042 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47170c0b-6244-4baf-86c6-cc00ee3f16f6 admin admin] PATH_INFO: `/v3/users/a4be4796e7a84fa7bee01e3bdb87247a` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:37.767344 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47170c0b-6244-4baf-86c6-cc00ee3f16f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4be4796e7a84fa7bee01e3bdb87247a)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:37.770135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47170c0b-6244-4baf-86c6-cc00ee3f16f6 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:37.991386 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-47170c0b-6244-4baf-86c6-cc00ee3f16f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4be4796e7a84fa7bee01e3bdb87247a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:37.992281 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-47170c0b-6244-4baf-86c6-cc00ee3f16f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4be4796e7a84fa7bee01e3bdb87247a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:38.004184 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-47170c0b-6244-4baf-86c6-cc00ee3f16f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4be4796e7a84fa7bee01e3bdb87247a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:38.085501 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-47170c0b-6244-4baf-86c6-cc00ee3f16f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4be4796e7a84fa7bee01e3bdb87247a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:38.086065 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-47170c0b-6244-4baf-86c6-cc00ee3f16f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4be4796e7a84fa7bee01e3bdb87247a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:38.099871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1309/2589] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:43:37 2022] DELETE /identity/v3/users/a4be4796e7a84fa7bee01e3bdb87247a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:38.104501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb52fd5-0297-4b41-82bf-5fe01f91419c None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:38.104998 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb52fd5-0297-4b41-82bf-5fe01f91419c None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:38.105110 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb52fd5-0297-4b41-82bf-5fe01f91419c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:38.141725 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-abb52fd5-0297-4b41-82bf-5fe01f91419c None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:38.143293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-abb52fd5-0297-4b41-82bf-5fe01f91419c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:38.244159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1281/2590] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:43:38.252004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47170c0b-6244-4baf-86c6-cc00ee3f16f6 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:38.257960 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-47170c0b-6244-4baf-86c6-cc00ee3f16f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:38.342451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47170c0b-6244-4baf-86c6-cc00ee3f16f6 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:38.346399 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dbefc-d437-4574-9fe0-291a4bff06c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:38.347276 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dbefc-d437-4574-9fe0-291a4bff06c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:38.347540 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dbefc-d437-4574-9fe0-291a4bff06c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:38.347811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dbefc-d437-4574-9fe0-291a4bff06c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:38.357386 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dbefc-d437-4574-9fe0-291a4bff06c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:38.359506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dbefc-d437-4574-9fe0-291a4bff06c3 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:38.368935 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1310/2591] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:39.192745 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb52fd5-0297-4b41-82bf-5fe01f91419c None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:39.194334 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-abb52fd5-0297-4b41-82bf-5fe01f91419c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:39.213147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb52fd5-0297-4b41-82bf-5fe01f91419c None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:39.218390 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5cdb3-43a2-4bdd-b036-73ebf29c6a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:39.219059 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5cdb3-43a2-4bdd-b036-73ebf29c6a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:39.219563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5cdb3-43a2-4bdd-b036-73ebf29c6a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:39.219843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5cdb3-43a2-4bdd-b036-73ebf29c6a65 admin admin] PATH_INFO: `/v3/projects/b37885f52a774f0cbbbbdbe5b7c32acf` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:39.221367 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5cdb3-43a2-4bdd-b036-73ebf29c6a65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b37885f52a774f0cbbbbdbe5b7c32acf)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:39.223822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5cdb3-43a2-4bdd-b036-73ebf29c6a65 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:39.364690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:39.373569 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-04a5cdb3-43a2-4bdd-b036-73ebf29c6a65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b37885f52a774f0cbbbbdbe5b7c32acf', 'request_id': 'req-04a5cdb3-43a2-4bdd-b036-73ebf29c6a65'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:39.380779 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-04a5cdb3-43a2-4bdd-b036-73ebf29c6a65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b37885f52a774f0cbbbbdbe5b7c32acf', 'request_id': 'req-04a5cdb3-43a2-4bdd-b036-73ebf29c6a65'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:39.480086 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-04a5cdb3-43a2-4bdd-b036-73ebf29c6a65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b37885f52a774f0cbbbbdbe5b7c32acf', 'request_id': 'req-04a5cdb3-43a2-4bdd-b036-73ebf29c6a65'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:39.492076 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-04a5cdb3-43a2-4bdd-b036-73ebf29c6a65 admin admin] The token cache is being invalidate because project b37885f52a774f0cbbbbdbe5b7c32acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:43:39.492472 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-04a5cdb3-43a2-4bdd-b036-73ebf29c6a65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:39.493125 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-04a5cdb3-43a2-4bdd-b036-73ebf29c6a65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:39.494617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1282/2592] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:43:39 2022] DELETE /identity/v3/projects/b37885f52a774f0cbbbbdbe5b7c32acf => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:39.498671 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dbefc-d437-4574-9fe0-291a4bff06c3 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:39.504179 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:39.511090 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dbefc-d437-4574-9fe0-291a4bff06c3 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:39.515610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5cdb3-43a2-4bdd-b036-73ebf29c6a65 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:39.517041 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-04a5cdb3-43a2-4bdd-b036-73ebf29c6a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:39.585864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5fcb9-8f63-4e4a-b56c-5c31a7ef9717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:39.586735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5fcb9-8f63-4e4a-b56c-5c31a7ef9717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:39.586856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5fcb9-8f63-4e4a-b56c-5c31a7ef9717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:39.587208 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5fcb9-8f63-4e4a-b56c-5c31a7ef9717 admin admin] PATH_INFO: `/v3/users/f6ba3d34260f4ad394b0816624a008de` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:39.589384 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5fcb9-8f63-4e4a-b56c-5c31a7ef9717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ba3d34260f4ad394b0816624a008de)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:39.592435 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5fcb9-8f63-4e4a-b56c-5c31a7ef9717 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:39.599823 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5cdb3-43a2-4bdd-b036-73ebf29c6a65 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:39.606515 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b60464-3152-4553-ae17-a1d3d0035961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:39.607168 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b60464-3152-4553-ae17-a1d3d0035961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:39.607454 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b60464-3152-4553-ae17-a1d3d0035961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:39.607764 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b60464-3152-4553-ae17-a1d3d0035961 admin admin] PATH_INFO: `/v3/users/55a1961b3af6490d9a615e2d907365e9` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:39.608955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b60464-3152-4553-ae17-a1d3d0035961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55a1961b3af6490d9a615e2d907365e9)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:39.611086 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b60464-3152-4553-ae17-a1d3d0035961 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:39.768027 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-95b5fcb9-8f63-4e4a-b56c-5c31a7ef9717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ba3d34260f4ad394b0816624a008de'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:39.768788 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-95b5fcb9-8f63-4e4a-b56c-5c31a7ef9717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ba3d34260f4ad394b0816624a008de'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:39.781568 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-95b5fcb9-8f63-4e4a-b56c-5c31a7ef9717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ba3d34260f4ad394b0816624a008de'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:39.799692 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-02b60464-3152-4553-ae17-a1d3d0035961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55a1961b3af6490d9a615e2d907365e9'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:39.800408 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-02b60464-3152-4553-ae17-a1d3d0035961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55a1961b3af6490d9a615e2d907365e9'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:39.812365 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-02b60464-3152-4553-ae17-a1d3d0035961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55a1961b3af6490d9a615e2d907365e9'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:39.857428 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-95b5fcb9-8f63-4e4a-b56c-5c31a7ef9717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ba3d34260f4ad394b0816624a008de'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:39.858007 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-95b5fcb9-8f63-4e4a-b56c-5c31a7ef9717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ba3d34260f4ad394b0816624a008de'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:39.872078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1311/2593] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:43:39 2022] DELETE /identity/v3/users/f6ba3d34260f4ad394b0816624a008de => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:39.914656 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-02b60464-3152-4553-ae17-a1d3d0035961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55a1961b3af6490d9a615e2d907365e9'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:39.915372 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-02b60464-3152-4553-ae17-a1d3d0035961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55a1961b3af6490d9a615e2d907365e9'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:39.929165 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1283/2594] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:43:39 2022] DELETE /identity/v3/users/55a1961b3af6490d9a615e2d907365e9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:40.204045 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5fcb9-8f63-4e4a-b56c-5c31a7ef9717 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:40.205597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-95b5fcb9-8f63-4e4a-b56c-5c31a7ef9717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:40.273523 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5fcb9-8f63-4e4a-b56c-5c31a7ef9717 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:40.299724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:40.329137 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4de52b-b641-48c5-a6f5-4867ce17927a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:40.329761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4de52b-b641-48c5-a6f5-4867ce17927a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:40.330035 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4de52b-b641-48c5-a6f5-4867ce17927a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:40.330314 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4de52b-b641-48c5-a6f5-4867ce17927a admin admin] PATH_INFO: `/v3/projects/0fa3ce34554c4a44bc9e3cdc0cc4a2d1` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:40.331943 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4de52b-b641-48c5-a6f5-4867ce17927a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa3ce34554c4a44bc9e3cdc0cc4a2d1)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:40.333855 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4de52b-b641-48c5-a6f5-4867ce17927a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:40.367774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b60464-3152-4553-ae17-a1d3d0035961 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:40.369282 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-02b60464-3152-4553-ae17-a1d3d0035961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:40.388171 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b60464-3152-4553-ae17-a1d3d0035961 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:40.392813 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62965f0e-6a09-4a8e-81cc-2625f7b0722d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:40.393448 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62965f0e-6a09-4a8e-81cc-2625f7b0722d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:40.393723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62965f0e-6a09-4a8e-81cc-2625f7b0722d admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:40.394493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62965f0e-6a09-4a8e-81cc-2625f7b0722d admin admin] PATH_INFO: `/v3/projects/34d8a119ef2942dda72ad9dbefba1ab6` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:40.395719 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62965f0e-6a09-4a8e-81cc-2625f7b0722d admin admin] RBAC: Authorizing `identity:delete_project(project_id=34d8a119ef2942dda72ad9dbefba1ab6)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:40.397569 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62965f0e-6a09-4a8e-81cc-2625f7b0722d admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:40.503337 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5e4de52b-b641-48c5-a6f5-4867ce17927a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa3ce34554c4a44bc9e3cdc0cc4a2d1', 'request_id': 'req-5e4de52b-b641-48c5-a6f5-4867ce17927a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:40.509471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5e4de52b-b641-48c5-a6f5-4867ce17927a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa3ce34554c4a44bc9e3cdc0cc4a2d1', 'request_id': 'req-5e4de52b-b641-48c5-a6f5-4867ce17927a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:40.535819 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:40.544301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-62965f0e-6a09-4a8e-81cc-2625f7b0722d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34d8a119ef2942dda72ad9dbefba1ab6', 'request_id': 'req-62965f0e-6a09-4a8e-81cc-2625f7b0722d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:40.551800 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-62965f0e-6a09-4a8e-81cc-2625f7b0722d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34d8a119ef2942dda72ad9dbefba1ab6', 'request_id': 'req-62965f0e-6a09-4a8e-81cc-2625f7b0722d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:40.594704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5e4de52b-b641-48c5-a6f5-4867ce17927a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa3ce34554c4a44bc9e3cdc0cc4a2d1', 'request_id': 'req-5e4de52b-b641-48c5-a6f5-4867ce17927a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:40.605566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5e4de52b-b641-48c5-a6f5-4867ce17927a admin admin] The token cache is being invalidate because project 0fa3ce34554c4a44bc9e3cdc0cc4a2d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:43:40.605859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5e4de52b-b641-48c5-a6f5-4867ce17927a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:40.606548 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5e4de52b-b641-48c5-a6f5-4867ce17927a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:40.608037 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1312/2595] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:43:40 2022] DELETE /identity/v3/projects/0fa3ce34554c4a44bc9e3cdc0cc4a2d1 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:40.612723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2c7c0-d04f-4884-8c4c-ffc09c6ad558 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:40.613006 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2c7c0-d04f-4884-8c4c-ffc09c6ad558 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:40.613283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2c7c0-d04f-4884-8c4c-ffc09c6ad558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:40.633601 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-bca2c7c0-d04f-4884-8c4c-ffc09c6ad558 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:40.634708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-bca2c7c0-d04f-4884-8c4c-ffc09c6ad558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:40.686763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-62965f0e-6a09-4a8e-81cc-2625f7b0722d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34d8a119ef2942dda72ad9dbefba1ab6', 'request_id': 'req-62965f0e-6a09-4a8e-81cc-2625f7b0722d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:40.694552 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1313/2596] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:43:40.698681 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-62965f0e-6a09-4a8e-81cc-2625f7b0722d admin admin] The token cache is being invalidate because project 34d8a119ef2942dda72ad9dbefba1ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:43:40.698971 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-62965f0e-6a09-4a8e-81cc-2625f7b0722d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:40.699596 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-62965f0e-6a09-4a8e-81cc-2625f7b0722d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:40.701495 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1284/2597] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:43:40 2022] DELETE /identity/v3/projects/34d8a119ef2942dda72ad9dbefba1ab6 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:40.702816 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c397e-b777-47b2-845f-b16d4c421e8f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:40.703122 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c397e-b777-47b2-845f-b16d4c421e8f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:40.703398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c397e-b777-47b2-845f-b16d4c421e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:40.705030 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62965f0e-6a09-4a8e-81cc-2625f7b0722d admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:40.706339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-62965f0e-6a09-4a8e-81cc-2625f7b0722d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:40.719344 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62965f0e-6a09-4a8e-81cc-2625f7b0722d admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:40.723715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-118c397e-b777-47b2-845f-b16d4c421e8f None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:40.723927 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9356cb1-ff83-439b-a75c-b622fe4bb891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:40.724662 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9356cb1-ff83-439b-a75c-b622fe4bb891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:40.724929 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-118c397e-b777-47b2-845f-b16d4c421e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:40.725033 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9356cb1-ff83-439b-a75c-b622fe4bb891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:40.725232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9356cb1-ff83-439b-a75c-b622fe4bb891 admin admin] PATH_INFO: `/v3/users/81038f98b09f4ea78e45fc2c40c92493` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:40.726406 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9356cb1-ff83-439b-a75c-b622fe4bb891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81038f98b09f4ea78e45fc2c40c92493)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:40.728344 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9356cb1-ff83-439b-a75c-b622fe4bb891 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:40.732856 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1314/2598] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:43:40.737100 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c397e-b777-47b2-845f-b16d4c421e8f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:40.746192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c397e-b777-47b2-845f-b16d4c421e8f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:40.758185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf41eb-4eb6-4113-8fd2-1a1a800cb89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:40.758185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf41eb-4eb6-4113-8fd2-1a1a800cb89a admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:40.758185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf41eb-4eb6-4113-8fd2-1a1a800cb89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:40.758185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf41eb-4eb6-4113-8fd2-1a1a800cb89a admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:40.758606 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf41eb-4eb6-4113-8fd2-1a1a800cb89a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:43:40.758606 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf41eb-4eb6-4113-8fd2-1a1a800cb89a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:40.758606 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf41eb-4eb6-4113-8fd2-1a1a800cb89a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:40.766673 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1315/2599] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:43:40.771767 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf41eb-4eb6-4113-8fd2-1a1a800cb89a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:40.783554 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf41eb-4eb6-4113-8fd2-1a1a800cb89a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:40.790072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac1dcb-e5d1-4af5-a2e0-e84e19d9ee94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:40.791013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac1dcb-e5d1-4af5-a2e0-e84e19d9ee94 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:40.791410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac1dcb-e5d1-4af5-a2e0-e84e19d9ee94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:40.791725 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac1dcb-e5d1-4af5-a2e0-e84e19d9ee94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:40.792569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac1dcb-e5d1-4af5-a2e0-e84e19d9ee94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:40.794659 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac1dcb-e5d1-4af5-a2e0-e84e19d9ee94 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:40.887746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1316/2600] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:40 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:43:40.892044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac1dcb-e5d1-4af5-a2e0-e84e19d9ee94 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:40.911842 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:40.953373 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac1dcb-e5d1-4af5-a2e0-e84e19d9ee94 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:40.958629 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d8fc3-1ad5-4d3f-a910-02ea2475a456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:40.959251 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d8fc3-1ad5-4d3f-a910-02ea2475a456 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:40.959534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d8fc3-1ad5-4d3f-a910-02ea2475a456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:40.959814 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d8fc3-1ad5-4d3f-a910-02ea2475a456 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:40.960471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d8fc3-1ad5-4d3f-a910-02ea2475a456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:40.962389 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d8fc3-1ad5-4d3f-a910-02ea2475a456 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:40.963375 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-b9356cb1-ff83-439b-a75c-b622fe4bb891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81038f98b09f4ea78e45fc2c40c92493'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:40.964064 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-b9356cb1-ff83-439b-a75c-b622fe4bb891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81038f98b09f4ea78e45fc2c40c92493'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:40.976963 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-b9356cb1-ff83-439b-a75c-b622fe4bb891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81038f98b09f4ea78e45fc2c40c92493'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:41.063060 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1317/2601] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:40 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:43:41.067820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d8fc3-1ad5-4d3f-a910-02ea2475a456 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:41.069453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d56d8fc3-1ad5-4d3f-a910-02ea2475a456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:41.080026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-b9356cb1-ff83-439b-a75c-b622fe4bb891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81038f98b09f4ea78e45fc2c40c92493'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:41.080855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-b9356cb1-ff83-439b-a75c-b622fe4bb891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81038f98b09f4ea78e45fc2c40c92493'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:41.081535 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d8fc3-1ad5-4d3f-a910-02ea2475a456 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:41.086300 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f9f16-ed50-425f-ad71-9581fdd60c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:41.092807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f9f16-ed50-425f-ad71-9581fdd60c44 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:41.092807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f9f16-ed50-425f-ad71-9581fdd60c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:41.092807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f9f16-ed50-425f-ad71-9581fdd60c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:41.092807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f9f16-ed50-425f-ad71-9581fdd60c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:41.092807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f9f16-ed50-425f-ad71-9581fdd60c44 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:41.094123 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1285/2602] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:43:40 2022] DELETE /identity/v3/users/81038f98b09f4ea78e45fc2c40c92493 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:41.102432 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1318/2603] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:43:41.103778 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9356cb1-ff83-439b-a75c-b622fe4bb891 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:41.171583 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9356cb1-ff83-439b-a75c-b622fe4bb891 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:41.176673 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59135a-6e47-4d42-8fd1-97e2df1022ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:41.177301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59135a-6e47-4d42-8fd1-97e2df1022ed admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:41.177577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59135a-6e47-4d42-8fd1-97e2df1022ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:41.177863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59135a-6e47-4d42-8fd1-97e2df1022ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:41.178636 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59135a-6e47-4d42-8fd1-97e2df1022ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:41.180288 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59135a-6e47-4d42-8fd1-97e2df1022ed admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:41.191567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1286/2604] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:41.196619 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f9f16-ed50-425f-ad71-9581fdd60c44 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:41.208322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59135a-6e47-4d42-8fd1-97e2df1022ed admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:41.209803 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f9f16-ed50-425f-ad71-9581fdd60c44 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:41.210519 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-fa59135a-6e47-4d42-8fd1-97e2df1022ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:41.214619 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5103f3-dc4f-44e5-b08d-1278c8911138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:41.215434 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5103f3-dc4f-44e5-b08d-1278c8911138 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:41.215715 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5103f3-dc4f-44e5-b08d-1278c8911138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:41.215989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5103f3-dc4f-44e5-b08d-1278c8911138 admin admin] PATH_INFO: `/v3/projects/b818e75335cc4cc1b69cdd09467a62ab/users/2ebb30c7d41f4a37b6f5cd4343f161f5/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:41.223896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59135a-6e47-4d42-8fd1-97e2df1022ed admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:41.229355 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe63a41-3c74-4805-8a5c-8dfcc94a6be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:41.230119 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe63a41-3c74-4805-8a5c-8dfcc94a6be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:41.230502 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe63a41-3c74-4805-8a5c-8dfcc94a6be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:41.230790 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe63a41-3c74-4805-8a5c-8dfcc94a6be6 admin admin] PATH_INFO: `/v3/users/bb2d0223971e4062b13922935a8de08a` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:41.231754 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5103f3-dc4f-44e5-b08d-1278c8911138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b818e75335cc4cc1b69cdd09467a62ab, user_id=2ebb30c7d41f4a37b6f5cd4343f161f5, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:41.231970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe63a41-3c74-4805-8a5c-8dfcc94a6be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb2d0223971e4062b13922935a8de08a)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:41.234039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe63a41-3c74-4805-8a5c-8dfcc94a6be6 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:41.235485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5103f3-dc4f-44e5-b08d-1278c8911138 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:41.320261 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1319/2605] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:41 2022] PUT /identity/v3/projects/b818e75335cc4cc1b69cdd09467a62ab/users/2ebb30c7d41f4a37b6f5cd4343f161f5/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:41.331524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ae50e-0ec3-477a-b22d-3fe9154ef408 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:41.331809 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ae50e-0ec3-477a-b22d-3fe9154ef408 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:41.332115 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ae50e-0ec3-477a-b22d-3fe9154ef408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:41.346448 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:41.361855 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-539ae50e-0ec3-477a-b22d-3fe9154ef408 None None] MFA Rules not processed for user `2ebb30c7d41f4a37b6f5cd4343f161f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:41.363081 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-539ae50e-0ec3-477a-b22d-3fe9154ef408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:41.428524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1320/2606] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:43:41.432832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ae50e-0ec3-477a-b22d-3fe9154ef408 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:41.493260 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ae50e-0ec3-477a-b22d-3fe9154ef408 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:41.497887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13c66d-5a22-4e95-9658-723cef059764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:41.498482 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13c66d-5a22-4e95-9658-723cef059764 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:41.498760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13c66d-5a22-4e95-9658-723cef059764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:41.499032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13c66d-5a22-4e95-9658-723cef059764 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:41.499653 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13c66d-5a22-4e95-9658-723cef059764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:41.501591 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13c66d-5a22-4e95-9658-723cef059764 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:41.591352 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-7fe63a41-3c74-4805-8a5c-8dfcc94a6be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb2d0223971e4062b13922935a8de08a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:41.592538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-7fe63a41-3c74-4805-8a5c-8dfcc94a6be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb2d0223971e4062b13922935a8de08a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:41.605925 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-7fe63a41-3c74-4805-8a5c-8dfcc94a6be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb2d0223971e4062b13922935a8de08a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:41.711411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1321/2607] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:41 2022] POST /identity/v3/projects => generated 373 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:43:41.712168 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13c66d-5a22-4e95-9658-723cef059764 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:41.713775 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-df13c66d-5a22-4e95-9658-723cef059764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:41.715775 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-7fe63a41-3c74-4805-8a5c-8dfcc94a6be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb2d0223971e4062b13922935a8de08a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:41.716434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-7fe63a41-3c74-4805-8a5c-8dfcc94a6be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb2d0223971e4062b13922935a8de08a'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:41.729871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1287/2608] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:43:41 2022] DELETE /identity/v3/users/bb2d0223971e4062b13922935a8de08a => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:41.730658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe63a41-3c74-4805-8a5c-8dfcc94a6be6 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:41.731960 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-7fe63a41-3c74-4805-8a5c-8dfcc94a6be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:41.779670 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13c66d-5a22-4e95-9658-723cef059764 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:41.791974 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:41.852089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db8b4d-feaf-4c8e-bb6a-66b8ca99098c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:41.852785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db8b4d-feaf-4c8e-bb6a-66b8ca99098c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:41.853059 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db8b4d-feaf-4c8e-bb6a-66b8ca99098c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:41.853329 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db8b4d-feaf-4c8e-bb6a-66b8ca99098c admin admin] PATH_INFO: `/v3/projects/1f46b0c041754d88b7e5ff623b5d2cb0` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:41.854496 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db8b4d-feaf-4c8e-bb6a-66b8ca99098c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f46b0c041754d88b7e5ff623b5d2cb0)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:41.856474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db8b4d-feaf-4c8e-bb6a-66b8ca99098c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:41.918883 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe63a41-3c74-4805-8a5c-8dfcc94a6be6 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:41.923450 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db0b44-798a-4d98-9b4b-7103c228b8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:41.924047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db0b44-798a-4d98-9b4b-7103c228b8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:41.924575 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db0b44-798a-4d98-9b4b-7103c228b8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:41.924764 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db0b44-798a-4d98-9b4b-7103c228b8b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:41.925315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db0b44-798a-4d98-9b4b-7103c228b8b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:41.927247 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db0b44-798a-4d98-9b4b-7103c228b8b0 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:41.960875 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-52db8b4d-feaf-4c8e-bb6a-66b8ca99098c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f46b0c041754d88b7e5ff623b5d2cb0', 'request_id': 'req-52db8b4d-feaf-4c8e-bb6a-66b8ca99098c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:41.967597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-52db8b4d-feaf-4c8e-bb6a-66b8ca99098c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f46b0c041754d88b7e5ff623b5d2cb0', 'request_id': 'req-52db8b4d-feaf-4c8e-bb6a-66b8ca99098c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:42.023983 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1288/2609] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:41 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:42.028473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877eec8-9ae8-4245-93fe-665579d9c02a None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:42.028473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877eec8-9ae8-4245-93fe-665579d9c02a None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:42.028473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877eec8-9ae8-4245-93fe-665579d9c02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:42.044987 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-c877eec8-9ae8-4245-93fe-665579d9c02a None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:42.051316 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c877eec8-9ae8-4245-93fe-665579d9c02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:42.051449 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-52db8b4d-feaf-4c8e-bb6a-66b8ca99098c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f46b0c041754d88b7e5ff623b5d2cb0', 'request_id': 'req-52db8b4d-feaf-4c8e-bb6a-66b8ca99098c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:42.058339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-52db8b4d-feaf-4c8e-bb6a-66b8ca99098c admin admin] The token cache is being invalidate because project 1f46b0c041754d88b7e5ff623b5d2cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:43:42.058694 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-52db8b4d-feaf-4c8e-bb6a-66b8ca99098c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:42.059317 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-52db8b4d-feaf-4c8e-bb6a-66b8ca99098c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:42.060833 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1322/2610] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:43:41 2022] DELETE /identity/v3/projects/1f46b0c041754d88b7e5ff623b5d2cb0 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:42.061630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db8b4d-feaf-4c8e-bb6a-66b8ca99098c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:42.062931 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-52db8b4d-feaf-4c8e-bb6a-66b8ca99098c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:42.110922 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1289/2611] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:42.112164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef5498-c568-4683-bf39-79f6cc9d5060 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:42.112574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef5498-c568-4683-bf39-79f6cc9d5060 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:42.112947 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef5498-c568-4683-bf39-79f6cc9d5060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:42.132855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-09ef5498-c568-4683-bf39-79f6cc9d5060 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:42.134119 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-09ef5498-c568-4683-bf39-79f6cc9d5060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:42.136059 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db8b4d-feaf-4c8e-bb6a-66b8ca99098c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:42.141855 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ee0f1-caf6-466d-a3f2-c878b196f44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:42.141855 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ee0f1-caf6-466d-a3f2-c878b196f44d admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:42.141855 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ee0f1-caf6-466d-a3f2-c878b196f44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:42.141855 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ee0f1-caf6-466d-a3f2-c878b196f44d admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:42.142398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1290/2612] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:42.149723 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ee0f1-caf6-466d-a3f2-c878b196f44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:42.149869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef5498-c568-4683-bf39-79f6cc9d5060 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:42.149971 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ee0f1-caf6-466d-a3f2-c878b196f44d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:42.150079 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-09ef5498-c568-4683-bf39-79f6cc9d5060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:42.156783 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1323/2613] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:42.157946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf8404-25a4-4568-b574-84c164f1b98d None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:42.158252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf8404-25a4-4568-b574-84c164f1b98d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:42.158584 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf8404-25a4-4568-b574-84c164f1b98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:42.177927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b8cf8404-25a4-4568-b574-84c164f1b98d None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:42.179119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b8cf8404-25a4-4568-b574-84c164f1b98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:42.187503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1324/2614] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:42.188454 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf8404-25a4-4568-b574-84c164f1b98d None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:42.198880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf8404-25a4-4568-b574-84c164f1b98d None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:42.203660 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967388ad-20f9-42ec-b737-80b7c5a92a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:42.204298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967388ad-20f9-42ec-b737-80b7c5a92a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:42.205023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967388ad-20f9-42ec-b737-80b7c5a92a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:42.205023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967388ad-20f9-42ec-b737-80b7c5a92a2a admin admin] PATH_INFO: `/v3/projects/e91e888100bf42fb9892c8a358d6992f/users/b4660ce521994fb8a276887f1a301066/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:42.206965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef5498-c568-4683-bf39-79f6cc9d5060 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:42.211854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a80b0-5d2c-4047-b4dc-ec2b5906a7f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:42.212554 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a80b0-5d2c-4047-b4dc-ec2b5906a7f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:42.212840 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a80b0-5d2c-4047-b4dc-ec2b5906a7f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:42.213113 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a80b0-5d2c-4047-b4dc-ec2b5906a7f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:42.220157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967388ad-20f9-42ec-b737-80b7c5a92a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91e888100bf42fb9892c8a358d6992f, user_id=b4660ce521994fb8a276887f1a301066, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:42.222207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a80b0-5d2c-4047-b4dc-ec2b5906a7f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:42.222917 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967388ad-20f9-42ec-b737-80b7c5a92a2a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:42.223666 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a80b0-5d2c-4047-b4dc-ec2b5906a7f3 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:42.233192 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1291/2615] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:42.234067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a80b0-5d2c-4047-b4dc-ec2b5906a7f3 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:42.243469 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a80b0-5d2c-4047-b4dc-ec2b5906a7f3 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:42.248179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dcf11-558a-43c0-ae6e-677e527218f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:42.248797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dcf11-558a-43c0-ae6e-677e527218f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:42.249076 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dcf11-558a-43c0-ae6e-677e527218f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:42.249354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dcf11-558a-43c0-ae6e-677e527218f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:42.250178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461dcf11-558a-43c0-ae6e-677e527218f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:43:42.250485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461dcf11-558a-43c0-ae6e-677e527218f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:42.252105 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461dcf11-558a-43c0-ae6e-677e527218f1 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:42.264827 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1292/2616] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:43:42.269369 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dcf11-558a-43c0-ae6e-677e527218f1 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:42.276582 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1325/2617] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:42 2022] PUT /identity/v3/projects/e91e888100bf42fb9892c8a358d6992f/users/b4660ce521994fb8a276887f1a301066/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:42.280441 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967388ad-20f9-42ec-b737-80b7c5a92a2a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:42.281466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dcf11-558a-43c0-ae6e-677e527218f1 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:42.295216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:42.346486 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579362f-1e48-418b-bc16-0cbad78191d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:42.347093 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579362f-1e48-418b-bc16-0cbad78191d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:42.347420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579362f-1e48-418b-bc16-0cbad78191d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:42.348648 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579362f-1e48-418b-bc16-0cbad78191d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:42.349344 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579362f-1e48-418b-bc16-0cbad78191d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:42.351378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579362f-1e48-418b-bc16-0cbad78191d0 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:42.354654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967388ad-20f9-42ec-b737-80b7c5a92a2a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:42.359358 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613eac94-4d3a-46d6-8187-3365ac0e1733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:42.359982 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613eac94-4d3a-46d6-8187-3365ac0e1733 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:42.360251 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613eac94-4d3a-46d6-8187-3365ac0e1733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:42.360568 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613eac94-4d3a-46d6-8187-3365ac0e1733 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:42.361215 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613eac94-4d3a-46d6-8187-3365ac0e1733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:42.362798 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613eac94-4d3a-46d6-8187-3365ac0e1733 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:42.372565 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1326/2618] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:43:42.376891 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613eac94-4d3a-46d6-8187-3365ac0e1733 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:42.386770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613eac94-4d3a-46d6-8187-3365ac0e1733 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:42.391485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58be07b-72bc-49a3-b943-8c8ff1850d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:42.392105 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58be07b-72bc-49a3-b943-8c8ff1850d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:42.392473 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58be07b-72bc-49a3-b943-8c8ff1850d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:42.392783 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58be07b-72bc-49a3-b943-8c8ff1850d17 admin admin] PATH_INFO: `/v3/projects/e91e888100bf42fb9892c8a358d6992f/users/b4660ce521994fb8a276887f1a301066/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:42.394694 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58be07b-72bc-49a3-b943-8c8ff1850d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91e888100bf42fb9892c8a358d6992f, user_id=b4660ce521994fb8a276887f1a301066, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:42.397861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58be07b-72bc-49a3-b943-8c8ff1850d17 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:42.408082 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1327/2619] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:42 2022] PUT /identity/v3/projects/e91e888100bf42fb9892c8a358d6992f/users/b4660ce521994fb8a276887f1a301066/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:42.419623 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e21b69-47bd-47b4-8700-7a5a31d529c5 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:42.419889 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e21b69-47bd-47b4-8700-7a5a31d529c5 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:42.421490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e21b69-47bd-47b4-8700-7a5a31d529c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:42.443969 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:42.449478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-25e21b69-47bd-47b4-8700-7a5a31d529c5 None None] MFA Rules not processed for user `b4660ce521994fb8a276887f1a301066`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:42.450630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-25e21b69-47bd-47b4-8700-7a5a31d529c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:42.454745 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1293/2620] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:42 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:43:42.458723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579362f-1e48-418b-bc16-0cbad78191d0 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:42.527901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579362f-1e48-418b-bc16-0cbad78191d0 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:42.532480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1328/2621] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:43:42.533215 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827125a-3334-4256-b228-85efc0452657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:42.533827 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827125a-3334-4256-b228-85efc0452657 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:42.534271 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827125a-3334-4256-b228-85efc0452657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:42.534549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827125a-3334-4256-b228-85efc0452657 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:42.535617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827125a-3334-4256-b228-85efc0452657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:42.537570 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827125a-3334-4256-b228-85efc0452657 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:42.542998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e21b69-47bd-47b4-8700-7a5a31d529c5 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:42.544640 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-25e21b69-47bd-47b4-8700-7a5a31d529c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:42.601550 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e21b69-47bd-47b4-8700-7a5a31d529c5 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:42.605252 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3671cc-8165-41bf-b5e8-fe5f69020a81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:42.605854 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3671cc-8165-41bf-b5e8-fe5f69020a81 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:42.606130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3671cc-8165-41bf-b5e8-fe5f69020a81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:42.606397 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3671cc-8165-41bf-b5e8-fe5f69020a81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:42.615764 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3671cc-8165-41bf-b5e8-fe5f69020a81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:42.623510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3671cc-8165-41bf-b5e8-fe5f69020a81 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:42.626205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1329/2622] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:42.708974 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1294/2623] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:42 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:42.713163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3671cc-8165-41bf-b5e8-fe5f69020a81 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:42.723433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3671cc-8165-41bf-b5e8-fe5f69020a81 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:42.728044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a434f-1114-4991-8c58-01114e2fa47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:42.728699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a434f-1114-4991-8c58-01114e2fa47c admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:42.728983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a434f-1114-4991-8c58-01114e2fa47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:42.729312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a434f-1114-4991-8c58-01114e2fa47c admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:42.730015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a434f-1114-4991-8c58-01114e2fa47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:42.731707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a434f-1114-4991-8c58-01114e2fa47c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:42.746302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1330/2624] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:42.747619 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827125a-3334-4256-b228-85efc0452657 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:42.760883 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a434f-1114-4991-8c58-01114e2fa47c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:42.760883 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-081a434f-1114-4991-8c58-01114e2fa47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:42.765565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827125a-3334-4256-b228-85efc0452657 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:42.771736 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9d302-c85c-4dbd-b949-96c0b3fc4fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:42.772663 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9d302-c85c-4dbd-b949-96c0b3fc4fda admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:42.772941 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9d302-c85c-4dbd-b949-96c0b3fc4fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:42.773209 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9d302-c85c-4dbd-b949-96c0b3fc4fda admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:42.773848 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9d302-c85c-4dbd-b949-96c0b3fc4fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:42.774663 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a434f-1114-4991-8c58-01114e2fa47c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:42.775498 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9d302-c85c-4dbd-b949-96c0b3fc4fda admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:42.779820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ff8a7-5c79-41df-86c1-d75ab8fd8a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:42.780521 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ff8a7-5c79-41df-86c1-d75ab8fd8a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:42.787326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ff8a7-5c79-41df-86c1-d75ab8fd8a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:42.787326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ff8a7-5c79-41df-86c1-d75ab8fd8a1a admin admin] PATH_INFO: `/v3/projects/bd17394419b94ad4917bb14a5247dc1d` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:42.787326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ff8a7-5c79-41df-86c1-d75ab8fd8a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd17394419b94ad4917bb14a5247dc1d)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:42.787326 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ff8a7-5c79-41df-86c1-d75ab8fd8a1a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:42.796290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1295/2625] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:43:42.797247 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9d302-c85c-4dbd-b949-96c0b3fc4fda admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:42.808478 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9d302-c85c-4dbd-b949-96c0b3fc4fda admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:42.813458 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2565a7-6d3b-4591-8b56-0148069ee028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:42.814122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2565a7-6d3b-4591-8b56-0148069ee028 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:42.814402 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2565a7-6d3b-4591-8b56-0148069ee028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:42.814675 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2565a7-6d3b-4591-8b56-0148069ee028 admin admin] PATH_INFO: `/v3/projects/52c0f5f9ec214a7cba38a42d243a14f2/users/8685eef675bb441985a882b2f5e865b0/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:42.829882 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2565a7-6d3b-4591-8b56-0148069ee028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c0f5f9ec214a7cba38a42d243a14f2, user_id=8685eef675bb441985a882b2f5e865b0, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:42.832814 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2565a7-6d3b-4591-8b56-0148069ee028 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:42.938351 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1296/2626] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:42 2022] PUT /identity/v3/projects/52c0f5f9ec214a7cba38a42d243a14f2/users/8685eef675bb441985a882b2f5e865b0/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:42.946664 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2565a7-6d3b-4591-8b56-0148069ee028 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:42.950902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-864ff8a7-5c79-41df-86c1-d75ab8fd8a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd17394419b94ad4917bb14a5247dc1d', 'request_id': 'req-864ff8a7-5c79-41df-86c1-d75ab8fd8a1a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:42.959216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-864ff8a7-5c79-41df-86c1-d75ab8fd8a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd17394419b94ad4917bb14a5247dc1d', 'request_id': 'req-864ff8a7-5c79-41df-86c1-d75ab8fd8a1a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:43.001892 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2565a7-6d3b-4591-8b56-0148069ee028 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:43.025509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-864ff8a7-5c79-41df-86c1-d75ab8fd8a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd17394419b94ad4917bb14a5247dc1d', 'request_id': 'req-864ff8a7-5c79-41df-86c1-d75ab8fd8a1a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:43.037079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-864ff8a7-5c79-41df-86c1-d75ab8fd8a1a admin admin] The token cache is being invalidate because project bd17394419b94ad4917bb14a5247dc1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:43:43.037367 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-864ff8a7-5c79-41df-86c1-d75ab8fd8a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:43.038170 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-864ff8a7-5c79-41df-86c1-d75ab8fd8a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:43.039578 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1331/2627] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:43:42 2022] DELETE /identity/v3/projects/bd17394419b94ad4917bb14a5247dc1d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:43.043979 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b83c0b-0a6b-41bc-b7ec-3295f8e5ede0 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:43.044254 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b83c0b-0a6b-41bc-b7ec-3295f8e5ede0 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:43.044664 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b83c0b-0a6b-41bc-b7ec-3295f8e5ede0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:43.050892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:43.057062 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef14c83-d044-4e3a-a996-752f47463823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:43.057665 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef14c83-d044-4e3a-a996-752f47463823 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:43.057943 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef14c83-d044-4e3a-a996-752f47463823 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:43.058217 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef14c83-d044-4e3a-a996-752f47463823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:43.059943 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-aef14c83-d044-4e3a-a996-752f47463823 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:43.075569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-e9b83c0b-0a6b-41bc-b7ec-3295f8e5ede0 None None] MFA Rules not processed for user `8685eef675bb441985a882b2f5e865b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:43.076793 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e9b83c0b-0a6b-41bc-b7ec-3295f8e5ede0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:43.121284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef14c83-d044-4e3a-a996-752f47463823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:43.122704 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef14c83-d044-4e3a-a996-752f47463823 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:43.131983 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1297/2628] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:43.133050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964136d-ced5-432c-a8c4-0786fdd5e06b None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:43.133373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964136d-ced5-432c-a8c4-0786fdd5e06b None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:43.133644 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964136d-ced5-432c-a8c4-0786fdd5e06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:43.141542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1332/2629] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:43.147059 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b83c0b-0a6b-41bc-b7ec-3295f8e5ede0 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:43.149687 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e9b83c0b-0a6b-41bc-b7ec-3295f8e5ede0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:43.157383 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-6964136d-ced5-432c-a8c4-0786fdd5e06b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:43.158652 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6964136d-ced5-432c-a8c4-0786fdd5e06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:43.182232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:43.221797 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b83c0b-0a6b-41bc-b7ec-3295f8e5ede0 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:43.224317 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1298/2630] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:43.227212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b079c-4487-45d6-985a-e678b3705280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:43.227860 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b079c-4487-45d6-985a-e678b3705280 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:43.228142 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b079c-4487-45d6-985a-e678b3705280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:43.228467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b079c-4487-45d6-985a-e678b3705280 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:43.229096 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b079c-4487-45d6-985a-e678b3705280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:43.231076 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b079c-4487-45d6-985a-e678b3705280 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:43.232289 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60b45c-828d-4eca-bbe8-476f4df6717d None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:43.232686 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60b45c-828d-4eca-bbe8-476f4df6717d None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:43.232976 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60b45c-828d-4eca-bbe8-476f4df6717d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:43.254545 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-dc60b45c-828d-4eca-bbe8-476f4df6717d None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:43.255670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-dc60b45c-828d-4eca-bbe8-476f4df6717d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:43.263684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1299/2631] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:43.267879 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60b45c-828d-4eca-bbe8-476f4df6717d None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:43.277114 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60b45c-828d-4eca-bbe8-476f4df6717d None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:43.281753 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ca0aa-f782-4ec4-9a43-4f1af506a1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:43.282321 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ca0aa-f782-4ec4-9a43-4f1af506a1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:43.282598 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ca0aa-f782-4ec4-9a43-4f1af506a1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:43.282869 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ca0aa-f782-4ec4-9a43-4f1af506a1f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:43.283491 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ca0aa-f782-4ec4-9a43-4f1af506a1f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:43:43.283846 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ca0aa-f782-4ec4-9a43-4f1af506a1f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:43.285456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ca0aa-f782-4ec4-9a43-4f1af506a1f9 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:43.297267 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1300/2632] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:43:43.301534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ca0aa-f782-4ec4-9a43-4f1af506a1f9 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:43.310678 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ca0aa-f782-4ec4-9a43-4f1af506a1f9 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:43.315218 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c8779-acfe-4876-b0f5-98d80e82e2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:43.315767 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c8779-acfe-4876-b0f5-98d80e82e2ab admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:43.316046 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c8779-acfe-4876-b0f5-98d80e82e2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:43.316317 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c8779-acfe-4876-b0f5-98d80e82e2ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:43.316989 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c8779-acfe-4876-b0f5-98d80e82e2ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:43.318879 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c8779-acfe-4876-b0f5-98d80e82e2ab admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:43.356762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1333/2633] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:43 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:43:43.361032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b079c-4487-45d6-985a-e678b3705280 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:43.396614 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:43.423702 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b079c-4487-45d6-985a-e678b3705280 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:43.424891 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1301/2634] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:43 2022] POST /identity/v3/projects => generated 407 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:43:43.429117 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c8779-acfe-4876-b0f5-98d80e82e2ab admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:43.452422 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:43.483782 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c905d8-5457-4ad6-8120-dc2463130fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:43.484419 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c905d8-5457-4ad6-8120-dc2463130fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:43.484724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c905d8-5457-4ad6-8120-dc2463130fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:43.484999 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c905d8-5457-4ad6-8120-dc2463130fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:43.485629 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c905d8-5457-4ad6-8120-dc2463130fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:43.487514 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c905d8-5457-4ad6-8120-dc2463130fe6 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:43.496131 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c8779-acfe-4876-b0f5-98d80e82e2ab admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:43.500921 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0afca-6093-454f-b82f-cf53a85c66f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:43.501563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0afca-6093-454f-b82f-cf53a85c66f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:43.501868 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0afca-6093-454f-b82f-cf53a85c66f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:43.502159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0afca-6093-454f-b82f-cf53a85c66f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:43.502859 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0afca-6093-454f-b82f-cf53a85c66f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:43.504989 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0afca-6093-454f-b82f-cf53a85c66f1 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:43.566331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1334/2635] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:43 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:43:43.572473 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c905d8-5457-4ad6-8120-dc2463130fe6 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:43.584593 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c905d8-5457-4ad6-8120-dc2463130fe6 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:43.592675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e44a2-1d34-4304-9629-6d655e5e02ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:43.593557 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e44a2-1d34-4304-9629-6d655e5e02ae admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:43.594176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e44a2-1d34-4304-9629-6d655e5e02ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:43.594598 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e44a2-1d34-4304-9629-6d655e5e02ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:43.595656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e44a2-1d34-4304-9629-6d655e5e02ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:43.597426 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e44a2-1d34-4304-9629-6d655e5e02ae admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:43.610011 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1335/2636] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:43:43.612052 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1302/2637] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:43 2022] POST /identity/v3/users => generated 304 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:43:43.619801 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e44a2-1d34-4304-9629-6d655e5e02ae admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:43.622805 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0afca-6093-454f-b82f-cf53a85c66f1 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:43.630683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e44a2-1d34-4304-9629-6d655e5e02ae admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:43.633494 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0afca-6093-454f-b82f-cf53a85c66f1 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:43.635574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f978d3-331a-41a5-9ae3-0dc86feeed7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:43.636311 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f978d3-331a-41a5-9ae3-0dc86feeed7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:43.636620 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f978d3-331a-41a5-9ae3-0dc86feeed7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:43.636893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f978d3-331a-41a5-9ae3-0dc86feeed7b admin admin] PATH_INFO: `/v3/projects/47f8651173074a5db367c06c1237db17/users/574ec9b6870d4c6781d5ab8a040a61d2/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:43.639258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500d35f-ee39-4243-88b2-5ed70d7f699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:43.645743 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500d35f-ee39-4243-88b2-5ed70d7f699a admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:43.645743 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500d35f-ee39-4243-88b2-5ed70d7f699a admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:43.645743 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500d35f-ee39-4243-88b2-5ed70d7f699a admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:43.645743 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500d35f-ee39-4243-88b2-5ed70d7f699a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:43.645743 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500d35f-ee39-4243-88b2-5ed70d7f699a admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:43.653172 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f978d3-331a-41a5-9ae3-0dc86feeed7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f8651173074a5db367c06c1237db17, user_id=574ec9b6870d4c6781d5ab8a040a61d2, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:43.654294 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1303/2638] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:43:43.655908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f978d3-331a-41a5-9ae3-0dc86feeed7b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:43.658393 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500d35f-ee39-4243-88b2-5ed70d7f699a admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:43.668251 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500d35f-ee39-4243-88b2-5ed70d7f699a admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:43.674195 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd3c3f-202e-43da-a025-c6f8ac6e053a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:43.674195 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd3c3f-202e-43da-a025-c6f8ac6e053a admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:43.674195 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd3c3f-202e-43da-a025-c6f8ac6e053a admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:43.674195 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd3c3f-202e-43da-a025-c6f8ac6e053a admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:43.674675 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd3c3f-202e-43da-a025-c6f8ac6e053a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:43.676263 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd3c3f-202e-43da-a025-c6f8ac6e053a admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:43.686647 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1304/2639] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:43:43.690510 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd3c3f-202e-43da-a025-c6f8ac6e053a admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:43.701086 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd3c3f-202e-43da-a025-c6f8ac6e053a admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:43.705659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8909b-0d06-4cd5-8659-8df8c7275df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:43.708753 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8909b-0d06-4cd5-8659-8df8c7275df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:43.708753 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8909b-0d06-4cd5-8659-8df8c7275df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:43.708753 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8909b-0d06-4cd5-8659-8df8c7275df8 admin admin] PATH_INFO: `/v3/projects/1289948641bf4a848126cde3cd4c77a7/users/d507e480af0f4bc7b263bdc44c1841d6/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:43.722504 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8909b-0d06-4cd5-8659-8df8c7275df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1289948641bf4a848126cde3cd4c77a7, user_id=d507e480af0f4bc7b263bdc44c1841d6, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:43.724939 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8909b-0d06-4cd5-8659-8df8c7275df8 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:43.736180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1336/2640] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:43 2022] PUT /identity/v3/projects/47f8651173074a5db367c06c1237db17/users/574ec9b6870d4c6781d5ab8a040a61d2/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:43.740250 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f978d3-331a-41a5-9ae3-0dc86feeed7b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:43.801059 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f978d3-331a-41a5-9ae3-0dc86feeed7b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:43.805857 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93aca0-29f7-4c1f-8524-b56ca045130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:43.806459 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93aca0-29f7-4c1f-8524-b56ca045130a admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:43.806745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93aca0-29f7-4c1f-8524-b56ca045130a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:43.807021 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93aca0-29f7-4c1f-8524-b56ca045130a admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:43.807655 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93aca0-29f7-4c1f-8524-b56ca045130a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:43.809359 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93aca0-29f7-4c1f-8524-b56ca045130a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:43.821043 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1305/2641] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:43 2022] PUT /identity/v3/projects/1289948641bf4a848126cde3cd4c77a7/users/d507e480af0f4bc7b263bdc44c1841d6/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:43.821390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1337/2642] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:43:43.827998 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:43.830894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8909b-0d06-4cd5-8659-8df8c7275df8 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:43.831331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe46d02-8997-4220-b3e9-09aff175177f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:43.831761 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe46d02-8997-4220-b3e9-09aff175177f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:43.832169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe46d02-8997-4220-b3e9-09aff175177f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:43.861746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-abe46d02-8997-4220-b3e9-09aff175177f None None] MFA Rules not processed for user `d507e480af0f4bc7b263bdc44c1841d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:43.863041 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-abe46d02-8997-4220-b3e9-09aff175177f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:43.897332 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8909b-0d06-4cd5-8659-8df8c7275df8 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:43.902044 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568f203-e94e-43c0-9084-d039d319f785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:43.902764 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568f203-e94e-43c0-9084-d039d319f785 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:43.903049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568f203-e94e-43c0-9084-d039d319f785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:43.903321 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568f203-e94e-43c0-9084-d039d319f785 admin admin] PATH_INFO: `/v3/projects/47f8651173074a5db367c06c1237db17/users/574ec9b6870d4c6781d5ab8a040a61d2/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:43.905391 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568f203-e94e-43c0-9084-d039d319f785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f8651173074a5db367c06c1237db17, user_id=574ec9b6870d4c6781d5ab8a040a61d2, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:43.907988 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568f203-e94e-43c0-9084-d039d319f785 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:43.918315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1306/2643] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:43 2022] PUT /identity/v3/projects/47f8651173074a5db367c06c1237db17/users/574ec9b6870d4c6781d5ab8a040a61d2/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:43.929123 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1338/2644] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:43 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:43.933990 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568f203-e94e-43c0-9084-d039d319f785 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:43.940825 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:43.987797 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a643b4-0d2e-444a-8f75-eeefa416dc06 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:43.988269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a643b4-0d2e-444a-8f75-eeefa416dc06 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:43.989195 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a643b4-0d2e-444a-8f75-eeefa416dc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:44.003715 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568f203-e94e-43c0-9084-d039d319f785 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:44.009413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f490b6-7bf6-4871-9e0b-539b6c23273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:44.010018 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f490b6-7bf6-4871-9e0b-539b6c23273b admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:44.010319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f490b6-7bf6-4871-9e0b-539b6c23273b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:44.010593 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f490b6-7bf6-4871-9e0b-539b6c23273b admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:44.011255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f490b6-7bf6-4871-9e0b-539b6c23273b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:44.013238 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f490b6-7bf6-4871-9e0b-539b6c23273b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:44.021717 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-92a643b4-0d2e-444a-8f75-eeefa416dc06 None None] MFA Rules not processed for user `574ec9b6870d4c6781d5ab8a040a61d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:44.023024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-92a643b4-0d2e-444a-8f75-eeefa416dc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:44.089015 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:44.092506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1339/2645] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:44.103409 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a643b4-0d2e-444a-8f75-eeefa416dc06 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:44.104801 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-92a643b4-0d2e-444a-8f75-eeefa416dc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:44.162181 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1307/2646] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:43 2022] POST /identity/v3/projects => generated 409 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:44.162579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a643b4-0d2e-444a-8f75-eeefa416dc06 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:44.166180 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f490b6-7bf6-4871-9e0b-539b6c23273b admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:44.213158 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c54d8-2081-4ff5-81ef-33989ec1d731 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:44.213871 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c54d8-2081-4ff5-81ef-33989ec1d731 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:44.214176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c54d8-2081-4ff5-81ef-33989ec1d731 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:44.214475 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c54d8-2081-4ff5-81ef-33989ec1d731 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:44.226692 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f490b6-7bf6-4871-9e0b-539b6c23273b admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:44.232592 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c417e-f888-4ac4-8158-c9eb63e88be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:44.233283 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c417e-f888-4ac4-8158-c9eb63e88be4 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:44.233563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c417e-f888-4ac4-8158-c9eb63e88be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:44.233879 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c417e-f888-4ac4-8158-c9eb63e88be4 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:44.234558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c417e-f888-4ac4-8158-c9eb63e88be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:44.236613 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c417e-f888-4ac4-8158-c9eb63e88be4 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:44.275584 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c54d8-2081-4ff5-81ef-33989ec1d731 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:44.277037 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c54d8-2081-4ff5-81ef-33989ec1d731 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:44.287149 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1340/2647] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:43:44.337402 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1308/2648] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:44 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:44.341462 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c54d8-2081-4ff5-81ef-33989ec1d731 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:44.352238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c54d8-2081-4ff5-81ef-33989ec1d731 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:44.357152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a88df-60a8-40b6-aca8-c6713a393c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:44.357749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a88df-60a8-40b6-aca8-c6713a393c10 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:44.358031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a88df-60a8-40b6-aca8-c6713a393c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:44.358305 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a88df-60a8-40b6-aca8-c6713a393c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:44.363150 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a88df-60a8-40b6-aca8-c6713a393c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:44.363150 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a88df-60a8-40b6-aca8-c6713a393c10 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:44.371517 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1341/2649] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:44.375676 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c417e-f888-4ac4-8158-c9eb63e88be4 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:44.386249 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c417e-f888-4ac4-8158-c9eb63e88be4 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:44.391011 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbf043-073a-4f41-a2ce-bfed4ca11313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:44.391697 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbf043-073a-4f41-a2ce-bfed4ca11313 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:44.391995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbf043-073a-4f41-a2ce-bfed4ca11313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:44.392288 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbf043-073a-4f41-a2ce-bfed4ca11313 admin admin] PATH_INFO: `/v3/projects/9c23a0f3625e469485f2ff72de30fc79/users/71013ce80ead43d4b7a07a505dd300d7/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:44.407553 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbf043-073a-4f41-a2ce-bfed4ca11313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c23a0f3625e469485f2ff72de30fc79, user_id=71013ce80ead43d4b7a07a505dd300d7, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:44.410357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbf043-073a-4f41-a2ce-bfed4ca11313 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:44.514501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1309/2650] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:44 2022] PUT /identity/v3/projects/9c23a0f3625e469485f2ff72de30fc79/users/71013ce80ead43d4b7a07a505dd300d7/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:44.518532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a88df-60a8-40b6-aca8-c6713a393c10 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:44.528547 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a88df-60a8-40b6-aca8-c6713a393c10 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:44.579277 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:44.586348 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e93e9-b740-4271-98fa-830407e7a237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:44.586979 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e93e9-b740-4271-98fa-830407e7a237 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:44.587257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e93e9-b740-4271-98fa-830407e7a237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:44.587525 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e93e9-b740-4271-98fa-830407e7a237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:44.588152 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e93e9-b740-4271-98fa-830407e7a237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:44.589750 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e93e9-b740-4271-98fa-830407e7a237 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:44.605731 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1342/2651] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:44.608707 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbf043-073a-4f41-a2ce-bfed4ca11313 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:44.619994 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbf043-073a-4f41-a2ce-bfed4ca11313 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:44.628177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8727f1-737d-4235-854f-7d406e3395e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:44.628177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8727f1-737d-4235-854f-7d406e3395e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:44.628177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8727f1-737d-4235-854f-7d406e3395e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:44.628177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8727f1-737d-4235-854f-7d406e3395e2 admin admin] PATH_INFO: `/v3/projects/9c23a0f3625e469485f2ff72de30fc79/users/71013ce80ead43d4b7a07a505dd300d7/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:44.629783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8727f1-737d-4235-854f-7d406e3395e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c23a0f3625e469485f2ff72de30fc79, user_id=71013ce80ead43d4b7a07a505dd300d7, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:44.632469 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8727f1-737d-4235-854f-7d406e3395e2 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:44.643431 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1310/2652] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:44 2022] PUT /identity/v3/projects/9c23a0f3625e469485f2ff72de30fc79/users/71013ce80ead43d4b7a07a505dd300d7/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:44.663364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5a9ac-a7c1-4155-b184-29903a2d071b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:44.663652 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5a9ac-a7c1-4155-b184-29903a2d071b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:44.663924 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5a9ac-a7c1-4155-b184-29903a2d071b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:44.692825 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-8fa5a9ac-a7c1-4155-b184-29903a2d071b None None] MFA Rules not processed for user `71013ce80ead43d4b7a07a505dd300d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:44.694040 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8fa5a9ac-a7c1-4155-b184-29903a2d071b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:44.776499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1343/2653] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:44 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:44.877401 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8727f1-737d-4235-854f-7d406e3395e2 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:44.879148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-5f8727f1-737d-4235-854f-7d406e3395e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:44.925395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:44.937238 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8727f1-737d-4235-854f-7d406e3395e2 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:44.940965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc8cb9-041a-48a5-9540-08eda8b2babd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:44.941584 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc8cb9-041a-48a5-9540-08eda8b2babd service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:44.941890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc8cb9-041a-48a5-9540-08eda8b2babd service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:44.942187 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc8cb9-041a-48a5-9540-08eda8b2babd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:44.951647 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc8cb9-041a-48a5-9540-08eda8b2babd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:44.953203 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc8cb9-041a-48a5-9540-08eda8b2babd service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:44.963401 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1311/2654] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:44 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:45.359337 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5a9ac-a7c1-4155-b184-29903a2d071b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:45.369933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5a9ac-a7c1-4155-b184-29903a2d071b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:45.373635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c3195-611e-4d11-ad43-eeb6b939a720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:45.374243 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c3195-611e-4d11-ad43-eeb6b939a720 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:45.374529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c3195-611e-4d11-ad43-eeb6b939a720 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:45.374792 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c3195-611e-4d11-ad43-eeb6b939a720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:45.431379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c3195-611e-4d11-ad43-eeb6b939a720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:45.432879 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c3195-611e-4d11-ad43-eeb6b939a720 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:45.442318 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1344/2655] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:45 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:46.021034 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc8cb9-041a-48a5-9540-08eda8b2babd service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:46.085942 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc8cb9-041a-48a5-9540-08eda8b2babd service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:46.090358 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f3ded-00f3-48f8-9ecb-db448b58cfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:46.090972 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f3ded-00f3-48f8-9ecb-db448b58cfb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:46.091248 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f3ded-00f3-48f8-9ecb-db448b58cfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:46.091516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f3ded-00f3-48f8-9ecb-db448b58cfb3 admin admin] PATH_INFO: `/v3/users/8685eef675bb441985a882b2f5e865b0` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:46.092628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f3ded-00f3-48f8-9ecb-db448b58cfb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8685eef675bb441985a882b2f5e865b0)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:46.094516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f3ded-00f3-48f8-9ecb-db448b58cfb3 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:46.288373 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4d0f3ded-00f3-48f8-9ecb-db448b58cfb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8685eef675bb441985a882b2f5e865b0'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:46.289027 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4d0f3ded-00f3-48f8-9ecb-db448b58cfb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8685eef675bb441985a882b2f5e865b0'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:46.301040 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4d0f3ded-00f3-48f8-9ecb-db448b58cfb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8685eef675bb441985a882b2f5e865b0'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:46.360136 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4d0f3ded-00f3-48f8-9ecb-db448b58cfb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8685eef675bb441985a882b2f5e865b0'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:46.360795 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-4d0f3ded-00f3-48f8-9ecb-db448b58cfb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8685eef675bb441985a882b2f5e865b0'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:46.375468 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1312/2656] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:43:46 2022] DELETE /identity/v3/users/8685eef675bb441985a882b2f5e865b0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:46.379981 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b45882-c2dd-4bd4-a8da-a4d4ad71420c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:46.380489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b45882-c2dd-4bd4-a8da-a4d4ad71420c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:46.380585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b45882-c2dd-4bd4-a8da-a4d4ad71420c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:46.407148 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b7b45882-c2dd-4bd4-a8da-a4d4ad71420c None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:46.408386 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b7b45882-c2dd-4bd4-a8da-a4d4ad71420c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:46.465890 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1345/2657] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:43:46.476512 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f3ded-00f3-48f8-9ecb-db448b58cfb3 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:46.477976 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4d0f3ded-00f3-48f8-9ecb-db448b58cfb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:46.534802 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f3ded-00f3-48f8-9ecb-db448b58cfb3 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:46.538429 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52aef3-6fb6-441e-b773-f26a745e8887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:46.539029 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52aef3-6fb6-441e-b773-f26a745e8887 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:46.539309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52aef3-6fb6-441e-b773-f26a745e8887 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:46.539583 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52aef3-6fb6-441e-b773-f26a745e8887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:46.548754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52aef3-6fb6-441e-b773-f26a745e8887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:46.550223 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52aef3-6fb6-441e-b773-f26a745e8887 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:46.559760 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1313/2658] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:47.013791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b45882-c2dd-4bd4-a8da-a4d4ad71420c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:47.016036 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b7b45882-c2dd-4bd4-a8da-a4d4ad71420c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:47.039561 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b45882-c2dd-4bd4-a8da-a4d4ad71420c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:47.053453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842280c-fb5d-4ce7-902b-4ef780c0962c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:47.053453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842280c-fb5d-4ce7-902b-4ef780c0962c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:47.053453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842280c-fb5d-4ce7-902b-4ef780c0962c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:47.053453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842280c-fb5d-4ce7-902b-4ef780c0962c admin admin] PATH_INFO: `/v3/projects/52c0f5f9ec214a7cba38a42d243a14f2` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:47.053808 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842280c-fb5d-4ce7-902b-4ef780c0962c admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c0f5f9ec214a7cba38a42d243a14f2)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:47.053808 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842280c-fb5d-4ce7-902b-4ef780c0962c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:47.064584 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:47.172884 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e842280c-fb5d-4ce7-902b-4ef780c0962c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c0f5f9ec214a7cba38a42d243a14f2', 'request_id': 'req-e842280c-fb5d-4ce7-902b-4ef780c0962c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:47.179175 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e842280c-fb5d-4ce7-902b-4ef780c0962c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c0f5f9ec214a7cba38a42d243a14f2', 'request_id': 'req-e842280c-fb5d-4ce7-902b-4ef780c0962c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:47.246589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e842280c-fb5d-4ce7-902b-4ef780c0962c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c0f5f9ec214a7cba38a42d243a14f2', 'request_id': 'req-e842280c-fb5d-4ce7-902b-4ef780c0962c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:47.265123 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e842280c-fb5d-4ce7-902b-4ef780c0962c admin admin] The token cache is being invalidate because project 52c0f5f9ec214a7cba38a42d243a14f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:43:47.265514 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e842280c-fb5d-4ce7-902b-4ef780c0962c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:47.266276 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e842280c-fb5d-4ce7-902b-4ef780c0962c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:47.268401 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1346/2659] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:43:47 2022] DELETE /identity/v3/projects/52c0f5f9ec214a7cba38a42d243a14f2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:47.273170 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52aef3-6fb6-441e-b773-f26a745e8887 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:47.286309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52aef3-6fb6-441e-b773-f26a745e8887 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:47.291542 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:47.349525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556b6bf-d771-4e73-ba50-be19835cabda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:47.350191 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556b6bf-d771-4e73-ba50-be19835cabda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:47.350473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556b6bf-d771-4e73-ba50-be19835cabda admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:47.350746 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556b6bf-d771-4e73-ba50-be19835cabda admin admin] PATH_INFO: `/v3/users/574ec9b6870d4c6781d5ab8a040a61d2` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:47.351867 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556b6bf-d771-4e73-ba50-be19835cabda admin admin] RBAC: Authorizing `identity:delete_user(user_id=574ec9b6870d4c6781d5ab8a040a61d2)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:47.353919 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556b6bf-d771-4e73-ba50-be19835cabda admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:47.569270 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-7556b6bf-d771-4e73-ba50-be19835cabda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '574ec9b6870d4c6781d5ab8a040a61d2'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:47.569850 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-7556b6bf-d771-4e73-ba50-be19835cabda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '574ec9b6870d4c6781d5ab8a040a61d2'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:47.583281 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-7556b6bf-d771-4e73-ba50-be19835cabda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '574ec9b6870d4c6781d5ab8a040a61d2'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:47.634680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-7556b6bf-d771-4e73-ba50-be19835cabda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '574ec9b6870d4c6781d5ab8a040a61d2'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:47.635328 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-7556b6bf-d771-4e73-ba50-be19835cabda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '574ec9b6870d4c6781d5ab8a040a61d2'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:47.651232 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1314/2660] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:43:47 2022] DELETE /identity/v3/users/574ec9b6870d4c6781d5ab8a040a61d2 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:48.254515 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842280c-fb5d-4ce7-902b-4ef780c0962c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:48.256123 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e842280c-fb5d-4ce7-902b-4ef780c0962c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:48.269549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842280c-fb5d-4ce7-902b-4ef780c0962c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:48.331755 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a1f1e-d1fd-4d44-bdb3-1b85e0747ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:48.332474 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a1f1e-d1fd-4d44-bdb3-1b85e0747ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:48.332759 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a1f1e-d1fd-4d44-bdb3-1b85e0747ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:48.333030 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a1f1e-d1fd-4d44-bdb3-1b85e0747ddd admin admin] PATH_INFO: `/v3/projects/47f8651173074a5db367c06c1237db17` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:48.334689 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a1f1e-d1fd-4d44-bdb3-1b85e0747ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f8651173074a5db367c06c1237db17)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:48.336690 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a1f1e-d1fd-4d44-bdb3-1b85e0747ddd admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:48.521197 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-dd3a1f1e-d1fd-4d44-bdb3-1b85e0747ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f8651173074a5db367c06c1237db17', 'request_id': 'req-dd3a1f1e-d1fd-4d44-bdb3-1b85e0747ddd'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:48.529117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-dd3a1f1e-d1fd-4d44-bdb3-1b85e0747ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f8651173074a5db367c06c1237db17', 'request_id': 'req-dd3a1f1e-d1fd-4d44-bdb3-1b85e0747ddd'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:48.612193 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-dd3a1f1e-d1fd-4d44-bdb3-1b85e0747ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f8651173074a5db367c06c1237db17', 'request_id': 'req-dd3a1f1e-d1fd-4d44-bdb3-1b85e0747ddd'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:48.624405 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-dd3a1f1e-d1fd-4d44-bdb3-1b85e0747ddd admin admin] The token cache is being invalidate because project 47f8651173074a5db367c06c1237db17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:43:48.624708 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-dd3a1f1e-d1fd-4d44-bdb3-1b85e0747ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:48.625308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-dd3a1f1e-d1fd-4d44-bdb3-1b85e0747ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:48.626828 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1347/2661] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:43:48 2022] DELETE /identity/v3/projects/47f8651173074a5db367c06c1237db17 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:48.632328 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954d456-b164-4213-ae5b-f3db49c6a5f1 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:48.632794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954d456-b164-4213-ae5b-f3db49c6a5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:48.632964 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954d456-b164-4213-ae5b-f3db49c6a5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:48.652339 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-c954d456-b164-4213-ae5b-f3db49c6a5f1 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:48.653552 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c954d456-b164-4213-ae5b-f3db49c6a5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:48.719849 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1315/2662] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:48.721450 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61e924-86e9-4b23-a564-c8a55000c8ee None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:48.721733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61e924-86e9-4b23-a564-c8a55000c8ee None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:48.722004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61e924-86e9-4b23-a564-c8a55000c8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:48.749052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ef61e924-86e9-4b23-a564-c8a55000c8ee None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:48.750255 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ef61e924-86e9-4b23-a564-c8a55000c8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:48.759026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1348/2663] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:48.763235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954d456-b164-4213-ae5b-f3db49c6a5f1 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:48.773780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954d456-b164-4213-ae5b-f3db49c6a5f1 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:48.779588 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e987b16-2953-486d-a40c-89f277a3f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:48.780190 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e987b16-2953-486d-a40c-89f277a3f1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:48.780546 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e987b16-2953-486d-a40c-89f277a3f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:48.780810 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e987b16-2953-486d-a40c-89f277a3f1e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:48.781469 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e987b16-2953-486d-a40c-89f277a3f1e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:43:48.781801 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e987b16-2953-486d-a40c-89f277a3f1e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:48.783438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e987b16-2953-486d-a40c-89f277a3f1e3 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:48.801415 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1316/2664] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:43:48.805981 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61e924-86e9-4b23-a564-c8a55000c8ee None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:48.815417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61e924-86e9-4b23-a564-c8a55000c8ee None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:48.821098 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81f807-56f4-49c9-aa3c-9ed85ca81cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:48.821701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81f807-56f4-49c9-aa3c-9ed85ca81cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:48.821984 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81f807-56f4-49c9-aa3c-9ed85ca81cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:48.822284 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81f807-56f4-49c9-aa3c-9ed85ca81cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:48.822947 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81f807-56f4-49c9-aa3c-9ed85ca81cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:48.824931 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81f807-56f4-49c9-aa3c-9ed85ca81cf5 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:48.938859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:48.946447 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1349/2665] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:48 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:43:48.951134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e987b16-2953-486d-a40c-89f277a3f1e3 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:48.961909 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e987b16-2953-486d-a40c-89f277a3f1e3 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:48.972245 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:49.024915 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308bd67-f1f7-407c-bac2-e69e0ee07748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:49.025453 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308bd67-f1f7-407c-bac2-e69e0ee07748 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:49.025731 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308bd67-f1f7-407c-bac2-e69e0ee07748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:49.025999 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308bd67-f1f7-407c-bac2-e69e0ee07748 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:49.026621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308bd67-f1f7-407c-bac2-e69e0ee07748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:49.028777 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308bd67-f1f7-407c-bac2-e69e0ee07748 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:49.149812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1317/2666] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:48 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:43:49.153760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81f807-56f4-49c9-aa3c-9ed85ca81cf5 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:49.164977 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81f807-56f4-49c9-aa3c-9ed85ca81cf5 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:49.169538 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aa843-fb48-4c5f-8f2f-cdca6b7b1a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:49.170327 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aa843-fb48-4c5f-8f2f-cdca6b7b1a06 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:49.170611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aa843-fb48-4c5f-8f2f-cdca6b7b1a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:49.170823 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aa843-fb48-4c5f-8f2f-cdca6b7b1a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:49.171453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862aa843-fb48-4c5f-8f2f-cdca6b7b1a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:49.173075 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862aa843-fb48-4c5f-8f2f-cdca6b7b1a06 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:49.183865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1350/2667] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:49.187770 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308bd67-f1f7-407c-bac2-e69e0ee07748 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:49.198204 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308bd67-f1f7-407c-bac2-e69e0ee07748 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:49.202933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91878eaf-6f4f-4577-848b-19bedbf2c379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:49.205629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91878eaf-6f4f-4577-848b-19bedbf2c379 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:49.205629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91878eaf-6f4f-4577-848b-19bedbf2c379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:49.205629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91878eaf-6f4f-4577-848b-19bedbf2c379 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:49.205629 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91878eaf-6f4f-4577-848b-19bedbf2c379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:49.206354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91878eaf-6f4f-4577-848b-19bedbf2c379 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:49.217302 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1318/2668] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:49.221499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aa843-fb48-4c5f-8f2f-cdca6b7b1a06 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:49.232553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aa843-fb48-4c5f-8f2f-cdca6b7b1a06 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:49.237146 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0819ce4-2df2-43a7-b5ec-4bca2cb083f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:49.237796 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819ce4-2df2-43a7-b5ec-4bca2cb083f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:49.238072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819ce4-2df2-43a7-b5ec-4bca2cb083f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:49.238335 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819ce4-2df2-43a7-b5ec-4bca2cb083f9 admin admin] PATH_INFO: `/v3/projects/221ffd9533c047dea909b67355350cb5/users/5e648f7512374679a1ff33b904f79ce9/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:49.253149 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0819ce4-2df2-43a7-b5ec-4bca2cb083f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=221ffd9533c047dea909b67355350cb5, user_id=5e648f7512374679a1ff33b904f79ce9, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:49.255843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0819ce4-2df2-43a7-b5ec-4bca2cb083f9 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:49.380130 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1351/2669] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:49 2022] PUT /identity/v3/projects/221ffd9533c047dea909b67355350cb5/users/5e648f7512374679a1ff33b904f79ce9/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:49.385341 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984e593-a4f3-4d86-abc5-0a8e4417d96a None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:49.385681 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984e593-a4f3-4d86-abc5-0a8e4417d96a None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:49.385970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984e593-a4f3-4d86-abc5-0a8e4417d96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:49.406058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-2984e593-a4f3-4d86-abc5-0a8e4417d96a None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:49.407091 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-2984e593-a4f3-4d86-abc5-0a8e4417d96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:49.468813 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1319/2670] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:49.478791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0819ce4-2df2-43a7-b5ec-4bca2cb083f9 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:49.480803 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e0819ce4-2df2-43a7-b5ec-4bca2cb083f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:49.552019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0819ce4-2df2-43a7-b5ec-4bca2cb083f9 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:49.556416 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3c7b4-aed8-4ed1-b054-780e9bae6a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:49.557028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3c7b4-aed8-4ed1-b054-780e9bae6a90 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:49.557299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3c7b4-aed8-4ed1-b054-780e9bae6a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:49.557570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3c7b4-aed8-4ed1-b054-780e9bae6a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:49.567510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3c7b4-aed8-4ed1-b054-780e9bae6a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:49.569398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3c7b4-aed8-4ed1-b054-780e9bae6a90 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:49.584923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1352/2671] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:51.498763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0d916-0456-400a-a4ee-4d5d7e1f8f2a None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:51.499957 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0d916-0456-400a-a4ee-4d5d7e1f8f2a None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:51.500255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0d916-0456-400a-a4ee-4d5d7e1f8f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:51.532269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-ddd0d916-0456-400a-a4ee-4d5d7e1f8f2a None None] MFA Rules not processed for user `5e648f7512374679a1ff33b904f79ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:51.533522 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-ddd0d916-0456-400a-a4ee-4d5d7e1f8f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:51.597633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1320/2672] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:51.602411 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3c7b4-aed8-4ed1-b054-780e9bae6a90 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:51.612005 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3c7b4-aed8-4ed1-b054-780e9bae6a90 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:51.616956 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034385c-a57d-4ba1-ba02-838d15fe9dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:51.617539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034385c-a57d-4ba1-ba02-838d15fe9dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:51.617811 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034385c-a57d-4ba1-ba02-838d15fe9dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:51.618077 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034385c-a57d-4ba1-ba02-838d15fe9dc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:51.622225 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034385c-a57d-4ba1-ba02-838d15fe9dc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:51.622225 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034385c-a57d-4ba1-ba02-838d15fe9dc1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:51.716879 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1353/2673] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:51 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:51.720987 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0d916-0456-400a-a4ee-4d5d7e1f8f2a None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:51.732267 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0d916-0456-400a-a4ee-4d5d7e1f8f2a None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:51.751248 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:51.793389 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78222c-eaf4-44e4-98d4-1dc4203847d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:51.793752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78222c-eaf4-44e4-98d4-1dc4203847d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:51.793935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78222c-eaf4-44e4-98d4-1dc4203847d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:51.794186 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78222c-eaf4-44e4-98d4-1dc4203847d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:51.794839 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78222c-eaf4-44e4-98d4-1dc4203847d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:51.796844 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78222c-eaf4-44e4-98d4-1dc4203847d3 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:51.908009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1321/2674] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:51 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:51.909303 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034385c-a57d-4ba1-ba02-838d15fe9dc1 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:51.920167 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034385c-a57d-4ba1-ba02-838d15fe9dc1 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:51.924858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62e813-46e0-4536-bb92-c8c18e027d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:51.925466 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62e813-46e0-4536-bb92-c8c18e027d1b admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:51.925748 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62e813-46e0-4536-bb92-c8c18e027d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:51.926029 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62e813-46e0-4536-bb92-c8c18e027d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:51.926664 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62e813-46e0-4536-bb92-c8c18e027d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:51.928259 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62e813-46e0-4536-bb92-c8c18e027d1b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:51.938977 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1354/2675] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:51.946181 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78222c-eaf4-44e4-98d4-1dc4203847d3 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:51.956246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78222c-eaf4-44e4-98d4-1dc4203847d3 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:51.961582 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f190e1-ef88-43ef-8689-35ee116bd488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:51.962221 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f190e1-ef88-43ef-8689-35ee116bd488 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:51.962496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f190e1-ef88-43ef-8689-35ee116bd488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:51.965305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f190e1-ef88-43ef-8689-35ee116bd488 admin admin] PATH_INFO: `/v3/projects/4064f84be6ce40e4a0aea7eb97f2958d/users/7deee36bfd5948968864078c6e06a7e9/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:51.977033 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f190e1-ef88-43ef-8689-35ee116bd488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4064f84be6ce40e4a0aea7eb97f2958d, user_id=7deee36bfd5948968864078c6e06a7e9, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:51.979670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f190e1-ef88-43ef-8689-35ee116bd488 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:52.057621 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1322/2676] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:51 2022] PUT /identity/v3/projects/4064f84be6ce40e4a0aea7eb97f2958d/users/7deee36bfd5948968864078c6e06a7e9/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:52.061756 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62e813-46e0-4536-bb92-c8c18e027d1b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:52.072485 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62e813-46e0-4536-bb92-c8c18e027d1b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:52.131831 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ef77f-970f-46d2-a1f0-2143e3aa3ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:52.132458 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ef77f-970f-46d2-a1f0-2143e3aa3ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:52.132738 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ef77f-970f-46d2-a1f0-2143e3aa3ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:52.133009 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ef77f-970f-46d2-a1f0-2143e3aa3ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:52.133641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ef77f-970f-46d2-a1f0-2143e3aa3ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:52.135601 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ef77f-970f-46d2-a1f0-2143e3aa3ddb admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:52.144894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1355/2677] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:43:52.150055 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f190e1-ef88-43ef-8689-35ee116bd488 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:52.160245 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f190e1-ef88-43ef-8689-35ee116bd488 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:52.164862 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dc93d-0a72-40e8-a05a-b8db637af3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:52.165498 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dc93d-0a72-40e8-a05a-b8db637af3db admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:52.165780 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dc93d-0a72-40e8-a05a-b8db637af3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:52.166084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dc93d-0a72-40e8-a05a-b8db637af3db admin admin] PATH_INFO: `/v3/projects/4064f84be6ce40e4a0aea7eb97f2958d/users/7deee36bfd5948968864078c6e06a7e9/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:52.167973 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2dc93d-0a72-40e8-a05a-b8db637af3db admin admin] RBAC: Authorizing `identity:create_grant(project_id=4064f84be6ce40e4a0aea7eb97f2958d, user_id=7deee36bfd5948968864078c6e06a7e9, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:52.170584 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2dc93d-0a72-40e8-a05a-b8db637af3db admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:52.181309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1323/2678] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:52 2022] PUT /identity/v3/projects/4064f84be6ce40e4a0aea7eb97f2958d/users/7deee36bfd5948968864078c6e06a7e9/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:53.001071 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ef77f-970f-46d2-a1f0-2143e3aa3ddb admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:53.002859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ea1ef77f-970f-46d2-a1f0-2143e3aa3ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:53.016580 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ef77f-970f-46d2-a1f0-2143e3aa3ddb admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:53.046730 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:53.081916 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f71766-e602-42e4-bb9d-e42511931121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:53.082664 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f71766-e602-42e4-bb9d-e42511931121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:53.083317 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f71766-e602-42e4-bb9d-e42511931121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:53.083317 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f71766-e602-42e4-bb9d-e42511931121 admin admin] PATH_INFO: `/v3/users/d507e480af0f4bc7b263bdc44c1841d6` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:53.084824 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f71766-e602-42e4-bb9d-e42511931121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d507e480af0f4bc7b263bdc44c1841d6)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:53.086562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f71766-e602-42e4-bb9d-e42511931121 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:53.374039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f7f71766-e602-42e4-bb9d-e42511931121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd507e480af0f4bc7b263bdc44c1841d6'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:53.374781 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f7f71766-e602-42e4-bb9d-e42511931121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd507e480af0f4bc7b263bdc44c1841d6'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:53.387417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f7f71766-e602-42e4-bb9d-e42511931121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd507e480af0f4bc7b263bdc44c1841d6'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:53.566428 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f7f71766-e602-42e4-bb9d-e42511931121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd507e480af0f4bc7b263bdc44c1841d6'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:53.566988 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f7f71766-e602-42e4-bb9d-e42511931121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd507e480af0f4bc7b263bdc44c1841d6'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:53.580903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1356/2679] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:43:52 2022] DELETE /identity/v3/users/d507e480af0f4bc7b263bdc44c1841d6 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:53.586099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5d55c-61ee-4394-8c39-26b6ee4dadaf None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:53.586622 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5d55c-61ee-4394-8c39-26b6ee4dadaf None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:53.586738 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5d55c-61ee-4394-8c39-26b6ee4dadaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:53.605406 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-7bd5d55c-61ee-4394-8c39-26b6ee4dadaf None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:53.606603 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-7bd5d55c-61ee-4394-8c39-26b6ee4dadaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:53.664608 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1324/2680] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:53.673918 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f71766-e602-42e4-bb9d-e42511931121 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:53.675302 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f7f71766-e602-42e4-bb9d-e42511931121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:53.732816 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f71766-e602-42e4-bb9d-e42511931121 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:53.737176 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafbc5d-ee13-4a83-8e14-65974e4850d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:53.737918 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafbc5d-ee13-4a83-8e14-65974e4850d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:53.738244 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafbc5d-ee13-4a83-8e14-65974e4850d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:53.739143 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafbc5d-ee13-4a83-8e14-65974e4850d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:53.754968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafbc5d-ee13-4a83-8e14-65974e4850d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:53.760814 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafbc5d-ee13-4a83-8e14-65974e4850d5 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:53.775935 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1357/2681] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:53.891872 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97046188-b781-4f8e-8cf7-ee08841ecddc None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:53.892171 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97046188-b781-4f8e-8cf7-ee08841ecddc None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:53.892522 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97046188-b781-4f8e-8cf7-ee08841ecddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:53.932558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-97046188-b781-4f8e-8cf7-ee08841ecddc None None] MFA Rules not processed for user `7deee36bfd5948968864078c6e06a7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:53.932558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-97046188-b781-4f8e-8cf7-ee08841ecddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:54.000216 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:54.003744 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1325/2682] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:54.015119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcf101-3e46-41a5-98cd-4159234f151f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:54.015597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcf101-3e46-41a5-98cd-4159234f151f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:54.015747 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcf101-3e46-41a5-98cd-4159234f151f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:54.035282 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a6fcf101-3e46-41a5-98cd-4159234f151f None None] MFA Rules not processed for user `5e648f7512374679a1ff33b904f79ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:54.036519 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a6fcf101-3e46-41a5-98cd-4159234f151f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:54.087059 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:54.096074 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1358/2683] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:54.112474 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97046188-b781-4f8e-8cf7-ee08841ecddc None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:54.114379 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-97046188-b781-4f8e-8cf7-ee08841ecddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:54.210094 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97046188-b781-4f8e-8cf7-ee08841ecddc None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:54.216806 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86751ca6-b6a2-462f-adaf-1b7d56c84eae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:54.217568 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86751ca6-b6a2-462f-adaf-1b7d56c84eae service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:54.217956 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86751ca6-b6a2-462f-adaf-1b7d56c84eae service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:54.218304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86751ca6-b6a2-462f-adaf-1b7d56c84eae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:54.220282 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-86751ca6-b6a2-462f-adaf-1b7d56c84eae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:54.234280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86751ca6-b6a2-462f-adaf-1b7d56c84eae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:54.236500 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86751ca6-b6a2-462f-adaf-1b7d56c84eae service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:54.247574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1326/2684] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:54.324371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcf101-3e46-41a5-98cd-4159234f151f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:54.327372 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a6fcf101-3e46-41a5-98cd-4159234f151f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:54.370896 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcf101-3e46-41a5-98cd-4159234f151f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:54.375754 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e2d78-e7ba-447e-b196-14b15834173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:54.376127 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e2d78-e7ba-447e-b196-14b15834173e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:54.376432 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e2d78-e7ba-447e-b196-14b15834173e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:54.376858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e2d78-e7ba-447e-b196-14b15834173e admin admin] PATH_INFO: `/v3/projects/1289948641bf4a848126cde3cd4c77a7` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:54.377983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e2d78-e7ba-447e-b196-14b15834173e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1289948641bf4a848126cde3cd4c77a7)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:54.380520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e2d78-e7ba-447e-b196-14b15834173e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:54.500108 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86751ca6-b6a2-462f-adaf-1b7d56c84eae service nova] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:54.509767 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86751ca6-b6a2-462f-adaf-1b7d56c84eae service nova] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:54.520680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-908e2d78-e7ba-447e-b196-14b15834173e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1289948641bf4a848126cde3cd4c77a7', 'request_id': 'req-908e2d78-e7ba-447e-b196-14b15834173e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:54.527570 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-908e2d78-e7ba-447e-b196-14b15834173e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1289948641bf4a848126cde3cd4c77a7', 'request_id': 'req-908e2d78-e7ba-447e-b196-14b15834173e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:54.559957 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9c713-d5b6-4fd7-95fb-21102637e5a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:54.560595 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9c713-d5b6-4fd7-95fb-21102637e5a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:54.560879 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9c713-d5b6-4fd7-95fb-21102637e5a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:54.561148 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9c713-d5b6-4fd7-95fb-21102637e5a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:54.562900 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f7b9c713-d5b6-4fd7-95fb-21102637e5a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:54.573112 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9c713-d5b6-4fd7-95fb-21102637e5a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:54.574523 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9c713-d5b6-4fd7-95fb-21102637e5a4 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:54.582657 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1327/2685] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:43:54.588961 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-908e2d78-e7ba-447e-b196-14b15834173e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1289948641bf4a848126cde3cd4c77a7', 'request_id': 'req-908e2d78-e7ba-447e-b196-14b15834173e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:54.600369 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-908e2d78-e7ba-447e-b196-14b15834173e admin admin] The token cache is being invalidate because project 1289948641bf4a848126cde3cd4c77a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:43:54.600925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-908e2d78-e7ba-447e-b196-14b15834173e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:54.601621 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-908e2d78-e7ba-447e-b196-14b15834173e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:54.603135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1359/2686] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:43:54 2022] DELETE /identity/v3/projects/1289948641bf4a848126cde3cd4c77a7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:54.607220 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9c713-d5b6-4fd7-95fb-21102637e5a4 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:54.673650 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9c713-d5b6-4fd7-95fb-21102637e5a4 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:54.678858 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eed788-0bb9-41db-b96f-e706f8a15c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:54.679487 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eed788-0bb9-41db-b96f-e706f8a15c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:54.679766 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eed788-0bb9-41db-b96f-e706f8a15c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:54.680037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eed788-0bb9-41db-b96f-e706f8a15c18 admin admin] PATH_INFO: `/v3/users/71013ce80ead43d4b7a07a505dd300d7` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:54.681224 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eed788-0bb9-41db-b96f-e706f8a15c18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71013ce80ead43d4b7a07a505dd300d7)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:54.683136 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eed788-0bb9-41db-b96f-e706f8a15c18 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:54.835049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:54.848243 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-43eed788-0bb9-41db-b96f-e706f8a15c18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71013ce80ead43d4b7a07a505dd300d7'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:54.848948 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-43eed788-0bb9-41db-b96f-e706f8a15c18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71013ce80ead43d4b7a07a505dd300d7'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:54.861123 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-43eed788-0bb9-41db-b96f-e706f8a15c18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71013ce80ead43d4b7a07a505dd300d7'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:54.931340 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-43eed788-0bb9-41db-b96f-e706f8a15c18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71013ce80ead43d4b7a07a505dd300d7'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:54.931990 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-43eed788-0bb9-41db-b96f-e706f8a15c18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71013ce80ead43d4b7a07a505dd300d7'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:54.949108 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1328/2687] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:43:54 2022] DELETE /identity/v3/users/71013ce80ead43d4b7a07a505dd300d7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:55.442028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e2d78-e7ba-447e-b196-14b15834173e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:55.444035 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-908e2d78-e7ba-447e-b196-14b15834173e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:55.457230 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e2d78-e7ba-447e-b196-14b15834173e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:55.521229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfca241-9387-4427-9c52-bcb2b643f2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:55.521905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfca241-9387-4427-9c52-bcb2b643f2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:55.522215 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfca241-9387-4427-9c52-bcb2b643f2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:55.522486 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfca241-9387-4427-9c52-bcb2b643f2de admin admin] PATH_INFO: `/v3/projects/9c23a0f3625e469485f2ff72de30fc79` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:55.523592 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfca241-9387-4427-9c52-bcb2b643f2de admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c23a0f3625e469485f2ff72de30fc79)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:55.525509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfca241-9387-4427-9c52-bcb2b643f2de admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:55.641903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-dbfca241-9387-4427-9c52-bcb2b643f2de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c23a0f3625e469485f2ff72de30fc79', 'request_id': 'req-dbfca241-9387-4427-9c52-bcb2b643f2de'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:55.648740 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-dbfca241-9387-4427-9c52-bcb2b643f2de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c23a0f3625e469485f2ff72de30fc79', 'request_id': 'req-dbfca241-9387-4427-9c52-bcb2b643f2de'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:55.731662 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-dbfca241-9387-4427-9c52-bcb2b643f2de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c23a0f3625e469485f2ff72de30fc79', 'request_id': 'req-dbfca241-9387-4427-9c52-bcb2b643f2de'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:55.743380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-dbfca241-9387-4427-9c52-bcb2b643f2de admin admin] The token cache is being invalidate because project 9c23a0f3625e469485f2ff72de30fc79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:43:55.743673 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-dbfca241-9387-4427-9c52-bcb2b643f2de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:55.744295 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-dbfca241-9387-4427-9c52-bcb2b643f2de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:55.745810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1360/2688] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:43:55 2022] DELETE /identity/v3/projects/9c23a0f3625e469485f2ff72de30fc79 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:55.751551 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f978bd-88a0-4e89-a8fc-0afb46cfc42a None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:55.752036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f978bd-88a0-4e89-a8fc-0afb46cfc42a None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:55.752152 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f978bd-88a0-4e89-a8fc-0afb46cfc42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:55.772871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-a9f978bd-88a0-4e89-a8fc-0afb46cfc42a None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:55.778941 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a9f978bd-88a0-4e89-a8fc-0afb46cfc42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:55.841173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1329/2689] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:55.849322 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b313e21-b92b-4e00-b855-dec9c8eade84 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:55.850293 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b313e21-b92b-4e00-b855-dec9c8eade84 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:55.850832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b313e21-b92b-4e00-b855-dec9c8eade84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:55.876200 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4b313e21-b92b-4e00-b855-dec9c8eade84 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:55.877469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4b313e21-b92b-4e00-b855-dec9c8eade84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:55.885258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1361/2690] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:43:55.889662 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f978bd-88a0-4e89-a8fc-0afb46cfc42a None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:55.899797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f978bd-88a0-4e89-a8fc-0afb46cfc42a None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:55.904585 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e68e9-e699-471e-a1ca-e1d9917fc248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:55.905226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e68e9-e699-471e-a1ca-e1d9917fc248 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:55.905528 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e68e9-e699-471e-a1ca-e1d9917fc248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:55.905802 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e68e9-e699-471e-a1ca-e1d9917fc248 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:55.906445 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e68e9-e699-471e-a1ca-e1d9917fc248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:43:55.906748 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e68e9-e699-471e-a1ca-e1d9917fc248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:55.908398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e68e9-e699-471e-a1ca-e1d9917fc248 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:55.920933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1330/2691] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:43:55.925239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b313e21-b92b-4e00-b855-dec9c8eade84 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:55.930820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:55.934576 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b313e21-b92b-4e00-b855-dec9c8eade84 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:55.939218 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09389f-2c45-4240-bfb8-1d242d4d0223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:55.939812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09389f-2c45-4240-bfb8-1d242d4d0223 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:55.940089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09389f-2c45-4240-bfb8-1d242d4d0223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:55.940388 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09389f-2c45-4240-bfb8-1d242d4d0223 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:55.941018 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09389f-2c45-4240-bfb8-1d242d4d0223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:55.942962 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09389f-2c45-4240-bfb8-1d242d4d0223 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:56.028942 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1362/2692] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:55 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:56.029997 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e68e9-e699-471e-a1ca-e1d9917fc248 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:56.040672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e68e9-e699-471e-a1ca-e1d9917fc248 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:56.096916 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408f8eb-07f9-4e4d-a584-9a1d00dba919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:56.097524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408f8eb-07f9-4e4d-a584-9a1d00dba919 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:56.097803 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408f8eb-07f9-4e4d-a584-9a1d00dba919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:56.098077 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408f8eb-07f9-4e4d-a584-9a1d00dba919 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:56.098716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408f8eb-07f9-4e4d-a584-9a1d00dba919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:56.101367 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408f8eb-07f9-4e4d-a584-9a1d00dba919 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:56.206155 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1331/2693] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:56 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:56.210946 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09389f-2c45-4240-bfb8-1d242d4d0223 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:56.221156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09389f-2c45-4240-bfb8-1d242d4d0223 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:56.226377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b81ae-4738-4b49-a4c1-fa9a25172d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:56.226969 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b81ae-4738-4b49-a4c1-fa9a25172d12 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:56.227264 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b81ae-4738-4b49-a4c1-fa9a25172d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:56.227586 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b81ae-4738-4b49-a4c1-fa9a25172d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:56.228417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b81ae-4738-4b49-a4c1-fa9a25172d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:56.229987 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b81ae-4738-4b49-a4c1-fa9a25172d12 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:56.239827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1363/2694] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:56.243812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408f8eb-07f9-4e4d-a584-9a1d00dba919 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:56.253865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408f8eb-07f9-4e4d-a584-9a1d00dba919 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:56.259024 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf16a2e-9076-4f3a-bd03-d07917c8b62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:56.259618 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf16a2e-9076-4f3a-bd03-d07917c8b62b admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:56.259898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf16a2e-9076-4f3a-bd03-d07917c8b62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:56.260174 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf16a2e-9076-4f3a-bd03-d07917c8b62b admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:56.261005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf16a2e-9076-4f3a-bd03-d07917c8b62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:56.269155 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf16a2e-9076-4f3a-bd03-d07917c8b62b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:56.273866 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1332/2695] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:56.278034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b81ae-4738-4b49-a4c1-fa9a25172d12 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:56.288203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b81ae-4738-4b49-a4c1-fa9a25172d12 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:56.293270 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a6cf5-2d01-4699-a89a-fd599b8b1399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:56.297972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a6cf5-2d01-4699-a89a-fd599b8b1399 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:56.297972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a6cf5-2d01-4699-a89a-fd599b8b1399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:56.297972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a6cf5-2d01-4699-a89a-fd599b8b1399 admin admin] PATH_INFO: `/v3/projects/90f0c7eb90b040068c0abe0a7ed7ef27/users/80761b5af54f4f6985ede77e88f81bbf/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:56.309040 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a6cf5-2d01-4699-a89a-fd599b8b1399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f0c7eb90b040068c0abe0a7ed7ef27, user_id=80761b5af54f4f6985ede77e88f81bbf, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:56.311751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a6cf5-2d01-4699-a89a-fd599b8b1399 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:56.418678 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1364/2696] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:56 2022] PUT /identity/v3/projects/90f0c7eb90b040068c0abe0a7ed7ef27/users/80761b5af54f4f6985ede77e88f81bbf/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:56.429635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f5e50-f2c7-4d8b-85e2-24eb58ee8ce5 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:56.429920 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f5e50-f2c7-4d8b-85e2-24eb58ee8ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:56.430192 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f5e50-f2c7-4d8b-85e2-24eb58ee8ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:56.456367 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:56.459284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-728f5e50-f2c7-4d8b-85e2-24eb58ee8ce5 None None] MFA Rules not processed for user `80761b5af54f4f6985ede77e88f81bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:56.460528 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-728f5e50-f2c7-4d8b-85e2-24eb58ee8ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:56.524446 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1333/2697] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:56.535650 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a6cf5-2d01-4699-a89a-fd599b8b1399 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:56.538270 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f21a6cf5-2d01-4699-a89a-fd599b8b1399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:56.602329 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a6cf5-2d01-4699-a89a-fd599b8b1399 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:56.606185 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20085f-6430-4c37-b2be-adf3cd546c90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:56.606991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20085f-6430-4c37-b2be-adf3cd546c90 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:56.607386 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20085f-6430-4c37-b2be-adf3cd546c90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:56.607739 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20085f-6430-4c37-b2be-adf3cd546c90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:56.618849 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20085f-6430-4c37-b2be-adf3cd546c90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:56.620379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20085f-6430-4c37-b2be-adf3cd546c90 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:56.629812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1365/2698] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:56.660734 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f5e50-f2c7-4d8b-85e2-24eb58ee8ce5 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:56.722103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f5e50-f2c7-4d8b-85e2-24eb58ee8ce5 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:56.727759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e34993-d76f-47ad-a6c2-978b8596e0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:56.728523 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e34993-d76f-47ad-a6c2-978b8596e0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:56.728890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e34993-d76f-47ad-a6c2-978b8596e0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:56.729219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e34993-d76f-47ad-a6c2-978b8596e0b5 admin admin] PATH_INFO: `/v3/users/80761b5af54f4f6985ede77e88f81bbf` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:56.730468 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e34993-d76f-47ad-a6c2-978b8596e0b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80761b5af54f4f6985ede77e88f81bbf)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:56.735284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e34993-d76f-47ad-a6c2-978b8596e0b5 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:56.917167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-27e34993-d76f-47ad-a6c2-978b8596e0b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80761b5af54f4f6985ede77e88f81bbf'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:56.917749 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-27e34993-d76f-47ad-a6c2-978b8596e0b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80761b5af54f4f6985ede77e88f81bbf'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:56.930552 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-27e34993-d76f-47ad-a6c2-978b8596e0b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80761b5af54f4f6985ede77e88f81bbf'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:57.068647 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-27e34993-d76f-47ad-a6c2-978b8596e0b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80761b5af54f4f6985ede77e88f81bbf'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:57.069229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-27e34993-d76f-47ad-a6c2-978b8596e0b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80761b5af54f4f6985ede77e88f81bbf'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:57.083338 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1334/2699] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:43:56 2022] DELETE /identity/v3/users/80761b5af54f4f6985ede77e88f81bbf => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:57.087769 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f50139-897a-4047-9263-262ba869725e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:57.088087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f50139-897a-4047-9263-262ba869725e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:57.088392 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f50139-897a-4047-9263-262ba869725e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:57.108410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b8f50139-897a-4047-9263-262ba869725e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:57.109604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b8f50139-897a-4047-9263-262ba869725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:57.170808 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1366/2700] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:57.179664 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e34993-d76f-47ad-a6c2-978b8596e0b5 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:57.181309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-27e34993-d76f-47ad-a6c2-978b8596e0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:57.209070 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:57.247136 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e34993-d76f-47ad-a6c2-978b8596e0b5 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:57.251616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060b083-a489-4750-9098-78d267eac152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:57.252266 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060b083-a489-4750-9098-78d267eac152 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:57.252680 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060b083-a489-4750-9098-78d267eac152 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:57.252964 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060b083-a489-4750-9098-78d267eac152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:57.263746 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060b083-a489-4750-9098-78d267eac152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:57.265473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060b083-a489-4750-9098-78d267eac152 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:57.280599 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1335/2701] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:43:57.762476 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f50139-897a-4047-9263-262ba869725e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:57.764051 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b8f50139-897a-4047-9263-262ba869725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:57.776508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f50139-897a-4047-9263-262ba869725e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:57.781100 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1e45c-20f2-4a40-8675-8c7c98d0f7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:57.781733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1e45c-20f2-4a40-8675-8c7c98d0f7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:57.782012 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1e45c-20f2-4a40-8675-8c7c98d0f7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:57.782286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1e45c-20f2-4a40-8675-8c7c98d0f7fa admin admin] PATH_INFO: `/v3/projects/90f0c7eb90b040068c0abe0a7ed7ef27` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:57.783408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1e45c-20f2-4a40-8675-8c7c98d0f7fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=90f0c7eb90b040068c0abe0a7ed7ef27)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:57.785368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1e45c-20f2-4a40-8675-8c7c98d0f7fa admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:57.932083 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:57.935188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-52f1e45c-20f2-4a40-8675-8c7c98d0f7fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90f0c7eb90b040068c0abe0a7ed7ef27', 'request_id': 'req-52f1e45c-20f2-4a40-8675-8c7c98d0f7fa'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:57.941910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-52f1e45c-20f2-4a40-8675-8c7c98d0f7fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90f0c7eb90b040068c0abe0a7ed7ef27', 'request_id': 'req-52f1e45c-20f2-4a40-8675-8c7c98d0f7fa'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:58.006499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-52f1e45c-20f2-4a40-8675-8c7c98d0f7fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90f0c7eb90b040068c0abe0a7ed7ef27', 'request_id': 'req-52f1e45c-20f2-4a40-8675-8c7c98d0f7fa'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:58.018987 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-52f1e45c-20f2-4a40-8675-8c7c98d0f7fa admin admin] The token cache is being invalidate because project 90f0c7eb90b040068c0abe0a7ed7ef27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:43:58.019280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-52f1e45c-20f2-4a40-8675-8c7c98d0f7fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:58.020446 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-52f1e45c-20f2-4a40-8675-8c7c98d0f7fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:43:58.040974 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1367/2702] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:43:57 2022] DELETE /identity/v3/projects/90f0c7eb90b040068c0abe0a7ed7ef27 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:43:58.045845 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b024695-633a-46db-878f-8c96a7f8fdee None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:58.046349 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b024695-633a-46db-878f-8c96a7f8fdee None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:58.046808 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b024695-633a-46db-878f-8c96a7f8fdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:58.076328 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-1b024695-633a-46db-878f-8c96a7f8fdee None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:58.077721 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-1b024695-633a-46db-878f-8c96a7f8fdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:58.140371 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1336/2703] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:58.149830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd54ec-9e67-42a7-ab2e-c9571e72b791 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:58.150217 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd54ec-9e67-42a7-ab2e-c9571e72b791 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:58.150626 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd54ec-9e67-42a7-ab2e-c9571e72b791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:58.171695 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-05cd54ec-9e67-42a7-ab2e-c9571e72b791 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:58.175283 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-05cd54ec-9e67-42a7-ab2e-c9571e72b791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:58.181470 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1368/2704] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:58.185540 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b024695-633a-46db-878f-8c96a7f8fdee None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:58.195790 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b024695-633a-46db-878f-8c96a7f8fdee None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:58.200407 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cd584-de80-4144-826f-687e60f02bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:58.201219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cd584-de80-4144-826f-687e60f02bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:58.201509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cd584-de80-4144-826f-687e60f02bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:58.202010 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cd584-de80-4144-826f-687e60f02bc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:58.202754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63cd584-de80-4144-826f-687e60f02bc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:43:58.202952 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63cd584-de80-4144-826f-687e60f02bc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:58.204678 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63cd584-de80-4144-826f-687e60f02bc9 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:58.222116 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1337/2705] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:43:58.223947 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd54ec-9e67-42a7-ab2e-c9571e72b791 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:58.233868 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd54ec-9e67-42a7-ab2e-c9571e72b791 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:58.238650 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace77e2-33b8-487a-8fb2-dcc9b215dba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:58.239251 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace77e2-33b8-487a-8fb2-dcc9b215dba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:58.239532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace77e2-33b8-487a-8fb2-dcc9b215dba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:58.239807 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace77e2-33b8-487a-8fb2-dcc9b215dba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:58.240507 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace77e2-33b8-487a-8fb2-dcc9b215dba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:58.242395 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace77e2-33b8-487a-8fb2-dcc9b215dba6 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:58.362751 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1369/2706] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:43:58 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:58.367316 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cd584-de80-4144-826f-687e60f02bc9 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:58.379441 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cd584-de80-4144-826f-687e60f02bc9 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:58.450994 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404b8fc-df13-402a-bd56-de3b463036a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:58.451537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404b8fc-df13-402a-bd56-de3b463036a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:58.452028 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404b8fc-df13-402a-bd56-de3b463036a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:58.452953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404b8fc-df13-402a-bd56-de3b463036a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:58.454467 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404b8fc-df13-402a-bd56-de3b463036a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:58.456938 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404b8fc-df13-402a-bd56-de3b463036a6 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:58.578452 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1338/2707] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:43:58 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:43:58.582574 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace77e2-33b8-487a-8fb2-dcc9b215dba6 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:58.592867 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace77e2-33b8-487a-8fb2-dcc9b215dba6 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:58.597572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bc5e2-1f81-4f3e-9541-23f12682ad91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:58.598271 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bc5e2-1f81-4f3e-9541-23f12682ad91 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:58.598559 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bc5e2-1f81-4f3e-9541-23f12682ad91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:58.598887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bc5e2-1f81-4f3e-9541-23f12682ad91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:58.599521 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bc5e2-1f81-4f3e-9541-23f12682ad91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:58.601733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bc5e2-1f81-4f3e-9541-23f12682ad91 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:58.611936 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1370/2708] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:58.616616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404b8fc-df13-402a-bd56-de3b463036a6 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:58.626646 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404b8fc-df13-402a-bd56-de3b463036a6 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:58.631420 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bdb37-bd59-48db-a1e9-f769e7b4dd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:58.632043 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bdb37-bd59-48db-a1e9-f769e7b4dd0b admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:58.632323 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bdb37-bd59-48db-a1e9-f769e7b4dd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:58.632635 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bdb37-bd59-48db-a1e9-f769e7b4dd0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:58.633268 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bdb37-bd59-48db-a1e9-f769e7b4dd0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:58.634866 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bdb37-bd59-48db-a1e9-f769e7b4dd0b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:58.645478 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1339/2709] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:43:58.649725 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bc5e2-1f81-4f3e-9541-23f12682ad91 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:58.659928 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bc5e2-1f81-4f3e-9541-23f12682ad91 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:58.665193 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263afc0-1549-4ff5-a9b7-c360824c061b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:58.678981 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263afc0-1549-4ff5-a9b7-c360824c061b admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:58.678981 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263afc0-1549-4ff5-a9b7-c360824c061b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:58.678981 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263afc0-1549-4ff5-a9b7-c360824c061b admin admin] PATH_INFO: `/v3/projects/e00c7471daf0442d838dde8812be53a9/users/b5fc59d7706d4a20be3deeff92902507/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:58.682308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263afc0-1549-4ff5-a9b7-c360824c061b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00c7471daf0442d838dde8812be53a9, user_id=b5fc59d7706d4a20be3deeff92902507, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:58.685116 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263afc0-1549-4ff5-a9b7-c360824c061b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:58.744787 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1371/2710] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:43:58 2022] PUT /identity/v3/projects/e00c7471daf0442d838dde8812be53a9/users/b5fc59d7706d4a20be3deeff92902507/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:43:58.755528 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a47a6-83ac-4a7e-bba9-d42064a23854 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:58.755815 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a47a6-83ac-4a7e-bba9-d42064a23854 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:58.756097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a47a6-83ac-4a7e-bba9-d42064a23854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:58.786965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-174a47a6-83ac-4a7e-bba9-d42064a23854 None None] MFA Rules not processed for user `b5fc59d7706d4a20be3deeff92902507`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:43:58.788799 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-174a47a6-83ac-4a7e-bba9-d42064a23854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:58.809595 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:58.860156 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1340/2711] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:43:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:43:58.871527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263afc0-1549-4ff5-a9b7-c360824c061b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:43:58.878911 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b263afc0-1549-4ff5-a9b7-c360824c061b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:43:58.931857 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263afc0-1549-4ff5-a9b7-c360824c061b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:43:58.936155 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bf4e4-cccc-44a8-bf70-18942b0930a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:43:58.936843 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bf4e4-cccc-44a8-bf70-18942b0930a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:43:58.937173 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bf4e4-cccc-44a8-bf70-18942b0930a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:43:58.937533 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bf4e4-cccc-44a8-bf70-18942b0930a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:43:58.947903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bf4e4-cccc-44a8-bf70-18942b0930a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:43:58.950050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bf4e4-cccc-44a8-bf70-18942b0930a5 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:43:58.959157 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1372/2712] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:43:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:44:06.370353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a47a6-83ac-4a7e-bba9-d42064a23854 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:06.431827 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a47a6-83ac-4a7e-bba9-d42064a23854 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:06.436266 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4665f-d618-4013-b5ba-ba998bb24d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:06.436917 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4665f-d618-4013-b5ba-ba998bb24d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:06.437192 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4665f-d618-4013-b5ba-ba998bb24d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:06.437462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4665f-d618-4013-b5ba-ba998bb24d00 admin admin] PATH_INFO: `/v3/users/b5fc59d7706d4a20be3deeff92902507` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:06.438557 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4665f-d618-4013-b5ba-ba998bb24d00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5fc59d7706d4a20be3deeff92902507)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:06.440538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4665f-d618-4013-b5ba-ba998bb24d00 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:06.596412 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-93f4665f-d618-4013-b5ba-ba998bb24d00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5fc59d7706d4a20be3deeff92902507'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:06.597068 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-93f4665f-d618-4013-b5ba-ba998bb24d00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5fc59d7706d4a20be3deeff92902507'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:06.609558 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-93f4665f-d618-4013-b5ba-ba998bb24d00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5fc59d7706d4a20be3deeff92902507'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:06.680107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-93f4665f-d618-4013-b5ba-ba998bb24d00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5fc59d7706d4a20be3deeff92902507'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:06.680755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-93f4665f-d618-4013-b5ba-ba998bb24d00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5fc59d7706d4a20be3deeff92902507'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:06.694868 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1341/2713] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:44:06 2022] DELETE /identity/v3/users/b5fc59d7706d4a20be3deeff92902507 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:06.699523 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fbcdc-ae6c-419b-86fd-b9f55cd9a2d6 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:06.700675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fbcdc-ae6c-419b-86fd-b9f55cd9a2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:06.700675 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fbcdc-ae6c-419b-86fd-b9f55cd9a2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:06.718624 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d20fbcdc-ae6c-419b-86fd-b9f55cd9a2d6 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:06.719804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d20fbcdc-ae6c-419b-86fd-b9f55cd9a2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:06.778268 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1373/2714] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:06.791372 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4665f-d618-4013-b5ba-ba998bb24d00 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:06.796415 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-93f4665f-d618-4013-b5ba-ba998bb24d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:06.838898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:06.853332 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4665f-d618-4013-b5ba-ba998bb24d00 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:06.857343 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4354788-724b-4d63-9443-4c88c8342fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:06.860723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4354788-724b-4d63-9443-4c88c8342fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:06.860723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4354788-724b-4d63-9443-4c88c8342fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:06.860723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4354788-724b-4d63-9443-4c88c8342fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:06.870711 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4354788-724b-4d63-9443-4c88c8342fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:06.872259 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4354788-724b-4d63-9443-4c88c8342fa8 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:06.882251 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1342/2715] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:44:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:44:07.265315 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fbcdc-ae6c-419b-86fd-b9f55cd9a2d6 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:07.269242 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d20fbcdc-ae6c-419b-86fd-b9f55cd9a2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:07.285371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fbcdc-ae6c-419b-86fd-b9f55cd9a2d6 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:07.290408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5860bb-bf64-4909-9f40-07c76e685af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:07.291043 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5860bb-bf64-4909-9f40-07c76e685af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:07.291369 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5860bb-bf64-4909-9f40-07c76e685af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:07.291644 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5860bb-bf64-4909-9f40-07c76e685af1 admin admin] PATH_INFO: `/v3/projects/e00c7471daf0442d838dde8812be53a9` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:07.292780 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5860bb-bf64-4909-9f40-07c76e685af1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e00c7471daf0442d838dde8812be53a9)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:07.294667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5860bb-bf64-4909-9f40-07c76e685af1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:07.303677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:07.406968 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c5860bb-bf64-4909-9f40-07c76e685af1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e00c7471daf0442d838dde8812be53a9', 'request_id': 'req-7c5860bb-bf64-4909-9f40-07c76e685af1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:07.413887 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c5860bb-bf64-4909-9f40-07c76e685af1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e00c7471daf0442d838dde8812be53a9', 'request_id': 'req-7c5860bb-bf64-4909-9f40-07c76e685af1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:07.548958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c5860bb-bf64-4909-9f40-07c76e685af1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e00c7471daf0442d838dde8812be53a9', 'request_id': 'req-7c5860bb-bf64-4909-9f40-07c76e685af1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:07.560206 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c5860bb-bf64-4909-9f40-07c76e685af1 admin admin] The token cache is being invalidate because project e00c7471daf0442d838dde8812be53a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:44:07.560733 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c5860bb-bf64-4909-9f40-07c76e685af1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:07.561477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c5860bb-bf64-4909-9f40-07c76e685af1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:07.563355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1374/2716] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:44:07 2022] DELETE /identity/v3/projects/e00c7471daf0442d838dde8812be53a9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:07.569707 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c15ebc-f815-41e2-b486-d3bcb01e7837 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:07.570200 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c15ebc-f815-41e2-b486-d3bcb01e7837 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:07.570303 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c15ebc-f815-41e2-b486-d3bcb01e7837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:07.590946 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-92c15ebc-f815-41e2-b486-d3bcb01e7837 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:07.592141 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-92c15ebc-f815-41e2-b486-d3bcb01e7837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:07.650601 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1343/2717] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:07.659866 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc65f-d147-4588-9685-35f7f5fba58e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:07.660106 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc65f-d147-4588-9685-35f7f5fba58e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:07.660415 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc65f-d147-4588-9685-35f7f5fba58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:07.680472 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-297cc65f-d147-4588-9685-35f7f5fba58e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:07.682308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-297cc65f-d147-4588-9685-35f7f5fba58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:07.690509 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1375/2718] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:07.695255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c15ebc-f815-41e2-b486-d3bcb01e7837 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:07.705270 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c15ebc-f815-41e2-b486-d3bcb01e7837 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:07.710684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb09e4-f190-4f7f-b626-937bc8063fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:07.711410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb09e4-f190-4f7f-b626-937bc8063fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:07.711563 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb09e4-f190-4f7f-b626-937bc8063fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:07.711864 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb09e4-f190-4f7f-b626-937bc8063fb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:07.712548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb09e4-f190-4f7f-b626-937bc8063fb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:44:07.718993 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb09e4-f190-4f7f-b626-937bc8063fb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:07.718993 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb09e4-f190-4f7f-b626-937bc8063fb0 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:07.730577 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1344/2719] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:44:07.732690 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cc65f-d147-4588-9685-35f7f5fba58e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:07.743019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cc65f-d147-4588-9685-35f7f5fba58e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:07.748169 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a71c3a-8f58-44a6-b355-08c4b2885f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:07.753571 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a71c3a-8f58-44a6-b355-08c4b2885f0c admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:07.753571 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a71c3a-8f58-44a6-b355-08c4b2885f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:07.753571 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a71c3a-8f58-44a6-b355-08c4b2885f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:07.753571 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a71c3a-8f58-44a6-b355-08c4b2885f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:07.753571 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a71c3a-8f58-44a6-b355-08c4b2885f0c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:07.853817 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1376/2720] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:44:07 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:44:07.858116 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb09e4-f190-4f7f-b626-937bc8063fb0 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:07.870442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb09e4-f190-4f7f-b626-937bc8063fb0 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:07.928550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099221f-e9d5-4566-a32e-009a7cec401c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:07.929083 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099221f-e9d5-4566-a32e-009a7cec401c admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:07.929386 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099221f-e9d5-4566-a32e-009a7cec401c admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:07.929664 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099221f-e9d5-4566-a32e-009a7cec401c admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:07.930287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099221f-e9d5-4566-a32e-009a7cec401c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:07.932216 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099221f-e9d5-4566-a32e-009a7cec401c admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:07.999986 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1345/2721] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:44:07 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:44:08.003988 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a71c3a-8f58-44a6-b355-08c4b2885f0c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:08.015113 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a71c3a-8f58-44a6-b355-08c4b2885f0c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:08.019934 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb630b-8755-41f1-b304-b340bad5fc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:08.020564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb630b-8755-41f1-b304-b340bad5fc00 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:08.020848 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb630b-8755-41f1-b304-b340bad5fc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:08.021122 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb630b-8755-41f1-b304-b340bad5fc00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:08.021757 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb630b-8755-41f1-b304-b340bad5fc00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:08.023423 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb630b-8755-41f1-b304-b340bad5fc00 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:08.034170 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1377/2722] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:44:08.038185 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099221f-e9d5-4566-a32e-009a7cec401c admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:08.048019 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099221f-e9d5-4566-a32e-009a7cec401c admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:08.052625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec1f98-a1c7-460d-a1c3-5950bfc9f34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:08.053709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec1f98-a1c7-460d-a1c3-5950bfc9f34e admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:08.053983 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec1f98-a1c7-460d-a1c3-5950bfc9f34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:08.054253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec1f98-a1c7-460d-a1c3-5950bfc9f34e admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:08.054884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec1f98-a1c7-460d-a1c3-5950bfc9f34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:08.056494 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec1f98-a1c7-460d-a1c3-5950bfc9f34e admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:08.066877 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1346/2723] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:44:08.071778 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb630b-8755-41f1-b304-b340bad5fc00 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:08.081889 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb630b-8755-41f1-b304-b340bad5fc00 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:08.087874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfde31c-67e2-4971-9662-7a134cdb0e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:08.088557 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfde31c-67e2-4971-9662-7a134cdb0e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:08.088838 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfde31c-67e2-4971-9662-7a134cdb0e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:08.089113 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfde31c-67e2-4971-9662-7a134cdb0e3d admin admin] PATH_INFO: `/v3/projects/d5e2245cdf2e4478aba54c1e72e2f040/users/bb34adc9a6e34b7bb2300ab77722ba6e/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:08.107140 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfde31c-67e2-4971-9662-7a134cdb0e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e2245cdf2e4478aba54c1e72e2f040, user_id=bb34adc9a6e34b7bb2300ab77722ba6e, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:08.109813 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfde31c-67e2-4971-9662-7a134cdb0e3d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:08.188809 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1378/2724] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:44:08 2022] PUT /identity/v3/projects/d5e2245cdf2e4478aba54c1e72e2f040/users/bb34adc9a6e34b7bb2300ab77722ba6e/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:08.199989 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc504dbd-38d2-4bdd-b61f-9b693fa46500 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:08.200274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc504dbd-38d2-4bdd-b61f-9b693fa46500 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:08.200578 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc504dbd-38d2-4bdd-b61f-9b693fa46500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:08.227662 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-cc504dbd-38d2-4bdd-b61f-9b693fa46500 None None] MFA Rules not processed for user `bb34adc9a6e34b7bb2300ab77722ba6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:08.228927 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-cc504dbd-38d2-4bdd-b61f-9b693fa46500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:08.268043 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:08.293580 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1347/2725] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:08.305739 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfde31c-67e2-4971-9662-7a134cdb0e3d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:08.307442 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-bcfde31c-67e2-4971-9662-7a134cdb0e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:08.364535 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfde31c-67e2-4971-9662-7a134cdb0e3d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:08.368707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7a94d-92a1-42bf-ac6f-3bbd29add51e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:08.369339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7a94d-92a1-42bf-ac6f-3bbd29add51e service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:08.369619 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7a94d-92a1-42bf-ac6f-3bbd29add51e service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:08.369891 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7a94d-92a1-42bf-ac6f-3bbd29add51e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:08.378080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7a94d-92a1-42bf-ac6f-3bbd29add51e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:08.379498 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7a94d-92a1-42bf-ac6f-3bbd29add51e service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:08.388211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1379/2726] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:44:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:44:10.174099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7262021-4926-4361-9dd4-c8c9c7ca580b None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:10.174717 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7262021-4926-4361-9dd4-c8c9c7ca580b None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:10.174717 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7262021-4926-4361-9dd4-c8c9c7ca580b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:10.193832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-a7262021-4926-4361-9dd4-c8c9c7ca580b None None] MFA Rules not processed for user `bb34adc9a6e34b7bb2300ab77722ba6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:10.195039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a7262021-4926-4361-9dd4-c8c9c7ca580b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:10.202310 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1348/2727] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:11.284849 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7a94d-92a1-42bf-ac6f-3bbd29add51e service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:11.293525 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7a94d-92a1-42bf-ac6f-3bbd29add51e service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:11.297223 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2567df-8481-4c04-9ca5-e7aa2d792c26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:11.297808 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2567df-8481-4c04-9ca5-e7aa2d792c26 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:11.298084 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2567df-8481-4c04-9ca5-e7aa2d792c26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:11.298353 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2567df-8481-4c04-9ca5-e7aa2d792c26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:11.300033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-fd2567df-8481-4c04-9ca5-e7aa2d792c26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:11.338918 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:11.369066 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2567df-8481-4c04-9ca5-e7aa2d792c26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:11.370529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2567df-8481-4c04-9ca5-e7aa2d792c26 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:11.380352 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1380/2728] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:44:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:44:20.188283 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=13 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:21.509636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=14 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:23.715829 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7262021-4926-4361-9dd4-c8c9c7ca580b None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:23.718026 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a7262021-4926-4361-9dd4-c8c9c7ca580b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:23.789628 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7262021-4926-4361-9dd4-c8c9c7ca580b None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:23.794938 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b88a3-b339-4dc5-9dd8-10b4336460e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:23.795653 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b88a3-b339-4dc5-9dd8-10b4336460e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:23.802198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b88a3-b339-4dc5-9dd8-10b4336460e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:23.802198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b88a3-b339-4dc5-9dd8-10b4336460e6 admin admin] PATH_INFO: `/v3/users/2ebb30c7d41f4a37b6f5cd4343f161f5` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:23.802198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b88a3-b339-4dc5-9dd8-10b4336460e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ebb30c7d41f4a37b6f5cd4343f161f5)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:23.802198 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b88a3-b339-4dc5-9dd8-10b4336460e6 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:24.077395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-743b88a3-b339-4dc5-9dd8-10b4336460e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ebb30c7d41f4a37b6f5cd4343f161f5'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:24.078038 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-743b88a3-b339-4dc5-9dd8-10b4336460e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ebb30c7d41f4a37b6f5cd4343f161f5'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:24.091496 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-743b88a3-b339-4dc5-9dd8-10b4336460e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ebb30c7d41f4a37b6f5cd4343f161f5'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:24.200378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-743b88a3-b339-4dc5-9dd8-10b4336460e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ebb30c7d41f4a37b6f5cd4343f161f5'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:24.201032 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-743b88a3-b339-4dc5-9dd8-10b4336460e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ebb30c7d41f4a37b6f5cd4343f161f5'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:24.215359 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1349/2729] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:44:23 2022] DELETE /identity/v3/users/2ebb30c7d41f4a37b6f5cd4343f161f5 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:24.220087 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088e83c-93fd-41b9-bb97-d1fb866dbd01 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:24.220569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088e83c-93fd-41b9-bb97-d1fb866dbd01 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:24.220721 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088e83c-93fd-41b9-bb97-d1fb866dbd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:24.240732 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a088e83c-93fd-41b9-bb97-d1fb866dbd01 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:24.241934 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a088e83c-93fd-41b9-bb97-d1fb866dbd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:24.304032 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1381/2730] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:44:24.319785 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b88a3-b339-4dc5-9dd8-10b4336460e6 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:24.319785 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-743b88a3-b339-4dc5-9dd8-10b4336460e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:24.374390 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b88a3-b339-4dc5-9dd8-10b4336460e6 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:24.378220 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4f824-af4d-495a-9a6b-6d746ae76b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:24.378620 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4f824-af4d-495a-9a6b-6d746ae76b95 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:24.378902 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4f824-af4d-495a-9a6b-6d746ae76b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:24.379174 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4f824-af4d-495a-9a6b-6d746ae76b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:24.388410 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4f824-af4d-495a-9a6b-6d746ae76b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:24.389839 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4f824-af4d-495a-9a6b-6d746ae76b95 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:24.406784 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1350/2731] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:44:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:44:24.790093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088e83c-93fd-41b9-bb97-d1fb866dbd01 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:24.791528 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a088e83c-93fd-41b9-bb97-d1fb866dbd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:24.806072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088e83c-93fd-41b9-bb97-d1fb866dbd01 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:24.810972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f15bd-1476-4a43-a268-3741319c78f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:24.811744 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f15bd-1476-4a43-a268-3741319c78f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:24.812026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f15bd-1476-4a43-a268-3741319c78f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:24.812327 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f15bd-1476-4a43-a268-3741319c78f2 admin admin] PATH_INFO: `/v3/projects/b818e75335cc4cc1b69cdd09467a62ab` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:24.813714 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f15bd-1476-4a43-a268-3741319c78f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b818e75335cc4cc1b69cdd09467a62ab)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:24.824558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f15bd-1476-4a43-a268-3741319c78f2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:24.933616 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2e7f15bd-1476-4a43-a268-3741319c78f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b818e75335cc4cc1b69cdd09467a62ab', 'request_id': 'req-2e7f15bd-1476-4a43-a268-3741319c78f2'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:24.940144 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2e7f15bd-1476-4a43-a268-3741319c78f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b818e75335cc4cc1b69cdd09467a62ab', 'request_id': 'req-2e7f15bd-1476-4a43-a268-3741319c78f2'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:25.034605 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2e7f15bd-1476-4a43-a268-3741319c78f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b818e75335cc4cc1b69cdd09467a62ab', 'request_id': 'req-2e7f15bd-1476-4a43-a268-3741319c78f2'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:25.045925 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2e7f15bd-1476-4a43-a268-3741319c78f2 admin admin] The token cache is being invalidate because project b818e75335cc4cc1b69cdd09467a62ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:44:25.046216 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2e7f15bd-1476-4a43-a268-3741319c78f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:25.046840 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2e7f15bd-1476-4a43-a268-3741319c78f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:25.048319 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1382/2732] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:44:24 2022] DELETE /identity/v3/projects/b818e75335cc4cc1b69cdd09467a62ab => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:44:25.052353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4f824-af4d-495a-9a6b-6d746ae76b95 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:25.062062 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4f824-af4d-495a-9a6b-6d746ae76b95 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:25.082985 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:25.119625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356d75b-426d-494f-8d25-b8df9dc7a24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:25.120250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356d75b-426d-494f-8d25-b8df9dc7a24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:25.120708 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356d75b-426d-494f-8d25-b8df9dc7a24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:25.120969 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356d75b-426d-494f-8d25-b8df9dc7a24e admin admin] PATH_INFO: `/v3/users/b4660ce521994fb8a276887f1a301066` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:25.122073 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356d75b-426d-494f-8d25-b8df9dc7a24e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4660ce521994fb8a276887f1a301066)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:25.123978 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356d75b-426d-494f-8d25-b8df9dc7a24e admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:25.305269 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2356d75b-426d-494f-8d25-b8df9dc7a24e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4660ce521994fb8a276887f1a301066'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:25.305923 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2356d75b-426d-494f-8d25-b8df9dc7a24e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4660ce521994fb8a276887f1a301066'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:25.317887 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2356d75b-426d-494f-8d25-b8df9dc7a24e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4660ce521994fb8a276887f1a301066'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:25.400623 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2356d75b-426d-494f-8d25-b8df9dc7a24e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4660ce521994fb8a276887f1a301066'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:25.401367 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2356d75b-426d-494f-8d25-b8df9dc7a24e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4660ce521994fb8a276887f1a301066'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:25.414537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1351/2733] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:44:25 2022] DELETE /identity/v3/users/b4660ce521994fb8a276887f1a301066 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:25.802927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f15bd-1476-4a43-a268-3741319c78f2 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:25.804431 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2e7f15bd-1476-4a43-a268-3741319c78f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:25.818198 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f15bd-1476-4a43-a268-3741319c78f2 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:25.881527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea143c7-1660-4659-ad1f-618d153380a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:25.882209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea143c7-1660-4659-ad1f-618d153380a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:25.882502 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea143c7-1660-4659-ad1f-618d153380a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:25.883420 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea143c7-1660-4659-ad1f-618d153380a5 admin admin] PATH_INFO: `/v3/projects/e91e888100bf42fb9892c8a358d6992f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:25.884611 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea143c7-1660-4659-ad1f-618d153380a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e91e888100bf42fb9892c8a358d6992f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:25.886607 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea143c7-1660-4659-ad1f-618d153380a5 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:25.967745 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:25.983552 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-bea143c7-1660-4659-ad1f-618d153380a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e91e888100bf42fb9892c8a358d6992f', 'request_id': 'req-bea143c7-1660-4659-ad1f-618d153380a5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:25.989902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-bea143c7-1660-4659-ad1f-618d153380a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e91e888100bf42fb9892c8a358d6992f', 'request_id': 'req-bea143c7-1660-4659-ad1f-618d153380a5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:26.057784 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-bea143c7-1660-4659-ad1f-618d153380a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e91e888100bf42fb9892c8a358d6992f', 'request_id': 'req-bea143c7-1660-4659-ad1f-618d153380a5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:26.070114 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-bea143c7-1660-4659-ad1f-618d153380a5 admin admin] The token cache is being invalidate because project e91e888100bf42fb9892c8a358d6992f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:44:26.071044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-bea143c7-1660-4659-ad1f-618d153380a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:26.071959 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-bea143c7-1660-4659-ad1f-618d153380a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:26.075031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1383/2734] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:44:25 2022] DELETE /identity/v3/projects/e91e888100bf42fb9892c8a358d6992f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:26.080274 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2ef2d-5d3d-4a8c-8348-5be522b1dee5 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:26.080783 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2ef2d-5d3d-4a8c-8348-5be522b1dee5 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:26.080904 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2ef2d-5d3d-4a8c-8348-5be522b1dee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:26.100883 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-f1e2ef2d-5d3d-4a8c-8348-5be522b1dee5 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:26.102106 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f1e2ef2d-5d3d-4a8c-8348-5be522b1dee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:26.168286 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1352/2735] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:26.176050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191963b8-4d59-44ac-853c-3bf498fa2bd6 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:26.176354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191963b8-4d59-44ac-853c-3bf498fa2bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:26.176649 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191963b8-4d59-44ac-853c-3bf498fa2bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:26.197726 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-191963b8-4d59-44ac-853c-3bf498fa2bd6 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:26.198990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-191963b8-4d59-44ac-853c-3bf498fa2bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:26.209018 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1384/2736] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:26.213896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2ef2d-5d3d-4a8c-8348-5be522b1dee5 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:26.223995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2ef2d-5d3d-4a8c-8348-5be522b1dee5 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:26.229366 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349a92c-ccd8-486f-8911-50b55299c91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:26.229970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349a92c-ccd8-486f-8911-50b55299c91b admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:26.230261 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349a92c-ccd8-486f-8911-50b55299c91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:26.230518 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349a92c-ccd8-486f-8911-50b55299c91b admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:26.231155 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349a92c-ccd8-486f-8911-50b55299c91b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:44:26.231456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349a92c-ccd8-486f-8911-50b55299c91b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:26.233087 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349a92c-ccd8-486f-8911-50b55299c91b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:26.245004 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1353/2737] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:44:26.249119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191963b8-4d59-44ac-853c-3bf498fa2bd6 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:26.259281 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191963b8-4d59-44ac-853c-3bf498fa2bd6 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:26.264602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56d919-c9e9-4206-99fa-da36c9257804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:26.265439 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56d919-c9e9-4206-99fa-da36c9257804 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:26.265713 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56d919-c9e9-4206-99fa-da36c9257804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:26.265983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56d919-c9e9-4206-99fa-da36c9257804 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:26.266626 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56d919-c9e9-4206-99fa-da36c9257804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:26.268567 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56d919-c9e9-4206-99fa-da36c9257804 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:26.385766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1385/2738] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:44:26 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:44:26.389937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349a92c-ccd8-486f-8911-50b55299c91b admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:26.401364 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349a92c-ccd8-486f-8911-50b55299c91b admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:26.431109 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:26.461991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fac6c-66e4-44b2-befd-649ac7622885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:26.462613 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fac6c-66e4-44b2-befd-649ac7622885 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:26.462960 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fac6c-66e4-44b2-befd-649ac7622885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:26.463244 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fac6c-66e4-44b2-befd-649ac7622885 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:26.463888 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fac6c-66e4-44b2-befd-649ac7622885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:26.465866 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fac6c-66e4-44b2-befd-649ac7622885 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:26.543591 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1354/2739] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:44:26 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:44:26.547746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56d919-c9e9-4206-99fa-da36c9257804 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:26.558409 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56d919-c9e9-4206-99fa-da36c9257804 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:26.563248 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fea98-cb89-488c-93de-12f1ad4990ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:26.563834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fea98-cb89-488c-93de-12f1ad4990ca admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:26.564107 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fea98-cb89-488c-93de-12f1ad4990ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:26.564420 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fea98-cb89-488c-93de-12f1ad4990ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:26.565112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742fea98-cb89-488c-93de-12f1ad4990ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:26.566681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742fea98-cb89-488c-93de-12f1ad4990ca admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:26.577431 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1386/2740] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:44:26.581314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fac6c-66e4-44b2-befd-649ac7622885 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:26.591822 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fac6c-66e4-44b2-befd-649ac7622885 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:26.596475 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c526639-3df3-46b7-a6f2-73efdf1edf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:26.597074 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c526639-3df3-46b7-a6f2-73efdf1edf29 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:26.597355 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c526639-3df3-46b7-a6f2-73efdf1edf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:26.597632 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c526639-3df3-46b7-a6f2-73efdf1edf29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:26.598295 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c526639-3df3-46b7-a6f2-73efdf1edf29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:26.600566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c526639-3df3-46b7-a6f2-73efdf1edf29 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:26.610229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1355/2741] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:44:26.614459 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fea98-cb89-488c-93de-12f1ad4990ca admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:26.625859 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fea98-cb89-488c-93de-12f1ad4990ca admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:26.630917 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c974f27-47c2-4aa8-a207-2ca28385078a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:26.631597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c974f27-47c2-4aa8-a207-2ca28385078a admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:26.631880 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c974f27-47c2-4aa8-a207-2ca28385078a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:26.632158 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c974f27-47c2-4aa8-a207-2ca28385078a admin admin] PATH_INFO: `/v3/projects/f5818f6254a2492895678f6119e60b83/users/398cbd6e1b09465fb68c9ac58fd6f71f/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:26.648352 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c974f27-47c2-4aa8-a207-2ca28385078a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5818f6254a2492895678f6119e60b83, user_id=398cbd6e1b09465fb68c9ac58fd6f71f, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:26.654599 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c974f27-47c2-4aa8-a207-2ca28385078a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:26.749566 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1387/2742] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:44:26 2022] PUT /identity/v3/projects/f5818f6254a2492895678f6119e60b83/users/398cbd6e1b09465fb68c9ac58fd6f71f/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:26.762276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f43fa-d5e6-4e6b-a036-ca87ae07098b None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:26.763098 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f43fa-d5e6-4e6b-a036-ca87ae07098b None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:26.763358 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f43fa-d5e6-4e6b-a036-ca87ae07098b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:26.794576 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-3f7f43fa-d5e6-4e6b-a036-ca87ae07098b None None] MFA Rules not processed for user `398cbd6e1b09465fb68c9ac58fd6f71f`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:26.795843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3f7f43fa-d5e6-4e6b-a036-ca87ae07098b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:26.858806 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1356/2743] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:26.863387 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c974f27-47c2-4aa8-a207-2ca28385078a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:26.927436 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c974f27-47c2-4aa8-a207-2ca28385078a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:26.932683 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41e792-4401-4ec1-80e4-e0ca03f80ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:26.933285 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41e792-4401-4ec1-80e4-e0ca03f80ccb admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:26.933564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41e792-4401-4ec1-80e4-e0ca03f80ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:26.933840 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41e792-4401-4ec1-80e4-e0ca03f80ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:26.934463 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c41e792-4401-4ec1-80e4-e0ca03f80ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:26.937382 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c41e792-4401-4ec1-80e4-e0ca03f80ccb admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:27.024223 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1388/2744] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:44:26 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:44:27.028536 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f43fa-d5e6-4e6b-a036-ca87ae07098b None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:27.040253 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f43fa-d5e6-4e6b-a036-ca87ae07098b None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:27.095565 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536fd9c-dfd7-4b7e-978d-ef38acd046b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:27.096221 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536fd9c-dfd7-4b7e-978d-ef38acd046b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:27.096461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536fd9c-dfd7-4b7e-978d-ef38acd046b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:27.096741 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536fd9c-dfd7-4b7e-978d-ef38acd046b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:27.097369 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536fd9c-dfd7-4b7e-978d-ef38acd046b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:27.099379 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536fd9c-dfd7-4b7e-978d-ef38acd046b2 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:27.214755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1357/2745] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:44:27 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:44:27.216242 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41e792-4401-4ec1-80e4-e0ca03f80ccb admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:27.227830 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41e792-4401-4ec1-80e4-e0ca03f80ccb admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:27.232505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722d040-af42-4e3a-a14c-ee7ba2ca2253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:27.233181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722d040-af42-4e3a-a14c-ee7ba2ca2253 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:27.233462 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722d040-af42-4e3a-a14c-ee7ba2ca2253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:27.233734 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722d040-af42-4e3a-a14c-ee7ba2ca2253 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:27.234361 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722d040-af42-4e3a-a14c-ee7ba2ca2253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:27.235941 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722d040-af42-4e3a-a14c-ee7ba2ca2253 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:27.249793 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1389/2746] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:44:27.253817 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536fd9c-dfd7-4b7e-978d-ef38acd046b2 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:27.264456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536fd9c-dfd7-4b7e-978d-ef38acd046b2 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:27.269404 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058500ed-db05-4791-a7d4-f59cdbbd7af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:27.269997 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058500ed-db05-4791-a7d4-f59cdbbd7af9 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:27.270275 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058500ed-db05-4791-a7d4-f59cdbbd7af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:27.270545 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058500ed-db05-4791-a7d4-f59cdbbd7af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:27.271213 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058500ed-db05-4791-a7d4-f59cdbbd7af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:27.272857 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058500ed-db05-4791-a7d4-f59cdbbd7af9 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:27.282998 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1358/2747] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:44:27.287147 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722d040-af42-4e3a-a14c-ee7ba2ca2253 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:27.297546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722d040-af42-4e3a-a14c-ee7ba2ca2253 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:27.302159 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5c6a3-f275-4487-9547-a246d85da8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:27.302795 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5c6a3-f275-4487-9547-a246d85da8c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:27.303072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5c6a3-f275-4487-9547-a246d85da8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:27.303343 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5c6a3-f275-4487-9547-a246d85da8c5 admin admin] PATH_INFO: `/v3/projects/03d2eb3afc214b5483c4d17528a8b668/users/9b769975056944578afde4dc71f26df2/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:27.318701 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5c6a3-f275-4487-9547-a246d85da8c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03d2eb3afc214b5483c4d17528a8b668, user_id=9b769975056944578afde4dc71f26df2, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:27.321652 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5c6a3-f275-4487-9547-a246d85da8c5 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:27.465016 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:27.470270 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1390/2748] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:44:27 2022] PUT /identity/v3/projects/03d2eb3afc214b5483c4d17528a8b668/users/9b769975056944578afde4dc71f26df2/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:44:27.482866 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e09c4d-b5d9-474e-af1e-ebf87d0e9d91 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:27.483160 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e09c4d-b5d9-474e-af1e-ebf87d0e9d91 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:27.483439 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e09c4d-b5d9-474e-af1e-ebf87d0e9d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:27.515037 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-15e09c4d-b5d9-474e-af1e-ebf87d0e9d91 None None] MFA Rules not processed for user `9b769975056944578afde4dc71f26df2`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:27.516248 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-15e09c4d-b5d9-474e-af1e-ebf87d0e9d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:27.520209 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:27.581133 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1359/2749] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:27.585563 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5c6a3-f275-4487-9547-a246d85da8c5 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:27.649720 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5c6a3-f275-4487-9547-a246d85da8c5 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:27.654522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ea1aa-a2b1-41f8-8ef6-3f35cba3aef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:27.655123 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ea1aa-a2b1-41f8-8ef6-3f35cba3aef9 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:27.655401 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ea1aa-a2b1-41f8-8ef6-3f35cba3aef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:27.655672 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ea1aa-a2b1-41f8-8ef6-3f35cba3aef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:27.656377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ea1aa-a2b1-41f8-8ef6-3f35cba3aef9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:27.658387 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ea1aa-a2b1-41f8-8ef6-3f35cba3aef9 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:27.809181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1391/2750] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:44:27 2022] POST /identity/v3/projects => generated 387 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:44:27.813223 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e09c4d-b5d9-474e-af1e-ebf87d0e9d91 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:27.824292 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e09c4d-b5d9-474e-af1e-ebf87d0e9d91 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:27.880386 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb83d77-4897-4a1e-ac33-abeb819536c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:27.881007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb83d77-4897-4a1e-ac33-abeb819536c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:27.881290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb83d77-4897-4a1e-ac33-abeb819536c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:27.881566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb83d77-4897-4a1e-ac33-abeb819536c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:27.882211 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb83d77-4897-4a1e-ac33-abeb819536c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:27.884206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb83d77-4897-4a1e-ac33-abeb819536c6 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:27.966356 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1360/2751] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:44:27 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:44:27.970373 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ea1aa-a2b1-41f8-8ef6-3f35cba3aef9 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:27.981483 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ea1aa-a2b1-41f8-8ef6-3f35cba3aef9 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:27.986228 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7df91c-510f-4e5e-84bc-d6761664bbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:27.986829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7df91c-510f-4e5e-84bc-d6761664bbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:27.987109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7df91c-510f-4e5e-84bc-d6761664bbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:27.987387 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7df91c-510f-4e5e-84bc-d6761664bbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:27.988024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7df91c-510f-4e5e-84bc-d6761664bbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:27.989653 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7df91c-510f-4e5e-84bc-d6761664bbc7 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:28.001641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1392/2752] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:44:28.005824 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb83d77-4897-4a1e-ac33-abeb819536c6 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:28.016067 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb83d77-4897-4a1e-ac33-abeb819536c6 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:28.020724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a551c7-ed99-4bad-94d0-fc85e9b46455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:28.021387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a551c7-ed99-4bad-94d0-fc85e9b46455 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:28.021735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a551c7-ed99-4bad-94d0-fc85e9b46455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:28.022027 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a551c7-ed99-4bad-94d0-fc85e9b46455 admin admin] PATH_INFO: `/v3/projects/5301b13afa4147eb88984952287aef72/users/897a17f85292476db6997056e1520e54/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:28.037572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a551c7-ed99-4bad-94d0-fc85e9b46455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5301b13afa4147eb88984952287aef72, user_id=897a17f85292476db6997056e1520e54, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:28.040167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a551c7-ed99-4bad-94d0-fc85e9b46455 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:28.104284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1361/2753] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:44:28 2022] PUT /identity/v3/projects/5301b13afa4147eb88984952287aef72/users/897a17f85292476db6997056e1520e54/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:28.108329 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7df91c-510f-4e5e-84bc-d6761664bbc7 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:28.118135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7df91c-510f-4e5e-84bc-d6761664bbc7 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:28.172604 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799ac13-a934-4eb4-a9b2-9adc864d816c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:28.173196 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799ac13-a934-4eb4-a9b2-9adc864d816c admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:28.173471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799ac13-a934-4eb4-a9b2-9adc864d816c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:28.178538 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799ac13-a934-4eb4-a9b2-9adc864d816c admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:28.178538 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799ac13-a934-4eb4-a9b2-9adc864d816c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:28.178538 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799ac13-a934-4eb4-a9b2-9adc864d816c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:28.185630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1393/2754] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:44:28.189965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a551c7-ed99-4bad-94d0-fc85e9b46455 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:28.200890 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a551c7-ed99-4bad-94d0-fc85e9b46455 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:28.205804 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8930e8-398e-4ba6-8be9-66a89396ca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:28.206451 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8930e8-398e-4ba6-8be9-66a89396ca45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:28.206727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8930e8-398e-4ba6-8be9-66a89396ca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:28.207064 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8930e8-398e-4ba6-8be9-66a89396ca45 admin admin] PATH_INFO: `/v3/projects/5301b13afa4147eb88984952287aef72/users/897a17f85292476db6997056e1520e54/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:28.209086 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8930e8-398e-4ba6-8be9-66a89396ca45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5301b13afa4147eb88984952287aef72, user_id=897a17f85292476db6997056e1520e54, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:28.212455 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8930e8-398e-4ba6-8be9-66a89396ca45 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:28.223223 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1362/2755] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:44:28 2022] PUT /identity/v3/projects/5301b13afa4147eb88984952287aef72/users/897a17f85292476db6997056e1520e54/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:28.235303 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ed836-3a81-4a74-be2a-248e263afa4e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:28.235596 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ed836-3a81-4a74-be2a-248e263afa4e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:28.235900 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ed836-3a81-4a74-be2a-248e263afa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:28.263614 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-844ed836-3a81-4a74-be2a-248e263afa4e None None] MFA Rules not processed for user `897a17f85292476db6997056e1520e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:28.264864 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-844ed836-3a81-4a74-be2a-248e263afa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:28.325888 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:28.334829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1394/2756] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:28 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:28.346437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8930e8-398e-4ba6-8be9-66a89396ca45 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:28.348462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-1f8930e8-398e-4ba6-8be9-66a89396ca45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:28.409351 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8930e8-398e-4ba6-8be9-66a89396ca45 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:28.413187 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fc04d-a0f5-4a59-b067-dd235ebd512b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:28.413797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fc04d-a0f5-4a59-b067-dd235ebd512b service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:28.414652 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fc04d-a0f5-4a59-b067-dd235ebd512b service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:28.414924 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fc04d-a0f5-4a59-b067-dd235ebd512b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:28.424821 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fc04d-a0f5-4a59-b067-dd235ebd512b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:28.426292 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fc04d-a0f5-4a59-b067-dd235ebd512b service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:28.431559 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:28.436590 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1363/2757] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:44:28 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:44:29.419691 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ed836-3a81-4a74-be2a-248e263afa4e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:29.429081 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ed836-3a81-4a74-be2a-248e263afa4e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:29.432618 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc05ad7-6e31-4d8d-a9db-d134158fcb20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:29.433206 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc05ad7-6e31-4d8d-a9db-d134158fcb20 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:29.433479 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc05ad7-6e31-4d8d-a9db-d134158fcb20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:29.433747 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc05ad7-6e31-4d8d-a9db-d134158fcb20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:29.490023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc05ad7-6e31-4d8d-a9db-d134158fcb20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:29.491504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc05ad7-6e31-4d8d-a9db-d134158fcb20 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:29.500560 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1395/2758] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:44:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:44:31.616773 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a93fd-1702-4241-a79c-e84f5b838d18 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:31.617250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a93fd-1702-4241-a79c-e84f5b838d18 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:31.617352 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a93fd-1702-4241-a79c-e84f5b838d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:31.638435 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-143a93fd-1702-4241-a79c-e84f5b838d18 None None] MFA Rules not processed for user `0c8d0a718e8347b5af397f866056266e`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:31.638849 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-143a93fd-1702-4241-a79c-e84f5b838d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:31.697884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1364/2759] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 27 16:44:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:31.739510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc05ad7-6e31-4d8d-a9db-d134158fcb20 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:31.740950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7cc05ad7-6e31-4d8d-a9db-d134158fcb20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:31.810089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc05ad7-6e31-4d8d-a9db-d134158fcb20 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:31.815542 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08477f-8c40-4978-b619-28d68d74ad64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b85e430004a8b865622354c1d1ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:31.816160 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08477f-8c40-4978-b619-28d68d74ad64 service swift] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:31.816471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08477f-8c40-4978-b619-28d68d74ad64 service swift] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:31.816797 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08477f-8c40-4978-b619-28d68d74ad64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:31.826329 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08477f-8c40-4978-b619-28d68d74ad64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:31.827950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08477f-8c40-4978-b619-28d68d74ad64 service swift] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:31.837050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1396/2760] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 27 16:44:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 27 16:44:32.763387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123ce2a-62cb-4f94-aeaa-0a4ba21611a5 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:32.763911 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123ce2a-62cb-4f94-aeaa-0a4ba21611a5 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:32.763911 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123ce2a-62cb-4f94-aeaa-0a4ba21611a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:32.782835 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-5123ce2a-62cb-4f94-aeaa-0a4ba21611a5 None None] MFA Rules not processed for user `0c8d0a718e8347b5af397f866056266e`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:32.784022 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-5123ce2a-62cb-4f94-aeaa-0a4ba21611a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:32.791597 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1365/2761] 10.222.0.26 () {58 vars in 967 bytes} [Tue Sep 27 16:44:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:32.803949 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08477f-8c40-4978-b619-28d68d74ad64 service swift] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:32.815241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08477f-8c40-4978-b619-28d68d74ad64 service swift] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:32.821107 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b09143-4654-4e8a-a185-852552f0663b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b85e430004a8b865622354c1d1ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:32.821990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b09143-4654-4e8a-a185-852552f0663b service swift] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:32.822379 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b09143-4654-4e8a-a185-852552f0663b service swift] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:32.822770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b09143-4654-4e8a-a185-852552f0663b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:32.831126 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b09143-4654-4e8a-a185-852552f0663b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:32.832858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b09143-4654-4e8a-a185-852552f0663b service swift] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:32.840954 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1397/2762] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 27 16:44:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 27 16:44:33.485547 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f70bc-e616-47c4-9fd5-3b35aa0c77e7 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:33.485837 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f70bc-e616-47c4-9fd5-3b35aa0c77e7 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:33.486107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f70bc-e616-47c4-9fd5-3b35aa0c77e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:33.505615 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-567f70bc-e616-47c4-9fd5-3b35aa0c77e7 None None] MFA Rules not processed for user `0c8d0a718e8347b5af397f866056266e`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:33.506797 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-567f70bc-e616-47c4-9fd5-3b35aa0c77e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:33.514507 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1366/2763] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 27 16:44:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:33.525989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b09143-4654-4e8a-a185-852552f0663b service swift] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:33.536667 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b09143-4654-4e8a-a185-852552f0663b service swift] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:33.541899 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd455d5-c065-4d0f-832d-2faa6faef064 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b85e430004a8b865622354c1d1ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:33.542488 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd455d5-c065-4d0f-832d-2faa6faef064 service swift] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:33.542760 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd455d5-c065-4d0f-832d-2faa6faef064 service swift] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:33.543028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd455d5-c065-4d0f-832d-2faa6faef064 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:33.550997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd455d5-c065-4d0f-832d-2faa6faef064 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:33.552575 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd455d5-c065-4d0f-832d-2faa6faef064 service swift] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:33.560881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1398/2764] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 27 16:44:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 16:44:34.154983 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39d47f-1df2-4f19-af64-35469fe162f0 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:34.155456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39d47f-1df2-4f19-af64-35469fe162f0 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:34.155738 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39d47f-1df2-4f19-af64-35469fe162f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:34.175737 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-fe39d47f-1df2-4f19-af64-35469fe162f0 None None] MFA Rules not processed for user `0c8d0a718e8347b5af397f866056266e`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:34.180793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-fe39d47f-1df2-4f19-af64-35469fe162f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:34.184314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1367/2765] 10.222.0.26 () {58 vars in 967 bytes} [Tue Sep 27 16:44:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:34.196910 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd455d5-c065-4d0f-832d-2faa6faef064 service swift] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:34.207312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd455d5-c065-4d0f-832d-2faa6faef064 service swift] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:34.212984 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81b6db-364c-4f8e-aedf-14900d342e18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b85e430004a8b865622354c1d1ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:34.213572 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81b6db-364c-4f8e-aedf-14900d342e18 service swift] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:34.214026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81b6db-364c-4f8e-aedf-14900d342e18 service swift] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:34.214299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81b6db-364c-4f8e-aedf-14900d342e18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:34.222666 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81b6db-364c-4f8e-aedf-14900d342e18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:34.224358 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81b6db-364c-4f8e-aedf-14900d342e18 service swift] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:34.233589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1399/2766] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 27 16:44:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 16:44:34.445434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39d47f-1df2-4f19-af64-35469fe162f0 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:34.447146 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-fe39d47f-1df2-4f19-af64-35469fe162f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:34.458856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39d47f-1df2-4f19-af64-35469fe162f0 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:34.463072 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142d2af-f943-4de4-bb81-09c1a11f32cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:34.463663 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142d2af-f943-4de4-bb81-09c1a11f32cd service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:34.463937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142d2af-f943-4de4-bb81-09c1a11f32cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:34.464204 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142d2af-f943-4de4-bb81-09c1a11f32cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:34.520884 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142d2af-f943-4de4-bb81-09c1a11f32cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:34.522308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142d2af-f943-4de4-bb81-09c1a11f32cd service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:34.531834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1368/2767] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:44:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:44:36.699706 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81b6db-364c-4f8e-aedf-14900d342e18 service swift] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:36.701523 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-cd81b6db-364c-4f8e-aedf-14900d342e18 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:36.751005 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:36.769073 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81b6db-364c-4f8e-aedf-14900d342e18 service swift] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:36.773741 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afc6d0-399a-40d3-a1e4-020bd0368a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:36.774368 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afc6d0-399a-40d3-a1e4-020bd0368a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:36.774649 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afc6d0-399a-40d3-a1e4-020bd0368a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:36.774923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afc6d0-399a-40d3-a1e4-020bd0368a8d admin admin] PATH_INFO: `/v3/users/5e648f7512374679a1ff33b904f79ce9` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:36.776149 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afc6d0-399a-40d3-a1e4-020bd0368a8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e648f7512374679a1ff33b904f79ce9)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:36.777996 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afc6d0-399a-40d3-a1e4-020bd0368a8d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:36.945135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-59afc6d0-399a-40d3-a1e4-020bd0368a8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e648f7512374679a1ff33b904f79ce9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:36.945812 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-59afc6d0-399a-40d3-a1e4-020bd0368a8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e648f7512374679a1ff33b904f79ce9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:36.958220 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-59afc6d0-399a-40d3-a1e4-020bd0368a8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e648f7512374679a1ff33b904f79ce9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:37.023260 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-59afc6d0-399a-40d3-a1e4-020bd0368a8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e648f7512374679a1ff33b904f79ce9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:37.023908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-59afc6d0-399a-40d3-a1e4-020bd0368a8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e648f7512374679a1ff33b904f79ce9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:37.036886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1400/2768] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:44:36 2022] DELETE /identity/v3/users/5e648f7512374679a1ff33b904f79ce9 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:37.280772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142d2af-f943-4de4-bb81-09c1a11f32cd service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:37.282305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b142d2af-f943-4de4-bb81-09c1a11f32cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:37.297296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142d2af-f943-4de4-bb81-09c1a11f32cd service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:37.326662 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afc6d0-399a-40d3-a1e4-020bd0368a8d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:37.328310 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-59afc6d0-399a-40d3-a1e4-020bd0368a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:37.370937 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922f2c7-2d25-44af-9dc0-5cbfc0bec008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:37.371587 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922f2c7-2d25-44af-9dc0-5cbfc0bec008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:37.379084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922f2c7-2d25-44af-9dc0-5cbfc0bec008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:37.379084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922f2c7-2d25-44af-9dc0-5cbfc0bec008 admin admin] PATH_INFO: `/v3/users/bb34adc9a6e34b7bb2300ab77722ba6e` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:37.379084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922f2c7-2d25-44af-9dc0-5cbfc0bec008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb34adc9a6e34b7bb2300ab77722ba6e)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:37.379084 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922f2c7-2d25-44af-9dc0-5cbfc0bec008 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:37.403919 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afc6d0-399a-40d3-a1e4-020bd0368a8d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:37.408632 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4f165-6219-4474-8c28-652306f1d9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:37.409268 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4f165-6219-4474-8c28-652306f1d9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:37.409549 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4f165-6219-4474-8c28-652306f1d9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:37.409827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4f165-6219-4474-8c28-652306f1d9a9 admin admin] PATH_INFO: `/v3/projects/221ffd9533c047dea909b67355350cb5` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:37.411106 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4f165-6219-4474-8c28-652306f1d9a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=221ffd9533c047dea909b67355350cb5)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:37.413118 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4f165-6219-4474-8c28-652306f1d9a9 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:37.464106 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:37.597912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-54d4f165-6219-4474-8c28-652306f1d9a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '221ffd9533c047dea909b67355350cb5', 'request_id': 'req-54d4f165-6219-4474-8c28-652306f1d9a9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:37.598136 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-c922f2c7-2d25-44af-9dc0-5cbfc0bec008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb34adc9a6e34b7bb2300ab77722ba6e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:37.598863 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-c922f2c7-2d25-44af-9dc0-5cbfc0bec008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb34adc9a6e34b7bb2300ab77722ba6e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:37.604363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-54d4f165-6219-4474-8c28-652306f1d9a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '221ffd9533c047dea909b67355350cb5', 'request_id': 'req-54d4f165-6219-4474-8c28-652306f1d9a9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:37.612066 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-c922f2c7-2d25-44af-9dc0-5cbfc0bec008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb34adc9a6e34b7bb2300ab77722ba6e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:37.668696 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-54d4f165-6219-4474-8c28-652306f1d9a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '221ffd9533c047dea909b67355350cb5', 'request_id': 'req-54d4f165-6219-4474-8c28-652306f1d9a9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:37.672996 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:37.680195 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-54d4f165-6219-4474-8c28-652306f1d9a9 admin admin] The token cache is being invalidate because project 221ffd9533c047dea909b67355350cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:44:37.680516 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-54d4f165-6219-4474-8c28-652306f1d9a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:37.681143 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-54d4f165-6219-4474-8c28-652306f1d9a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:37.682620 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1401/2769] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:44:37 2022] DELETE /identity/v3/projects/221ffd9533c047dea909b67355350cb5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:44:37.686491 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4f165-6219-4474-8c28-652306f1d9a9 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:37.687750 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-54d4f165-6219-4474-8c28-652306f1d9a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:37.748923 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4f165-6219-4474-8c28-652306f1d9a9 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:37.753907 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5784b66-7962-49df-b483-fe712bbfe504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:37.754533 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5784b66-7962-49df-b483-fe712bbfe504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:37.754814 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5784b66-7962-49df-b483-fe712bbfe504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:37.755120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5784b66-7962-49df-b483-fe712bbfe504 admin admin] PATH_INFO: `/v3/users/7deee36bfd5948968864078c6e06a7e9` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:37.756261 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5784b66-7962-49df-b483-fe712bbfe504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7deee36bfd5948968864078c6e06a7e9)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:37.758703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5784b66-7962-49df-b483-fe712bbfe504 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:37.771979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-c922f2c7-2d25-44af-9dc0-5cbfc0bec008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb34adc9a6e34b7bb2300ab77722ba6e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:37.774923 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-c922f2c7-2d25-44af-9dc0-5cbfc0bec008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb34adc9a6e34b7bb2300ab77722ba6e'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:37.786437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1369/2770] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:44:37 2022] DELETE /identity/v3/users/bb34adc9a6e34b7bb2300ab77722ba6e => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:37.790649 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e62d5-34b2-4178-8a60-eb033a3f8714 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:37.790935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e62d5-34b2-4178-8a60-eb033a3f8714 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:37.791207 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e62d5-34b2-4178-8a60-eb033a3f8714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:37.810537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-c78e62d5-34b2-4178-8a60-eb033a3f8714 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:37.811721 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c78e62d5-34b2-4178-8a60-eb033a3f8714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:37.870820 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1370/2771] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:44:37.880513 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e62d5-34b2-4178-8a60-eb033a3f8714 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:37.881835 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c78e62d5-34b2-4178-8a60-eb033a3f8714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:37.937651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e62d5-34b2-4178-8a60-eb033a3f8714 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:37.941295 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd85e29-ccbc-471e-9406-610a14adcbf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:37.941976 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd85e29-ccbc-471e-9406-610a14adcbf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:37.942285 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd85e29-ccbc-471e-9406-610a14adcbf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:37.942580 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd85e29-ccbc-471e-9406-610a14adcbf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:37.952914 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd85e29-ccbc-471e-9406-610a14adcbf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:37.954437 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd85e29-ccbc-471e-9406-610a14adcbf4 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:37.964610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1371/2772] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:44:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:44:38.012320 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a5784b66-7962-49df-b483-fe712bbfe504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7deee36bfd5948968864078c6e06a7e9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.014635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a5784b66-7962-49df-b483-fe712bbfe504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7deee36bfd5948968864078c6e06a7e9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.028750 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a5784b66-7962-49df-b483-fe712bbfe504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7deee36bfd5948968864078c6e06a7e9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.120229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a5784b66-7962-49df-b483-fe712bbfe504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7deee36bfd5948968864078c6e06a7e9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.120950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a5784b66-7962-49df-b483-fe712bbfe504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7deee36bfd5948968864078c6e06a7e9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.135881 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1402/2773] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:44:37 2022] DELETE /identity/v3/users/7deee36bfd5948968864078c6e06a7e9 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:44:38.212725 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd85e29-ccbc-471e-9406-610a14adcbf4 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:38.214140 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6cd85e29-ccbc-471e-9406-610a14adcbf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:38.227847 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd85e29-ccbc-471e-9406-610a14adcbf4 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:38.285719 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:38.299219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81205bcf-e656-41e4-afd7-3778ef94d82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:38.299860 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81205bcf-e656-41e4-afd7-3778ef94d82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:38.300139 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81205bcf-e656-41e4-afd7-3778ef94d82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:38.300443 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81205bcf-e656-41e4-afd7-3778ef94d82b admin admin] PATH_INFO: `/v3/projects/d5e2245cdf2e4478aba54c1e72e2f040` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:38.301581 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81205bcf-e656-41e4-afd7-3778ef94d82b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e2245cdf2e4478aba54c1e72e2f040)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:38.303494 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81205bcf-e656-41e4-afd7-3778ef94d82b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:38.403126 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5784b66-7962-49df-b483-fe712bbfe504 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:38.404836 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a5784b66-7962-49df-b483-fe712bbfe504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:38.419535 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5784b66-7962-49df-b483-fe712bbfe504 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:38.429261 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-81205bcf-e656-41e4-afd7-3778ef94d82b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e2245cdf2e4478aba54c1e72e2f040', 'request_id': 'req-81205bcf-e656-41e4-afd7-3778ef94d82b'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.436614 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-81205bcf-e656-41e4-afd7-3778ef94d82b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e2245cdf2e4478aba54c1e72e2f040', 'request_id': 'req-81205bcf-e656-41e4-afd7-3778ef94d82b'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.482813 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a994db-9969-4344-85a7-9f6f87bd15e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:38.483470 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a994db-9969-4344-85a7-9f6f87bd15e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:38.483747 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a994db-9969-4344-85a7-9f6f87bd15e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:38.484020 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a994db-9969-4344-85a7-9f6f87bd15e1 admin admin] PATH_INFO: `/v3/projects/4064f84be6ce40e4a0aea7eb97f2958d` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:38.485212 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a994db-9969-4344-85a7-9f6f87bd15e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4064f84be6ce40e4a0aea7eb97f2958d)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:38.487091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a994db-9969-4344-85a7-9f6f87bd15e1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:38.505072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:38.509652 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-81205bcf-e656-41e4-afd7-3778ef94d82b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e2245cdf2e4478aba54c1e72e2f040', 'request_id': 'req-81205bcf-e656-41e4-afd7-3778ef94d82b'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.521245 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-81205bcf-e656-41e4-afd7-3778ef94d82b admin admin] The token cache is being invalidate because project d5e2245cdf2e4478aba54c1e72e2f040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:44:38.521965 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-81205bcf-e656-41e4-afd7-3778ef94d82b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.522233 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-81205bcf-e656-41e4-afd7-3778ef94d82b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.524427 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1372/2774] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:44:38 2022] DELETE /identity/v3/projects/d5e2245cdf2e4478aba54c1e72e2f040 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:38.632103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81205bcf-e656-41e4-afd7-3778ef94d82b admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:38.634186 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-81205bcf-e656-41e4-afd7-3778ef94d82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:38.645909 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d6a994db-9969-4344-85a7-9f6f87bd15e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4064f84be6ce40e4a0aea7eb97f2958d', 'request_id': 'req-d6a994db-9969-4344-85a7-9f6f87bd15e1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.647828 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81205bcf-e656-41e4-afd7-3778ef94d82b admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:38.653198 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d6a994db-9969-4344-85a7-9f6f87bd15e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4064f84be6ce40e4a0aea7eb97f2958d', 'request_id': 'req-d6a994db-9969-4344-85a7-9f6f87bd15e1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.713421 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254abd5-73a1-47c7-a47f-afd30e061aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:38.714073 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254abd5-73a1-47c7-a47f-afd30e061aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:38.714353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254abd5-73a1-47c7-a47f-afd30e061aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:38.714627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254abd5-73a1-47c7-a47f-afd30e061aa8 admin admin] PATH_INFO: `/v3/users/398cbd6e1b09465fb68c9ac58fd6f71f` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:38.715798 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254abd5-73a1-47c7-a47f-afd30e061aa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=398cbd6e1b09465fb68c9ac58fd6f71f)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:38.717789 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254abd5-73a1-47c7-a47f-afd30e061aa8 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:38.749325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d6a994db-9969-4344-85a7-9f6f87bd15e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4064f84be6ce40e4a0aea7eb97f2958d', 'request_id': 'req-d6a994db-9969-4344-85a7-9f6f87bd15e1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.761197 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d6a994db-9969-4344-85a7-9f6f87bd15e1 admin admin] The token cache is being invalidate because project 4064f84be6ce40e4a0aea7eb97f2958d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:44:38.761488 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d6a994db-9969-4344-85a7-9f6f87bd15e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.762149 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d6a994db-9969-4344-85a7-9f6f87bd15e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.763618 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1403/2775] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:44:38 2022] DELETE /identity/v3/projects/4064f84be6ce40e4a0aea7eb97f2958d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:44:38.768383 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9a5a6-29fa-40dc-8061-5e55e7cea4fd None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:38.768686 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9a5a6-29fa-40dc-8061-5e55e7cea4fd None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:38.768960 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9a5a6-29fa-40dc-8061-5e55e7cea4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:38.788672 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-85a9a5a6-29fa-40dc-8061-5e55e7cea4fd None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:38.790510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-85a9a5a6-29fa-40dc-8061-5e55e7cea4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:38.798348 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1404/2776] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:44:38.805957 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c99d65-dabb-4945-8f9f-beaca9f99874 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:38.806242 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c99d65-dabb-4945-8f9f-beaca9f99874 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:38.806505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c99d65-dabb-4945-8f9f-beaca9f99874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:38.825800 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-02c99d65-dabb-4945-8f9f-beaca9f99874 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:38.829372 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-02c99d65-dabb-4945-8f9f-beaca9f99874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:38.834737 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1405/2777] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:44:38.839123 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c99d65-dabb-4945-8f9f-beaca9f99874 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:38.847687 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c99d65-dabb-4945-8f9f-beaca9f99874 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:38.852768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824027e-b5ad-47d5-9ba6-39df2af57b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:38.853329 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824027e-b5ad-47d5-9ba6-39df2af57b96 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:38.853602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824027e-b5ad-47d5-9ba6-39df2af57b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:38.853870 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824027e-b5ad-47d5-9ba6-39df2af57b96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:38.854490 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824027e-b5ad-47d5-9ba6-39df2af57b96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:44:38.854790 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824027e-b5ad-47d5-9ba6-39df2af57b96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:38.856362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824027e-b5ad-47d5-9ba6-39df2af57b96 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:38.869374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1406/2778] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 16:44:38.873440 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824027e-b5ad-47d5-9ba6-39df2af57b96 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:38.883089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824027e-b5ad-47d5-9ba6-39df2af57b96 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:38.887949 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a78f54-0d03-41b6-a7c0-74d32c54ebc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:38.888372 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2254abd5-73a1-47c7-a47f-afd30e061aa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '398cbd6e1b09465fb68c9ac58fd6f71f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.888562 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a78f54-0d03-41b6-a7c0-74d32c54ebc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:38.888840 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a78f54-0d03-41b6-a7c0-74d32c54ebc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:38.889054 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2254abd5-73a1-47c7-a47f-afd30e061aa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '398cbd6e1b09465fb68c9ac58fd6f71f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.889171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a78f54-0d03-41b6-a7c0-74d32c54ebc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:38.889718 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a78f54-0d03-41b6-a7c0-74d32c54ebc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:38.891591 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a78f54-0d03-41b6-a7c0-74d32c54ebc4 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:38.902368 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2254abd5-73a1-47c7-a47f-afd30e061aa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '398cbd6e1b09465fb68c9ac58fd6f71f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.971354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2254abd5-73a1-47c7-a47f-afd30e061aa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '398cbd6e1b09465fb68c9ac58fd6f71f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.971991 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2254abd5-73a1-47c7-a47f-afd30e061aa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '398cbd6e1b09465fb68c9ac58fd6f71f'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:38.978259 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:38.985486 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1373/2779] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:44:38 2022] DELETE /identity/v3/users/398cbd6e1b09465fb68c9ac58fd6f71f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:38.990006 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6998c50-eb81-4e2e-b773-8ce65ab10ab9 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:38.990289 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6998c50-eb81-4e2e-b773-8ce65ab10ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:38.990564 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6998c50-eb81-4e2e-b773-8ce65ab10ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:38.990853 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1407/2780] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:44:38 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:44:38.994414 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a78f54-0d03-41b6-a7c0-74d32c54ebc4 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:38.995989 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-63a78f54-0d03-41b6-a7c0-74d32c54ebc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:39.010643 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-d6998c50-eb81-4e2e-b773-8ce65ab10ab9 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:39.012772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-d6998c50-eb81-4e2e-b773-8ce65ab10ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:39.064736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a78f54-0d03-41b6-a7c0-74d32c54ebc4 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:39.069832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42383200-40d8-4bcd-b4ac-009c7c8e59a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:39.070976 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42383200-40d8-4bcd-b4ac-009c7c8e59a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:39.071249 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42383200-40d8-4bcd-b4ac-009c7c8e59a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:39.071522 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42383200-40d8-4bcd-b4ac-009c7c8e59a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:39.072423 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42383200-40d8-4bcd-b4ac-009c7c8e59a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:39.074327 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42383200-40d8-4bcd-b4ac-009c7c8e59a7 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:39.078090 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1374/2781] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:44:39.088889 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6998c50-eb81-4e2e-b773-8ce65ab10ab9 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:39.090237 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-d6998c50-eb81-4e2e-b773-8ce65ab10ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:39.149559 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6998c50-eb81-4e2e-b773-8ce65ab10ab9 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:39.153413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db5caa-5622-4bd4-a49d-e11933ce572e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:39.154021 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db5caa-5622-4bd4-a49d-e11933ce572e service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:39.154301 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db5caa-5622-4bd4-a49d-e11933ce572e service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:39.154572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db5caa-5622-4bd4-a49d-e11933ce572e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:39.164724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db5caa-5622-4bd4-a49d-e11933ce572e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:39.166158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db5caa-5622-4bd4-a49d-e11933ce572e service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:39.167865 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1408/2782] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:44:38 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:44:39.171644 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42383200-40d8-4bcd-b4ac-009c7c8e59a7 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:39.178572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1375/2783] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:44:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:44:39.182803 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42383200-40d8-4bcd-b4ac-009c7c8e59a7 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:39.187593 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10481c10-ed32-485d-9453-1ace601a8257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:39.194617 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10481c10-ed32-485d-9453-1ace601a8257 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:39.194617 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10481c10-ed32-485d-9453-1ace601a8257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:39.194617 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10481c10-ed32-485d-9453-1ace601a8257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:39.194617 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10481c10-ed32-485d-9453-1ace601a8257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:39.194617 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10481c10-ed32-485d-9453-1ace601a8257 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:39.201922 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1409/2784] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:44:39.206982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db5caa-5622-4bd4-a49d-e11933ce572e service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:39.220072 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db5caa-5622-4bd4-a49d-e11933ce572e service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:39.226308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f837a-172d-4b47-81f9-dfa8268bbd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:39.227583 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f837a-172d-4b47-81f9-dfa8268bbd97 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:39.228308 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f837a-172d-4b47-81f9-dfa8268bbd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:39.228681 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f837a-172d-4b47-81f9-dfa8268bbd97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:39.229417 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f837a-172d-4b47-81f9-dfa8268bbd97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:39.231548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f837a-172d-4b47-81f9-dfa8268bbd97 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:39.244714 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1376/2785] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:44:39.249026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10481c10-ed32-485d-9453-1ace601a8257 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:39.262273 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10481c10-ed32-485d-9453-1ace601a8257 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:39.267266 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a6ea3-54e7-40c1-beda-7c4cd8e0323e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:39.267933 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a6ea3-54e7-40c1-beda-7c4cd8e0323e admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:39.268211 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a6ea3-54e7-40c1-beda-7c4cd8e0323e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:39.268564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a6ea3-54e7-40c1-beda-7c4cd8e0323e admin admin] PATH_INFO: `/v3/projects/5dbc51cc550e4fd7ae9be92520177975/users/b8a74a34c7664d7e830166d7dc5185b3/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:39.286912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a6ea3-54e7-40c1-beda-7c4cd8e0323e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dbc51cc550e4fd7ae9be92520177975, user_id=b8a74a34c7664d7e830166d7dc5185b3, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:39.289563 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a6ea3-54e7-40c1-beda-7c4cd8e0323e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:39.441191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1410/2786] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:44:39 2022] PUT /identity/v3/projects/5dbc51cc550e4fd7ae9be92520177975/users/b8a74a34c7664d7e830166d7dc5185b3/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:39.452790 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0793c0-51a1-4bcd-8791-b83463f725e1 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:39.453310 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0793c0-51a1-4bcd-8791-b83463f725e1 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:39.454094 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0793c0-51a1-4bcd-8791-b83463f725e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:39.487173 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-4e0793c0-51a1-4bcd-8791-b83463f725e1 None None] MFA Rules not processed for user `b8a74a34c7664d7e830166d7dc5185b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:39.488671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-4e0793c0-51a1-4bcd-8791-b83463f725e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:39.556216 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1377/2787] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:39.567418 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a6ea3-54e7-40c1-beda-7c4cd8e0323e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:39.569188 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f54a6ea3-54e7-40c1-beda-7c4cd8e0323e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:39.581653 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:39.628905 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a6ea3-54e7-40c1-beda-7c4cd8e0323e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:39.632697 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f98359-89a7-47a0-b11a-28e2775b95fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:39.633827 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f98359-89a7-47a0-b11a-28e2775b95fa service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:39.634105 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f98359-89a7-47a0-b11a-28e2775b95fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:39.634380 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f98359-89a7-47a0-b11a-28e2775b95fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:39.647770 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f98359-89a7-47a0-b11a-28e2775b95fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:39.649325 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f98359-89a7-47a0-b11a-28e2775b95fa service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:39.658674 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1411/2788] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:44:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:44:39.686955 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0793c0-51a1-4bcd-8791-b83463f725e1 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:39.707184 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=100 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:39.750025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0793c0-51a1-4bcd-8791-b83463f725e1 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:39.754688 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781d57a-0cbb-482c-aa6d-6d48d12650ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:39.755314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781d57a-0cbb-482c-aa6d-6d48d12650ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:39.755595 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781d57a-0cbb-482c-aa6d-6d48d12650ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:39.755873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781d57a-0cbb-482c-aa6d-6d48d12650ae admin admin] PATH_INFO: `/v3/users/b8a74a34c7664d7e830166d7dc5185b3` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:39.757012 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781d57a-0cbb-482c-aa6d-6d48d12650ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8a74a34c7664d7e830166d7dc5185b3)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:39.758946 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781d57a-0cbb-482c-aa6d-6d48d12650ae admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:39.768180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f98359-89a7-47a0-b11a-28e2775b95fa service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:39.773460 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d3f98359-89a7-47a0-b11a-28e2775b95fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:39.800648 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f98359-89a7-47a0-b11a-28e2775b95fa service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:39.807054 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf68d22-527f-4b43-88eb-f1450771a706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:39.807975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf68d22-527f-4b43-88eb-f1450771a706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:39.808355 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf68d22-527f-4b43-88eb-f1450771a706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:39.808747 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf68d22-527f-4b43-88eb-f1450771a706 admin admin] PATH_INFO: `/v3/projects/f5818f6254a2492895678f6119e60b83` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:39.810126 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf68d22-527f-4b43-88eb-f1450771a706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5818f6254a2492895678f6119e60b83)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:39.812253 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf68d22-527f-4b43-88eb-f1450771a706 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:40.007493 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-0781d57a-0cbb-482c-aa6d-6d48d12650ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8a74a34c7664d7e830166d7dc5185b3'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:40.008712 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-0781d57a-0cbb-482c-aa6d-6d48d12650ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8a74a34c7664d7e830166d7dc5185b3'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:40.013180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8bf68d22-527f-4b43-88eb-f1450771a706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5818f6254a2492895678f6119e60b83', 'request_id': 'req-8bf68d22-527f-4b43-88eb-f1450771a706'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:40.024110 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8bf68d22-527f-4b43-88eb-f1450771a706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5818f6254a2492895678f6119e60b83', 'request_id': 'req-8bf68d22-527f-4b43-88eb-f1450771a706'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:40.030293 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-0781d57a-0cbb-482c-aa6d-6d48d12650ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8a74a34c7664d7e830166d7dc5185b3'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:40.097535 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8bf68d22-527f-4b43-88eb-f1450771a706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5818f6254a2492895678f6119e60b83', 'request_id': 'req-8bf68d22-527f-4b43-88eb-f1450771a706'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:40.109972 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8bf68d22-527f-4b43-88eb-f1450771a706 admin admin] The token cache is being invalidate because project f5818f6254a2492895678f6119e60b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:44:40.110265 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8bf68d22-527f-4b43-88eb-f1450771a706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:40.110930 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8bf68d22-527f-4b43-88eb-f1450771a706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:40.117556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1412/2789] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:44:39 2022] DELETE /identity/v3/projects/f5818f6254a2492895678f6119e60b83 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:40.117556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf68d22-527f-4b43-88eb-f1450771a706 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:40.118661 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8bf68d22-527f-4b43-88eb-f1450771a706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:40.194526 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-0781d57a-0cbb-482c-aa6d-6d48d12650ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8a74a34c7664d7e830166d7dc5185b3'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:40.194743 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf68d22-527f-4b43-88eb-f1450771a706 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:40.195357 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-0781d57a-0cbb-482c-aa6d-6d48d12650ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8a74a34c7664d7e830166d7dc5185b3'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:40.199984 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c4cb9-8735-4ce5-b7b9-833df14713a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:40.203994 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c4cb9-8735-4ce5-b7b9-833df14713a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:40.203994 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c4cb9-8735-4ce5-b7b9-833df14713a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:40.203994 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c4cb9-8735-4ce5-b7b9-833df14713a7 admin admin] PATH_INFO: `/v3/users/9b769975056944578afde4dc71f26df2` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:40.203994 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c4cb9-8735-4ce5-b7b9-833df14713a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b769975056944578afde4dc71f26df2)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:40.204774 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c4cb9-8735-4ce5-b7b9-833df14713a7 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:40.210065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1378/2790] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:44:39 2022] DELETE /identity/v3/users/b8a74a34c7664d7e830166d7dc5185b3 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:40.217028 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e17d58-dc8f-4837-8a63-ce3d44a4c892 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:40.217743 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e17d58-dc8f-4837-8a63-ce3d44a4c892 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:40.218102 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e17d58-dc8f-4837-8a63-ce3d44a4c892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:40.253793 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-46e17d58-dc8f-4837-8a63-ce3d44a4c892 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:40.254954 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-46e17d58-dc8f-4837-8a63-ce3d44a4c892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:40.335413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1379/2791] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:40.350609 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e17d58-dc8f-4837-8a63-ce3d44a4c892 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:40.352883 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-46e17d58-dc8f-4837-8a63-ce3d44a4c892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:40.401110 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:40.417817 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e17d58-dc8f-4837-8a63-ce3d44a4c892 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:40.421429 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8d15c-82e1-438f-a3f8-d5b53f14c11a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:40.422036 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8d15c-82e1-438f-a3f8-d5b53f14c11a service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:40.422313 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8d15c-82e1-438f-a3f8-d5b53f14c11a service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:40.422585 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8d15c-82e1-438f-a3f8-d5b53f14c11a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:40.433694 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8d15c-82e1-438f-a3f8-d5b53f14c11a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:40.435065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8d15c-82e1-438f-a3f8-d5b53f14c11a service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:40.436264 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:40.445277 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0a9c4cb9-8735-4ce5-b7b9-833df14713a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b769975056944578afde4dc71f26df2'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:40.446085 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0a9c4cb9-8735-4ce5-b7b9-833df14713a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b769975056944578afde4dc71f26df2'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:40.449842 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1380/2792] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:44:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:44:40.468620 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0a9c4cb9-8735-4ce5-b7b9-833df14713a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b769975056944578afde4dc71f26df2'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:40.537268 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0a9c4cb9-8735-4ce5-b7b9-833df14713a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b769975056944578afde4dc71f26df2'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:40.538111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0a9c4cb9-8735-4ce5-b7b9-833df14713a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b769975056944578afde4dc71f26df2'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:40.552532 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1413/2793] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:44:40 2022] DELETE /identity/v3/users/9b769975056944578afde4dc71f26df2 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:41.205353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8d15c-82e1-438f-a3f8-d5b53f14c11a service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:41.219290 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c4cb9-8735-4ce5-b7b9-833df14713a7 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:41.221421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0a9c4cb9-8735-4ce5-b7b9-833df14713a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:41.264713 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8d15c-82e1-438f-a3f8-d5b53f14c11a service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:41.331307 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0e1f0-85b4-4ad8-8ccf-9aa93ae54fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:41.332186 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0e1f0-85b4-4ad8-8ccf-9aa93ae54fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:41.332310 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0e1f0-85b4-4ad8-8ccf-9aa93ae54fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:41.332613 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0e1f0-85b4-4ad8-8ccf-9aa93ae54fca admin admin] PATH_INFO: `/v3/projects/03d2eb3afc214b5483c4d17528a8b668` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:41.333970 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0e1f0-85b4-4ad8-8ccf-9aa93ae54fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=03d2eb3afc214b5483c4d17528a8b668)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:41.336455 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0e1f0-85b4-4ad8-8ccf-9aa93ae54fca admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:41.405209 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c4cb9-8735-4ce5-b7b9-833df14713a7 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:41.411595 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8000c-22b9-42d7-be83-08b9680a2428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:41.412231 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8000c-22b9-42d7-be83-08b9680a2428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:41.412544 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8000c-22b9-42d7-be83-08b9680a2428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:41.412851 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8000c-22b9-42d7-be83-08b9680a2428 admin admin] PATH_INFO: `/v3/projects/5dbc51cc550e4fd7ae9be92520177975` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:41.415178 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8000c-22b9-42d7-be83-08b9680a2428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dbc51cc550e4fd7ae9be92520177975)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:41.416586 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8000c-22b9-42d7-be83-08b9680a2428 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:41.497658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-3ee0e1f0-85b4-4ad8-8ccf-9aa93ae54fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03d2eb3afc214b5483c4d17528a8b668', 'request_id': 'req-3ee0e1f0-85b4-4ad8-8ccf-9aa93ae54fca'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:41.504363 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-3ee0e1f0-85b4-4ad8-8ccf-9aa93ae54fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03d2eb3afc214b5483c4d17528a8b668', 'request_id': 'req-3ee0e1f0-85b4-4ad8-8ccf-9aa93ae54fca'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:41.570815 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2ec8000c-22b9-42d7-be83-08b9680a2428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dbc51cc550e4fd7ae9be92520177975', 'request_id': 'req-2ec8000c-22b9-42d7-be83-08b9680a2428'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:41.577754 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2ec8000c-22b9-42d7-be83-08b9680a2428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dbc51cc550e4fd7ae9be92520177975', 'request_id': 'req-2ec8000c-22b9-42d7-be83-08b9680a2428'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:41.580944 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:41.583659 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-3ee0e1f0-85b4-4ad8-8ccf-9aa93ae54fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03d2eb3afc214b5483c4d17528a8b668', 'request_id': 'req-3ee0e1f0-85b4-4ad8-8ccf-9aa93ae54fca'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:41.598947 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-3ee0e1f0-85b4-4ad8-8ccf-9aa93ae54fca admin admin] The token cache is being invalidate because project 03d2eb3afc214b5483c4d17528a8b668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:44:41.599254 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-3ee0e1f0-85b4-4ad8-8ccf-9aa93ae54fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:41.599912 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-3ee0e1f0-85b4-4ad8-8ccf-9aa93ae54fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:41.604450 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1381/2794] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:44:41 2022] DELETE /identity/v3/projects/03d2eb3afc214b5483c4d17528a8b668 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:41.605855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0e1f0-85b4-4ad8-8ccf-9aa93ae54fca admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:41.607202 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-3ee0e1f0-85b4-4ad8-8ccf-9aa93ae54fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:41.648935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:41.671413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0e1f0-85b4-4ad8-8ccf-9aa93ae54fca admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:41.692024 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2ec8000c-22b9-42d7-be83-08b9680a2428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dbc51cc550e4fd7ae9be92520177975', 'request_id': 'req-2ec8000c-22b9-42d7-be83-08b9680a2428'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:41.712170 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2ec8000c-22b9-42d7-be83-08b9680a2428 admin admin] The token cache is being invalidate because project 5dbc51cc550e4fd7ae9be92520177975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:44:41.712916 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2ec8000c-22b9-42d7-be83-08b9680a2428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:41.713765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2ec8000c-22b9-42d7-be83-08b9680a2428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:41.715529 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1414/2795] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:44:41 2022] DELETE /identity/v3/projects/5dbc51cc550e4fd7ae9be92520177975 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:44:41.732047 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1e604-8b05-4494-86bc-9f73e9388313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:41.732758 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1e604-8b05-4494-86bc-9f73e9388313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:41.733041 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1e604-8b05-4494-86bc-9f73e9388313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:41.733319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1e604-8b05-4494-86bc-9f73e9388313 admin admin] PATH_INFO: `/v3/users/897a17f85292476db6997056e1520e54` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:41.734601 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1e604-8b05-4494-86bc-9f73e9388313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=897a17f85292476db6997056e1520e54)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:41.736718 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1e604-8b05-4494-86bc-9f73e9388313 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:41.961759 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-96c1e604-8b05-4494-86bc-9f73e9388313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897a17f85292476db6997056e1520e54'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:41.962451 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-96c1e604-8b05-4494-86bc-9f73e9388313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897a17f85292476db6997056e1520e54'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:41.985211 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-96c1e604-8b05-4494-86bc-9f73e9388313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897a17f85292476db6997056e1520e54'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:42.034787 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-96c1e604-8b05-4494-86bc-9f73e9388313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897a17f85292476db6997056e1520e54'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:42.035433 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-96c1e604-8b05-4494-86bc-9f73e9388313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897a17f85292476db6997056e1520e54'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:42.056430 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1382/2796] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:44:41 2022] DELETE /identity/v3/users/897a17f85292476db6997056e1520e54 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:44:42.567524 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8000c-22b9-42d7-be83-08b9680a2428 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:42.570295 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2ec8000c-22b9-42d7-be83-08b9680a2428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:42.584140 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8000c-22b9-42d7-be83-08b9680a2428 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:42.657234 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9054ad-2b3b-4ca6-a32a-9fa36e23cd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:42.657831 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9054ad-2b3b-4ca6-a32a-9fa36e23cd7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:42.658138 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9054ad-2b3b-4ca6-a32a-9fa36e23cd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:42.658813 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9054ad-2b3b-4ca6-a32a-9fa36e23cd7f admin admin] PATH_INFO: `/v3/projects/5301b13afa4147eb88984952287aef72` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:42.659765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9054ad-2b3b-4ca6-a32a-9fa36e23cd7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5301b13afa4147eb88984952287aef72)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:42.661703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9054ad-2b3b-4ca6-a32a-9fa36e23cd7f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:42.756627 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-cd9054ad-2b3b-4ca6-a32a-9fa36e23cd7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5301b13afa4147eb88984952287aef72', 'request_id': 'req-cd9054ad-2b3b-4ca6-a32a-9fa36e23cd7f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:42.763699 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-cd9054ad-2b3b-4ca6-a32a-9fa36e23cd7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5301b13afa4147eb88984952287aef72', 'request_id': 'req-cd9054ad-2b3b-4ca6-a32a-9fa36e23cd7f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:42.909039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-cd9054ad-2b3b-4ca6-a32a-9fa36e23cd7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5301b13afa4147eb88984952287aef72', 'request_id': 'req-cd9054ad-2b3b-4ca6-a32a-9fa36e23cd7f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:42.921117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-cd9054ad-2b3b-4ca6-a32a-9fa36e23cd7f admin admin] The token cache is being invalidate because project 5301b13afa4147eb88984952287aef72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:44:42.921408 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-cd9054ad-2b3b-4ca6-a32a-9fa36e23cd7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:42.922027 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-cd9054ad-2b3b-4ca6-a32a-9fa36e23cd7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:42.923500 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1415/2797] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:44:42 2022] DELETE /identity/v3/projects/5301b13afa4147eb88984952287aef72 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:42.929511 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d7c54-c97c-447e-b514-3d9325cb1290 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:42.930523 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d7c54-c97c-447e-b514-3d9325cb1290 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:42.930731 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d7c54-c97c-447e-b514-3d9325cb1290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:42.987732 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-b07d7c54-c97c-447e-b514-3d9325cb1290 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:42.988957 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-b07d7c54-c97c-447e-b514-3d9325cb1290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:43.017476 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:43.047537 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1383/2798] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:43.057098 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f9502-5133-4b5c-8c3f-3ad43c5018d9 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:43.057387 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f9502-5133-4b5c-8c3f-3ad43c5018d9 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:43.057664 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f9502-5133-4b5c-8c3f-3ad43c5018d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:43.078107 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b74f9502-5133-4b5c-8c3f-3ad43c5018d9 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:43.079357 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b74f9502-5133-4b5c-8c3f-3ad43c5018d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:43.087820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1416/2799] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:44:43.092085 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d7c54-c97c-447e-b514-3d9325cb1290 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:43.102305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d7c54-c97c-447e-b514-3d9325cb1290 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:43.106837 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aee564-7352-4e8d-b7ef-d9acd177a954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:43.107443 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aee564-7352-4e8d-b7ef-d9acd177a954 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:43.107724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aee564-7352-4e8d-b7ef-d9acd177a954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:43.108001 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aee564-7352-4e8d-b7ef-d9acd177a954 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:43.108690 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aee564-7352-4e8d-b7ef-d9acd177a954 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:44:43.109000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aee564-7352-4e8d-b7ef-d9acd177a954 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:43.110601 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aee564-7352-4e8d-b7ef-d9acd177a954 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:43.122097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1384/2800] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:44:43.126558 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f9502-5133-4b5c-8c3f-3ad43c5018d9 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:43.135672 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f9502-5133-4b5c-8c3f-3ad43c5018d9 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:43.140510 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11da7d5-b18a-4955-aef5-10816fac2da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:43.146983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11da7d5-b18a-4955-aef5-10816fac2da3 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:43.146983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11da7d5-b18a-4955-aef5-10816fac2da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:43.146983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11da7d5-b18a-4955-aef5-10816fac2da3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:43.146983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11da7d5-b18a-4955-aef5-10816fac2da3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:43.146983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11da7d5-b18a-4955-aef5-10816fac2da3 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:43.231150 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1417/2801] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:44:43 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:44:43.235315 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aee564-7352-4e8d-b7ef-d9acd177a954 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:43.245188 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aee564-7352-4e8d-b7ef-d9acd177a954 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:43.300925 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0fa50-e1e5-4c08-9ab2-199195f54167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:43.301525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0fa50-e1e5-4c08-9ab2-199195f54167 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:43.301813 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0fa50-e1e5-4c08-9ab2-199195f54167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:43.302086 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0fa50-e1e5-4c08-9ab2-199195f54167 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:43.302712 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0fa50-e1e5-4c08-9ab2-199195f54167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:43.304687 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0fa50-e1e5-4c08-9ab2-199195f54167 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:43.406078 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1385/2802] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:44:43 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:44:43.410287 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11da7d5-b18a-4955-aef5-10816fac2da3 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:43.421133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11da7d5-b18a-4955-aef5-10816fac2da3 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:43.425707 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40a66e-74cf-4a56-abd6-fb89ede2e834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:43.426273 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40a66e-74cf-4a56-abd6-fb89ede2e834 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:43.426547 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40a66e-74cf-4a56-abd6-fb89ede2e834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:43.426816 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40a66e-74cf-4a56-abd6-fb89ede2e834 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:43.427441 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40a66e-74cf-4a56-abd6-fb89ede2e834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:43.429053 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40a66e-74cf-4a56-abd6-fb89ede2e834 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:43.438748 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1418/2803] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:44:43.447935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0fa50-e1e5-4c08-9ab2-199195f54167 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:43.458064 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0fa50-e1e5-4c08-9ab2-199195f54167 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:43.463244 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2291e-f6d6-4f4e-9627-01b02117c91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:43.463834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2291e-f6d6-4f4e-9627-01b02117c91e admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:43.464157 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2291e-f6d6-4f4e-9627-01b02117c91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:43.464462 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2291e-f6d6-4f4e-9627-01b02117c91e admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:43.465099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2291e-f6d6-4f4e-9627-01b02117c91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:43.466866 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2291e-f6d6-4f4e-9627-01b02117c91e admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:43.478224 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1386/2804] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:44:43.482617 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40a66e-74cf-4a56-abd6-fb89ede2e834 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:43.492467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40a66e-74cf-4a56-abd6-fb89ede2e834 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:43.497272 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f908b-1615-417e-b632-da5fb3cb6c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:43.497912 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f908b-1615-417e-b632-da5fb3cb6c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:43.498192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f908b-1615-417e-b632-da5fb3cb6c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:43.498465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f908b-1615-417e-b632-da5fb3cb6c96 admin admin] PATH_INFO: `/v3/projects/b74a4951eed640378fb40b394a3f3646/users/f54aa584d8f44d7083df30159b3ae78a/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:43.513229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f908b-1615-417e-b632-da5fb3cb6c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74a4951eed640378fb40b394a3f3646, user_id=f54aa584d8f44d7083df30159b3ae78a, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:43.515858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f908b-1615-417e-b632-da5fb3cb6c96 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:43.594281 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1419/2805] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:44:43 2022] PUT /identity/v3/projects/b74a4951eed640378fb40b394a3f3646/users/f54aa584d8f44d7083df30159b3ae78a/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:44:43.605516 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e42607-baef-49d4-a24d-d0c482ffd8ce None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:43.618900 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e42607-baef-49d4-a24d-d0c482ffd8ce None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:43.618900 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e42607-baef-49d4-a24d-d0c482ffd8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:43.633964 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-77e42607-baef-49d4-a24d-d0c482ffd8ce None None] MFA Rules not processed for user `f54aa584d8f44d7083df30159b3ae78a`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:43.635179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-77e42607-baef-49d4-a24d-d0c482ffd8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:43.700518 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1387/2806] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:43.704644 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f908b-1615-417e-b632-da5fb3cb6c96 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:43.715226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:43.765579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f908b-1615-417e-b632-da5fb3cb6c96 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:43.770200 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d9cc4-531b-4f00-8edb-9672c51fe90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:43.770804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d9cc4-531b-4f00-8edb-9672c51fe90d admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:43.771079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d9cc4-531b-4f00-8edb-9672c51fe90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:43.771354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d9cc4-531b-4f00-8edb-9672c51fe90d admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:43.771978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d9cc4-531b-4f00-8edb-9672c51fe90d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:43.774439 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d9cc4-531b-4f00-8edb-9672c51fe90d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:43.859247 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1420/2807] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:44:43 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:44:43.863534 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e42607-baef-49d4-a24d-d0c482ffd8ce None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:43.874387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e42607-baef-49d4-a24d-d0c482ffd8ce None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:43.900507 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:43.931081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbcea6-a510-4e70-ad22-ec31ffc845ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:43.931692 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbcea6-a510-4e70-ad22-ec31ffc845ca admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:43.934208 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbcea6-a510-4e70-ad22-ec31ffc845ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:43.934208 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbcea6-a510-4e70-ad22-ec31ffc845ca admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:43.934208 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dbcea6-a510-4e70-ad22-ec31ffc845ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:43.934829 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dbcea6-a510-4e70-ad22-ec31ffc845ca admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:43.992201 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1388/2808] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:44:43 2022] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:44:43.993395 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d9cc4-531b-4f00-8edb-9672c51fe90d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:44.003901 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d9cc4-531b-4f00-8edb-9672c51fe90d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:44.009622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362262f-da92-4d0f-a309-b4f0a0f9c636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:44.010303 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362262f-da92-4d0f-a309-b4f0a0f9c636 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:44.010654 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362262f-da92-4d0f-a309-b4f0a0f9c636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:44.010993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362262f-da92-4d0f-a309-b4f0a0f9c636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:44.011642 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362262f-da92-4d0f-a309-b4f0a0f9c636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:44.013263 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362262f-da92-4d0f-a309-b4f0a0f9c636 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:44.027680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1421/2809] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 16:44:44.029718 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbcea6-a510-4e70-ad22-ec31ffc845ca admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:44.041250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbcea6-a510-4e70-ad22-ec31ffc845ca admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:44.046993 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6af4b-d107-4131-9525-aa6f97887176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:44.049090 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6af4b-d107-4131-9525-aa6f97887176 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:44.049090 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6af4b-d107-4131-9525-aa6f97887176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:44.049090 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6af4b-d107-4131-9525-aa6f97887176 admin admin] PATH_INFO: `/v3/projects/7c694e5561674f81adf27869329314b2/users/a405862d25af47809d8d254f7c530575/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:44.067483 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6af4b-d107-4131-9525-aa6f97887176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c694e5561674f81adf27869329314b2, user_id=a405862d25af47809d8d254f7c530575, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:44.072191 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6af4b-d107-4131-9525-aa6f97887176 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:44.143271 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1389/2810] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:44:44 2022] PUT /identity/v3/projects/7c694e5561674f81adf27869329314b2/users/a405862d25af47809d8d254f7c530575/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:44.152138 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362262f-da92-4d0f-a309-b4f0a0f9c636 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:44.161948 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362262f-da92-4d0f-a309-b4f0a0f9c636 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:44.217738 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca0157-92f2-44bb-83da-5278c422917f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:44.218257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca0157-92f2-44bb-83da-5278c422917f admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:44.218534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca0157-92f2-44bb-83da-5278c422917f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:44.218822 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca0157-92f2-44bb-83da-5278c422917f admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:44.219419 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca0157-92f2-44bb-83da-5278c422917f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:44.221026 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca0157-92f2-44bb-83da-5278c422917f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:44.231125 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1422/2811] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:44:44.235440 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6af4b-d107-4131-9525-aa6f97887176 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:44.245799 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6af4b-d107-4131-9525-aa6f97887176 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:44.253097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351867e-8ee7-4c46-b9ab-ddb7b5d90f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:44.253097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351867e-8ee7-4c46-b9ab-ddb7b5d90f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:44.253097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351867e-8ee7-4c46-b9ab-ddb7b5d90f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:44.253097 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351867e-8ee7-4c46-b9ab-ddb7b5d90f10 admin admin] PATH_INFO: `/v3/projects/7c694e5561674f81adf27869329314b2/users/a405862d25af47809d8d254f7c530575/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:44.253904 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351867e-8ee7-4c46-b9ab-ddb7b5d90f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c694e5561674f81adf27869329314b2, user_id=a405862d25af47809d8d254f7c530575, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:44.256531 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351867e-8ee7-4c46-b9ab-ddb7b5d90f10 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:44.269240 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1390/2812] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:44:44 2022] PUT /identity/v3/projects/7c694e5561674f81adf27869329314b2/users/a405862d25af47809d8d254f7c530575/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:44.281155 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c3ba5-8c84-401a-a175-8aae712e5bb4 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:44.281517 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c3ba5-8c84-401a-a175-8aae712e5bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:44.281804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c3ba5-8c84-401a-a175-8aae712e5bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:44.309780 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-be5c3ba5-8c84-401a-a175-8aae712e5bb4 None None] MFA Rules not processed for user `a405862d25af47809d8d254f7c530575`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:44.310990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-be5c3ba5-8c84-401a-a175-8aae712e5bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:44.379805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1423/2813] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:44.391657 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351867e-8ee7-4c46-b9ab-ddb7b5d90f10 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:44.393463 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-0351867e-8ee7-4c46-b9ab-ddb7b5d90f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:44.467434 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351867e-8ee7-4c46-b9ab-ddb7b5d90f10 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:44.471068 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ade47-db4b-43bb-b5ac-214418bb6c8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:44.471706 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ade47-db4b-43bb-b5ac-214418bb6c8a service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:44.471976 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ade47-db4b-43bb-b5ac-214418bb6c8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:44.472252 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ade47-db4b-43bb-b5ac-214418bb6c8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:44.481356 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ade47-db4b-43bb-b5ac-214418bb6c8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:44.482786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ade47-db4b-43bb-b5ac-214418bb6c8a service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:44.492377 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1391/2814] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:44:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:44:45.031480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c3ba5-8c84-401a-a175-8aae712e5bb4 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:45.037132 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:45.095732 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c3ba5-8c84-401a-a175-8aae712e5bb4 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:45.100773 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb2c27-468d-4f77-9f66-03771545ee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:45.101891 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb2c27-468d-4f77-9f66-03771545ee08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:45.102196 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb2c27-468d-4f77-9f66-03771545ee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:45.102475 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb2c27-468d-4f77-9f66-03771545ee08 admin admin] PATH_INFO: `/v3/users/f54aa584d8f44d7083df30159b3ae78a` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:45.103631 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb2c27-468d-4f77-9f66-03771545ee08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f54aa584d8f44d7083df30159b3ae78a)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:45.105577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb2c27-468d-4f77-9f66-03771545ee08 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:45.253137 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ebfb2c27-468d-4f77-9f66-03771545ee08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f54aa584d8f44d7083df30159b3ae78a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:45.253789 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ebfb2c27-468d-4f77-9f66-03771545ee08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f54aa584d8f44d7083df30159b3ae78a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:45.266372 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ebfb2c27-468d-4f77-9f66-03771545ee08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f54aa584d8f44d7083df30159b3ae78a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:45.314703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ebfb2c27-468d-4f77-9f66-03771545ee08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f54aa584d8f44d7083df30159b3ae78a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:45.315394 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ebfb2c27-468d-4f77-9f66-03771545ee08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f54aa584d8f44d7083df30159b3ae78a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:45.329780 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1424/2815] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:44:45 2022] DELETE /identity/v3/users/f54aa584d8f44d7083df30159b3ae78a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:45.334012 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5e540-3f3e-4b70-8034-48c05d6c9ac3 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:45.334473 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5e540-3f3e-4b70-8034-48c05d6c9ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:45.334649 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5e540-3f3e-4b70-8034-48c05d6c9ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:45.354413 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-f3a5e540-3f3e-4b70-8034-48c05d6c9ac3 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:45.355617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f3a5e540-3f3e-4b70-8034-48c05d6c9ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:45.416539 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1392/2816] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:45.426136 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb2c27-468d-4f77-9f66-03771545ee08 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:45.427602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ebfb2c27-468d-4f77-9f66-03771545ee08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:45.486407 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb2c27-468d-4f77-9f66-03771545ee08 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:45.490109 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1e782-a4a9-40e6-9d28-e0f4a2b181d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:45.490717 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1e782-a4a9-40e6-9d28-e0f4a2b181d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:45.490997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1e782-a4a9-40e6-9d28-e0f4a2b181d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:45.491273 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1e782-a4a9-40e6-9d28-e0f4a2b181d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:45.500906 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1e782-a4a9-40e6-9d28-e0f4a2b181d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:45.502317 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1e782-a4a9-40e6-9d28-e0f4a2b181d9 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:45.512434 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1425/2817] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:44:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:44:45.951020 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5e540-3f3e-4b70-8034-48c05d6c9ac3 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:45.952513 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f3a5e540-3f3e-4b70-8034-48c05d6c9ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:45.965633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5e540-3f3e-4b70-8034-48c05d6c9ac3 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:45.970452 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16db8a7-6976-4b88-ba2d-4ab9435c0209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:45.971087 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16db8a7-6976-4b88-ba2d-4ab9435c0209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:45.971372 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16db8a7-6976-4b88-ba2d-4ab9435c0209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:45.972159 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16db8a7-6976-4b88-ba2d-4ab9435c0209 admin admin] PATH_INFO: `/v3/projects/b74a4951eed640378fb40b394a3f3646` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:45.973506 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16db8a7-6976-4b88-ba2d-4ab9435c0209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74a4951eed640378fb40b394a3f3646)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:45.975454 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16db8a7-6976-4b88-ba2d-4ab9435c0209 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:45.978570 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:46.080727 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a16db8a7-6976-4b88-ba2d-4ab9435c0209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74a4951eed640378fb40b394a3f3646', 'request_id': 'req-a16db8a7-6976-4b88-ba2d-4ab9435c0209'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:46.087651 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a16db8a7-6976-4b88-ba2d-4ab9435c0209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74a4951eed640378fb40b394a3f3646', 'request_id': 'req-a16db8a7-6976-4b88-ba2d-4ab9435c0209'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:46.154466 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a16db8a7-6976-4b88-ba2d-4ab9435c0209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74a4951eed640378fb40b394a3f3646', 'request_id': 'req-a16db8a7-6976-4b88-ba2d-4ab9435c0209'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:46.165576 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a16db8a7-6976-4b88-ba2d-4ab9435c0209 admin admin] The token cache is being invalidate because project b74a4951eed640378fb40b394a3f3646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:44:46.165866 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a16db8a7-6976-4b88-ba2d-4ab9435c0209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:46.166477 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a16db8a7-6976-4b88-ba2d-4ab9435c0209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:46.168071 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1393/2818] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:44:45 2022] DELETE /identity/v3/projects/b74a4951eed640378fb40b394a3f3646 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:46.172078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1e782-a4a9-40e6-9d28-e0f4a2b181d9 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:46.181635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1e782-a4a9-40e6-9d28-e0f4a2b181d9 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:46.204501 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:46.236181 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c14e5-bd11-4fa0-8d97-d55d82810a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:46.236849 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c14e5-bd11-4fa0-8d97-d55d82810a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:46.237126 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c14e5-bd11-4fa0-8d97-d55d82810a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:46.237398 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c14e5-bd11-4fa0-8d97-d55d82810a0a admin admin] PATH_INFO: `/v3/users/a405862d25af47809d8d254f7c530575` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:46.238489 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c14e5-bd11-4fa0-8d97-d55d82810a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a405862d25af47809d8d254f7c530575)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:46.240417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c14e5-bd11-4fa0-8d97-d55d82810a0a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:46.427303 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-660c14e5-bd11-4fa0-8d97-d55d82810a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a405862d25af47809d8d254f7c530575'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:46.427303 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-660c14e5-bd11-4fa0-8d97-d55d82810a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a405862d25af47809d8d254f7c530575'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:46.439033 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-660c14e5-bd11-4fa0-8d97-d55d82810a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a405862d25af47809d8d254f7c530575'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:46.509170 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-660c14e5-bd11-4fa0-8d97-d55d82810a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a405862d25af47809d8d254f7c530575'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:46.509780 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-660c14e5-bd11-4fa0-8d97-d55d82810a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a405862d25af47809d8d254f7c530575'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:46.522629 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1426/2819] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:44:46 2022] DELETE /identity/v3/users/a405862d25af47809d8d254f7c530575 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:46.986814 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16db8a7-6976-4b88-ba2d-4ab9435c0209 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:46.988469 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a16db8a7-6976-4b88-ba2d-4ab9435c0209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:47.003330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16db8a7-6976-4b88-ba2d-4ab9435c0209 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:47.069648 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7429da-f53e-4a7a-a177-8dc19b15cc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:47.070972 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7429da-f53e-4a7a-a177-8dc19b15cc9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:47.071249 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7429da-f53e-4a7a-a177-8dc19b15cc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:47.071568 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7429da-f53e-4a7a-a177-8dc19b15cc9d admin admin] PATH_INFO: `/v3/projects/7c694e5561674f81adf27869329314b2` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:47.072987 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7429da-f53e-4a7a-a177-8dc19b15cc9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c694e5561674f81adf27869329314b2)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:47.074903 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7429da-f53e-4a7a-a177-8dc19b15cc9d admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:47.183166 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-da7429da-f53e-4a7a-a177-8dc19b15cc9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c694e5561674f81adf27869329314b2', 'request_id': 'req-da7429da-f53e-4a7a-a177-8dc19b15cc9d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:47.189438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-da7429da-f53e-4a7a-a177-8dc19b15cc9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c694e5561674f81adf27869329314b2', 'request_id': 'req-da7429da-f53e-4a7a-a177-8dc19b15cc9d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:47.251250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-da7429da-f53e-4a7a-a177-8dc19b15cc9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c694e5561674f81adf27869329314b2', 'request_id': 'req-da7429da-f53e-4a7a-a177-8dc19b15cc9d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:47.261817 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-da7429da-f53e-4a7a-a177-8dc19b15cc9d admin admin] The token cache is being invalidate because project 7c694e5561674f81adf27869329314b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:44:47.262103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-da7429da-f53e-4a7a-a177-8dc19b15cc9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:47.262724 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-da7429da-f53e-4a7a-a177-8dc19b15cc9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:47.264194 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1394/2820] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:44:46 2022] DELETE /identity/v3/projects/7c694e5561674f81adf27869329314b2 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:47.269640 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74c5d4-7eb7-4e4f-ae6e-441d75d694f5 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:47.270112 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74c5d4-7eb7-4e4f-ae6e-441d75d694f5 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:47.270221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74c5d4-7eb7-4e4f-ae6e-441d75d694f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:47.290159 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-cd74c5d4-7eb7-4e4f-ae6e-441d75d694f5 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:47.291346 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-cd74c5d4-7eb7-4e4f-ae6e-441d75d694f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:47.347785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1427/2821] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:47.355875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296db8c-570b-495c-9e52-7c658ea2e113 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:47.356191 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296db8c-570b-495c-9e52-7c658ea2e113 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:47.356514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296db8c-570b-495c-9e52-7c658ea2e113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:47.376705 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-c296db8c-570b-495c-9e52-7c658ea2e113 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:47.377903 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c296db8c-570b-495c-9e52-7c658ea2e113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:47.385839 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1395/2822] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:44:47.389964 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74c5d4-7eb7-4e4f-ae6e-441d75d694f5 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:47.399526 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74c5d4-7eb7-4e4f-ae6e-441d75d694f5 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:47.404012 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a21cff-5174-4ff3-a5f5-a445bb707e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:47.404669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a21cff-5174-4ff3-a5f5-a445bb707e7e admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:47.404938 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a21cff-5174-4ff3-a5f5-a445bb707e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:47.405206 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a21cff-5174-4ff3-a5f5-a445bb707e7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:47.405834 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a21cff-5174-4ff3-a5f5-a445bb707e7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:44:47.406133 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a21cff-5174-4ff3-a5f5-a445bb707e7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:47.407700 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a21cff-5174-4ff3-a5f5-a445bb707e7e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:47.419589 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1428/2823] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:44:47.423678 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296db8c-570b-495c-9e52-7c658ea2e113 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:47.433538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296db8c-570b-495c-9e52-7c658ea2e113 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:47.438179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae08b2-412a-4310-ac50-27ebd72c98e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:47.438771 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae08b2-412a-4310-ac50-27ebd72c98e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:47.439050 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae08b2-412a-4310-ac50-27ebd72c98e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:47.439325 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae08b2-412a-4310-ac50-27ebd72c98e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:47.439958 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae08b2-412a-4310-ac50-27ebd72c98e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:47.441878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae08b2-412a-4310-ac50-27ebd72c98e0 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:47.456601 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:47.521541 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1396/2824] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:44:47 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:44:47.525653 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a21cff-5174-4ff3-a5f5-a445bb707e7e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:47.535635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a21cff-5174-4ff3-a5f5-a445bb707e7e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:47.566689 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:47.593502 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47dad2-bc55-4beb-9875-ca183b321ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:47.594096 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47dad2-bc55-4beb-9875-ca183b321ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:47.594375 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47dad2-bc55-4beb-9875-ca183b321ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:47.594647 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47dad2-bc55-4beb-9875-ca183b321ce0 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:47.595276 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47dad2-bc55-4beb-9875-ca183b321ce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:47.597220 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47dad2-bc55-4beb-9875-ca183b321ce0 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:47.670051 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1429/2825] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:44:47 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:44:47.674160 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae08b2-412a-4310-ac50-27ebd72c98e0 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:47.684362 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae08b2-412a-4310-ac50-27ebd72c98e0 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:47.688927 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75691b38-824f-4aba-aa3b-b5b94b5d4bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:47.689517 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691b38-824f-4aba-aa3b-b5b94b5d4bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:47.689794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691b38-824f-4aba-aa3b-b5b94b5d4bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:47.690066 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691b38-824f-4aba-aa3b-b5b94b5d4bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:47.690706 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75691b38-824f-4aba-aa3b-b5b94b5d4bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:47.692296 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75691b38-824f-4aba-aa3b-b5b94b5d4bc0 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:47.702206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1397/2826] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:44:47.705898 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47dad2-bc55-4beb-9875-ca183b321ce0 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:47.717512 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47dad2-bc55-4beb-9875-ca183b321ce0 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:47.722080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7912a-e06a-4717-9f9c-5f92fac9a392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:47.722668 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7912a-e06a-4717-9f9c-5f92fac9a392 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:47.722950 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7912a-e06a-4717-9f9c-5f92fac9a392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:47.723223 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7912a-e06a-4717-9f9c-5f92fac9a392 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:47.723855 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7912a-e06a-4717-9f9c-5f92fac9a392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:47.725495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7912a-e06a-4717-9f9c-5f92fac9a392 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:47.735762 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1430/2827] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:44:47.739889 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75691b38-824f-4aba-aa3b-b5b94b5d4bc0 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:47.749755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75691b38-824f-4aba-aa3b-b5b94b5d4bc0 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:47.754525 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bc724-ec75-4c9a-b4fa-2ac73dbfa6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:47.755176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bc724-ec75-4c9a-b4fa-2ac73dbfa6de admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:47.755458 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bc724-ec75-4c9a-b4fa-2ac73dbfa6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:47.755731 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bc724-ec75-4c9a-b4fa-2ac73dbfa6de admin admin] PATH_INFO: `/v3/projects/1605fc21896d4b3683c07a46998804c2/users/84127f029af8467e97967c56310c5e23/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:47.771303 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bc724-ec75-4c9a-b4fa-2ac73dbfa6de admin admin] RBAC: Authorizing `identity:create_grant(project_id=1605fc21896d4b3683c07a46998804c2, user_id=84127f029af8467e97967c56310c5e23, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:47.775226 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bc724-ec75-4c9a-b4fa-2ac73dbfa6de admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:47.852819 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1398/2828] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:44:47 2022] PUT /identity/v3/projects/1605fc21896d4b3683c07a46998804c2/users/84127f029af8467e97967c56310c5e23/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:44:47.863741 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6922c20-59c7-49db-b82a-916bbc53e1e8 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:47.864022 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6922c20-59c7-49db-b82a-916bbc53e1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:47.864294 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6922c20-59c7-49db-b82a-916bbc53e1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:47.891323 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b6922c20-59c7-49db-b82a-916bbc53e1e8 None None] MFA Rules not processed for user `84127f029af8467e97967c56310c5e23`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:47.893234 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b6922c20-59c7-49db-b82a-916bbc53e1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:47.956645 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1431/2829] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:44:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:47.968639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bc724-ec75-4c9a-b4fa-2ac73dbfa6de admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:47.970314 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-040bc724-ec75-4c9a-b4fa-2ac73dbfa6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:48.027703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bc724-ec75-4c9a-b4fa-2ac73dbfa6de admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:48.031652 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc7d7b-f533-4dbb-aab3-780fed0947c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e15cb1d012934ebeac53af885ca65f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:48.032399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc7d7b-f533-4dbb-aab3-780fed0947c6 service glance] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:48.032583 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc7d7b-f533-4dbb-aab3-780fed0947c6 service glance] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:48.032838 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc7d7b-f533-4dbb-aab3-780fed0947c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:48.043078 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc7d7b-f533-4dbb-aab3-780fed0947c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:48.044015 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc7d7b-f533-4dbb-aab3-780fed0947c6 service glance] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:48.057709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1399/2830] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:44:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:44:50.608728 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52fad8-b28c-46d6-8c83-7ac8f1b7c3a3 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:50.609238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52fad8-b28c-46d6-8c83-7ac8f1b7c3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:50.609358 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52fad8-b28c-46d6-8c83-7ac8f1b7c3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:50.640738 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ea52fad8-b28c-46d6-8c83-7ac8f1b7c3a3 None None] MFA Rules not processed for user `0c8d0a718e8347b5af397f866056266e`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:44:50.642039 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ea52fad8-b28c-46d6-8c83-7ac8f1b7c3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:50.704755 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1432/2831] 10.222.0.26 () {58 vars in 967 bytes} [Tue Sep 27 16:44:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:44:50.717480 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc7d7b-f533-4dbb-aab3-780fed0947c6 service glance] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:50.718896 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-76cc7d7b-f533-4dbb-aab3-780fed0947c6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:50.797449 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc7d7b-f533-4dbb-aab3-780fed0947c6 service glance] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:50.803009 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75865e12-abea-4cfc-b071-f3f33e0231c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b85e430004a8b865622354c1d1ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:50.803687 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75865e12-abea-4cfc-b071-f3f33e0231c0 service swift] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:50.803989 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75865e12-abea-4cfc-b071-f3f33e0231c0 service swift] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:50.804316 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75865e12-abea-4cfc-b071-f3f33e0231c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:50.813039 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75865e12-abea-4cfc-b071-f3f33e0231c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:50.814604 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75865e12-abea-4cfc-b071-f3f33e0231c0 service swift] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:50.823406 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1400/2832] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 27 16:44:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 16:44:59.391892 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52fad8-b28c-46d6-8c83-7ac8f1b7c3a3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:44:59.393443 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ea52fad8-b28c-46d6-8c83-7ac8f1b7c3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:44:59.429079 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:59.462588 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52fad8-b28c-46d6-8c83-7ac8f1b7c3a3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:44:59.467120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d94fe8-bfef-4d23-8b20-86e08f143680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:44:59.467757 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d94fe8-bfef-4d23-8b20-86e08f143680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:44:59.468034 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d94fe8-bfef-4d23-8b20-86e08f143680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:44:59.468311 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d94fe8-bfef-4d23-8b20-86e08f143680 admin admin] PATH_INFO: `/v3/users/eeb3abe800c744b39356db954d6ef3c5` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:44:59.469653 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d94fe8-bfef-4d23-8b20-86e08f143680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb3abe800c744b39356db954d6ef3c5)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:44:59.471391 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d94fe8-bfef-4d23-8b20-86e08f143680 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:44:59.745537 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-73d94fe8-bfef-4d23-8b20-86e08f143680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb3abe800c744b39356db954d6ef3c5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:59.746192 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-73d94fe8-bfef-4d23-8b20-86e08f143680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb3abe800c744b39356db954d6ef3c5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:59.758908 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-73d94fe8-bfef-4d23-8b20-86e08f143680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb3abe800c744b39356db954d6ef3c5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:59.863129 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-73d94fe8-bfef-4d23-8b20-86e08f143680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb3abe800c744b39356db954d6ef3c5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:59.863787 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-73d94fe8-bfef-4d23-8b20-86e08f143680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb3abe800c744b39356db954d6ef3c5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:44:59.876585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1433/2833] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:44:59 2022] DELETE /identity/v3/users/eeb3abe800c744b39356db954d6ef3c5 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:45:00.150392 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75865e12-abea-4cfc-b071-f3f33e0231c0 service swift] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:00.163152 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75865e12-abea-4cfc-b071-f3f33e0231c0 service swift] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:00.214431 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:00.224514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fc8d3-b8c3-4743-a44e-9c97982aae70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:00.225205 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fc8d3-b8c3-4743-a44e-9c97982aae70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:00.225479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fc8d3-b8c3-4743-a44e-9c97982aae70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:00.225755 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fc8d3-b8c3-4743-a44e-9c97982aae70 admin admin] PATH_INFO: `/v3/projects/155093b39b8047d386d9ed0e5d1c214c` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:00.227027 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fc8d3-b8c3-4743-a44e-9c97982aae70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=155093b39b8047d386d9ed0e5d1c214c)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:00.228993 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fc8d3-b8c3-4743-a44e-9c97982aae70 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:00.348888 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-137fc8d3-b8c3-4743-a44e-9c97982aae70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '155093b39b8047d386d9ed0e5d1c214c', 'request_id': 'req-137fc8d3-b8c3-4743-a44e-9c97982aae70'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:00.354930 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-137fc8d3-b8c3-4743-a44e-9c97982aae70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '155093b39b8047d386d9ed0e5d1c214c', 'request_id': 'req-137fc8d3-b8c3-4743-a44e-9c97982aae70'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:00.440178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-137fc8d3-b8c3-4743-a44e-9c97982aae70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '155093b39b8047d386d9ed0e5d1c214c', 'request_id': 'req-137fc8d3-b8c3-4743-a44e-9c97982aae70'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:00.451704 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-137fc8d3-b8c3-4743-a44e-9c97982aae70 admin admin] The token cache is being invalidate because project 155093b39b8047d386d9ed0e5d1c214c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:45:00.452054 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-137fc8d3-b8c3-4743-a44e-9c97982aae70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:00.452697 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-137fc8d3-b8c3-4743-a44e-9c97982aae70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:00.454170 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1401/2834] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:45:00 2022] DELETE /identity/v3/projects/155093b39b8047d386d9ed0e5d1c214c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:45:00.458307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d94fe8-bfef-4d23-8b20-86e08f143680 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:00.459787 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-73d94fe8-bfef-4d23-8b20-86e08f143680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:00.473160 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d94fe8-bfef-4d23-8b20-86e08f143680 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:00.528280 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb38e8-5d81-4e3a-8073-5d526e86db67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:00.528973 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb38e8-5d81-4e3a-8073-5d526e86db67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:00.529254 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb38e8-5d81-4e3a-8073-5d526e86db67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:00.529553 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb38e8-5d81-4e3a-8073-5d526e86db67 admin admin] PATH_INFO: `/v3/users/d7d5e7a57b864dd1a483b729dc91fdcf` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:00.530704 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb38e8-5d81-4e3a-8073-5d526e86db67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d5e7a57b864dd1a483b729dc91fdcf)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:00.532630 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb38e8-5d81-4e3a-8073-5d526e86db67 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:00.717482 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9cbb38e8-5d81-4e3a-8073-5d526e86db67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d5e7a57b864dd1a483b729dc91fdcf'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:00.718059 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9cbb38e8-5d81-4e3a-8073-5d526e86db67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d5e7a57b864dd1a483b729dc91fdcf'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:00.722585 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:00.730425 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9cbb38e8-5d81-4e3a-8073-5d526e86db67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d5e7a57b864dd1a483b729dc91fdcf'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:00.846093 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9cbb38e8-5d81-4e3a-8073-5d526e86db67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d5e7a57b864dd1a483b729dc91fdcf'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:00.846766 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9cbb38e8-5d81-4e3a-8073-5d526e86db67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d5e7a57b864dd1a483b729dc91fdcf'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:00.859602 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1434/2835] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:45:00 2022] DELETE /identity/v3/users/d7d5e7a57b864dd1a483b729dc91fdcf => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:45:01.105103 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fc8d3-b8c3-4743-a44e-9c97982aae70 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:01.107670 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-137fc8d3-b8c3-4743-a44e-9c97982aae70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:01.122031 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fc8d3-b8c3-4743-a44e-9c97982aae70 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:01.181777 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689a4f9-f264-44ff-81b5-46150fe28378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:01.182456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689a4f9-f264-44ff-81b5-46150fe28378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:01.182674 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689a4f9-f264-44ff-81b5-46150fe28378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:01.182948 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689a4f9-f264-44ff-81b5-46150fe28378 admin admin] PATH_INFO: `/v3/projects/13a435383de04ea4a8c1dd7ec9a416a7` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:01.184054 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689a4f9-f264-44ff-81b5-46150fe28378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13a435383de04ea4a8c1dd7ec9a416a7)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:01.185975 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689a4f9-f264-44ff-81b5-46150fe28378 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:01.280550 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2689a4f9-f264-44ff-81b5-46150fe28378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13a435383de04ea4a8c1dd7ec9a416a7', 'request_id': 'req-2689a4f9-f264-44ff-81b5-46150fe28378'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:01.286763 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2689a4f9-f264-44ff-81b5-46150fe28378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13a435383de04ea4a8c1dd7ec9a416a7', 'request_id': 'req-2689a4f9-f264-44ff-81b5-46150fe28378'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:01.366147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2689a4f9-f264-44ff-81b5-46150fe28378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13a435383de04ea4a8c1dd7ec9a416a7', 'request_id': 'req-2689a4f9-f264-44ff-81b5-46150fe28378'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:01.376665 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2689a4f9-f264-44ff-81b5-46150fe28378 admin admin] The token cache is being invalidate because project 13a435383de04ea4a8c1dd7ec9a416a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:45:01.376979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2689a4f9-f264-44ff-81b5-46150fe28378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:01.377592 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-2689a4f9-f264-44ff-81b5-46150fe28378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:01.379064 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1402/2836] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:45:01 2022] DELETE /identity/v3/projects/13a435383de04ea4a8c1dd7ec9a416a7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:45:06.651347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb38e8-5d81-4e3a-8073-5d526e86db67 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:06.653354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9cbb38e8-5d81-4e3a-8073-5d526e86db67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:06.665917 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb38e8-5d81-4e3a-8073-5d526e86db67 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:06.722502 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49991bda-be41-421b-8b5e-c3d1a2e3a777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:06.723126 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49991bda-be41-421b-8b5e-c3d1a2e3a777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:06.723407 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49991bda-be41-421b-8b5e-c3d1a2e3a777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:06.723680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49991bda-be41-421b-8b5e-c3d1a2e3a777 admin admin] PATH_INFO: `/v3/users/84127f029af8467e97967c56310c5e23` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:06.724832 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49991bda-be41-421b-8b5e-c3d1a2e3a777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84127f029af8467e97967c56310c5e23)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:06.726724 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49991bda-be41-421b-8b5e-c3d1a2e3a777 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:06.979607 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-49991bda-be41-421b-8b5e-c3d1a2e3a777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84127f029af8467e97967c56310c5e23'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:06.980382 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-49991bda-be41-421b-8b5e-c3d1a2e3a777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84127f029af8467e97967c56310c5e23'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:06.993260 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-49991bda-be41-421b-8b5e-c3d1a2e3a777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84127f029af8467e97967c56310c5e23'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:07.103621 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-49991bda-be41-421b-8b5e-c3d1a2e3a777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84127f029af8467e97967c56310c5e23'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:07.104299 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-49991bda-be41-421b-8b5e-c3d1a2e3a777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84127f029af8467e97967c56310c5e23'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:07.117475 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1435/2837] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:45:06 2022] DELETE /identity/v3/users/84127f029af8467e97967c56310c5e23 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:45:07.122543 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7a2ae-02dc-4659-a019-25106a690f43 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:07.123035 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7a2ae-02dc-4659-a019-25106a690f43 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:07.123145 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7a2ae-02dc-4659-a019-25106a690f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:07.143675 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-bea7a2ae-02dc-4659-a019-25106a690f43 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:45:07.144982 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-bea7a2ae-02dc-4659-a019-25106a690f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:07.150044 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:07.203298 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1403/2838] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:45:07.213180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49991bda-be41-421b-8b5e-c3d1a2e3a777 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:07.214576 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-49991bda-be41-421b-8b5e-c3d1a2e3a777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:07.267676 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:07.291374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49991bda-be41-421b-8b5e-c3d1a2e3a777 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:07.295013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0854d20-6106-476f-a30b-b89e5a4ae266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:07.295615 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0854d20-6106-476f-a30b-b89e5a4ae266 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:07.295893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0854d20-6106-476f-a30b-b89e5a4ae266 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:07.296167 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0854d20-6106-476f-a30b-b89e5a4ae266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:07.305004 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0854d20-6106-476f-a30b-b89e5a4ae266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:07.306410 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0854d20-6106-476f-a30b-b89e5a4ae266 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:07.316772 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1436/2839] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:45:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:45:07.815509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7a2ae-02dc-4659-a019-25106a690f43 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:07.815509 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-bea7a2ae-02dc-4659-a019-25106a690f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:07.827702 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7a2ae-02dc-4659-a019-25106a690f43 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:07.832400 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076b393-06c3-4b91-8dba-c602edd06f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:07.833004 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076b393-06c3-4b91-8dba-c602edd06f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:07.833284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076b393-06c3-4b91-8dba-c602edd06f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:07.833555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076b393-06c3-4b91-8dba-c602edd06f96 admin admin] PATH_INFO: `/v3/projects/1605fc21896d4b3683c07a46998804c2` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:07.834684 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076b393-06c3-4b91-8dba-c602edd06f96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1605fc21896d4b3683c07a46998804c2)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:07.836624 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076b393-06c3-4b91-8dba-c602edd06f96 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:07.972058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d076b393-06c3-4b91-8dba-c602edd06f96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1605fc21896d4b3683c07a46998804c2', 'request_id': 'req-d076b393-06c3-4b91-8dba-c602edd06f96'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:07.978337 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d076b393-06c3-4b91-8dba-c602edd06f96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1605fc21896d4b3683c07a46998804c2', 'request_id': 'req-d076b393-06c3-4b91-8dba-c602edd06f96'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:08.069099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d076b393-06c3-4b91-8dba-c602edd06f96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1605fc21896d4b3683c07a46998804c2', 'request_id': 'req-d076b393-06c3-4b91-8dba-c602edd06f96'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:08.080622 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d076b393-06c3-4b91-8dba-c602edd06f96 admin admin] The token cache is being invalidate because project 1605fc21896d4b3683c07a46998804c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:45:08.084480 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d076b393-06c3-4b91-8dba-c602edd06f96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:08.084480 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-d076b393-06c3-4b91-8dba-c602edd06f96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:08.084480 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1404/2840] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:45:07 2022] DELETE /identity/v3/projects/1605fc21896d4b3683c07a46998804c2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:45:08.088013 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87859554-0b4e-444a-bb48-5c2c031c5b30 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:08.088501 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87859554-0b4e-444a-bb48-5c2c031c5b30 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:08.088635 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87859554-0b4e-444a-bb48-5c2c031c5b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:08.109366 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-87859554-0b4e-444a-bb48-5c2c031c5b30 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:45:08.110554 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-87859554-0b4e-444a-bb48-5c2c031c5b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:08.168454 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1437/2841] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:45:08.176177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb511ca2-0849-48bc-a089-3d4576ddc351 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:08.176692 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb511ca2-0849-48bc-a089-3d4576ddc351 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:08.176841 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb511ca2-0849-48bc-a089-3d4576ddc351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:08.196387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-fb511ca2-0849-48bc-a089-3d4576ddc351 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:45:08.197581 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-fb511ca2-0849-48bc-a089-3d4576ddc351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:08.206312 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1405/2842] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:45:08.210753 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87859554-0b4e-444a-bb48-5c2c031c5b30 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:08.221019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87859554-0b4e-444a-bb48-5c2c031c5b30 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:08.225497 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32cbcd-56bf-461f-b78c-d0855805c838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:08.226082 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32cbcd-56bf-461f-b78c-d0855805c838 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:08.226361 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32cbcd-56bf-461f-b78c-d0855805c838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:08.226633 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32cbcd-56bf-461f-b78c-d0855805c838 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:08.227269 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32cbcd-56bf-461f-b78c-d0855805c838 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:45:08.227569 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32cbcd-56bf-461f-b78c-d0855805c838 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:08.229173 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32cbcd-56bf-461f-b78c-d0855805c838 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:08.240375 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1438/2843] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:45:08.244479 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb511ca2-0849-48bc-a089-3d4576ddc351 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:08.253465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb511ca2-0849-48bc-a089-3d4576ddc351 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:08.258087 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5cdfb-7e0c-43ce-9bd0-1b689e013eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:08.258672 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5cdfb-7e0c-43ce-9bd0-1b689e013eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:08.258949 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5cdfb-7e0c-43ce-9bd0-1b689e013eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:08.259219 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5cdfb-7e0c-43ce-9bd0-1b689e013eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:08.259843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5cdfb-7e0c-43ce-9bd0-1b689e013eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:08.262256 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5cdfb-7e0c-43ce-9bd0-1b689e013eb2 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:08.355737 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1406/2844] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:45:08 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:45:08.359861 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32cbcd-56bf-461f-b78c-d0855805c838 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:08.369930 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32cbcd-56bf-461f-b78c-d0855805c838 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:08.425725 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f937b4a-fc9c-4c4f-8943-a4ee7b5b1c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:08.426316 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f937b4a-fc9c-4c4f-8943-a4ee7b5b1c1a admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:08.426597 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f937b4a-fc9c-4c4f-8943-a4ee7b5b1c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:08.426868 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f937b4a-fc9c-4c4f-8943-a4ee7b5b1c1a admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:08.427480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f937b4a-fc9c-4c4f-8943-a4ee7b5b1c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:08.429422 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f937b4a-fc9c-4c4f-8943-a4ee7b5b1c1a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:08.515556 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1439/2845] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:45:08 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:45:08.519693 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5cdfb-7e0c-43ce-9bd0-1b689e013eb2 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:08.529978 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5cdfb-7e0c-43ce-9bd0-1b689e013eb2 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:08.534574 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5beda-9581-4c87-b816-e74f3d34ca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:08.535164 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5beda-9581-4c87-b816-e74f3d34ca75 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:08.535442 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5beda-9581-4c87-b816-e74f3d34ca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:08.535715 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5beda-9581-4c87-b816-e74f3d34ca75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:08.536374 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5beda-9581-4c87-b816-e74f3d34ca75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:08.537996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5beda-9581-4c87-b816-e74f3d34ca75 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:08.547671 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1407/2846] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:45:08.551338 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f937b4a-fc9c-4c4f-8943-a4ee7b5b1c1a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:08.561945 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f937b4a-fc9c-4c4f-8943-a4ee7b5b1c1a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:08.566623 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be14809-bb52-4d27-b6ce-d2dfed2eda56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:08.567244 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be14809-bb52-4d27-b6ce-d2dfed2eda56 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:08.567525 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be14809-bb52-4d27-b6ce-d2dfed2eda56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:08.567800 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be14809-bb52-4d27-b6ce-d2dfed2eda56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:08.568470 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be14809-bb52-4d27-b6ce-d2dfed2eda56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:08.572590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be14809-bb52-4d27-b6ce-d2dfed2eda56 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:08.582692 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1440/2847] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:45:08.586891 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5beda-9581-4c87-b816-e74f3d34ca75 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:08.597022 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5beda-9581-4c87-b816-e74f3d34ca75 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:08.601703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c4a10-6247-4d65-8592-d76235a8cbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:08.602361 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c4a10-6247-4d65-8592-d76235a8cbce admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:08.602624 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c4a10-6247-4d65-8592-d76235a8cbce admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:08.602900 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c4a10-6247-4d65-8592-d76235a8cbce admin admin] PATH_INFO: `/v3/projects/5b12a99a3dce454080ec042830ce17b2/users/99a3f27419874da2a7a5d229a5d9ff75/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:08.618221 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c4a10-6247-4d65-8592-d76235a8cbce admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b12a99a3dce454080ec042830ce17b2, user_id=99a3f27419874da2a7a5d229a5d9ff75, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:08.620962 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c4a10-6247-4d65-8592-d76235a8cbce admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:08.697460 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1408/2848] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:45:08 2022] PUT /identity/v3/projects/5b12a99a3dce454080ec042830ce17b2/users/99a3f27419874da2a7a5d229a5d9ff75/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:45:08.708690 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dded7-f72f-4458-9d35-04c20e7c6112 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:08.708978 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dded7-f72f-4458-9d35-04c20e7c6112 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:08.709257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dded7-f72f-4458-9d35-04c20e7c6112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:08.736237 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-115dded7-f72f-4458-9d35-04c20e7c6112 None None] MFA Rules not processed for user `99a3f27419874da2a7a5d229a5d9ff75`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:45:08.737465 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-115dded7-f72f-4458-9d35-04c20e7c6112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:08.763772 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:08.802579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1441/2849] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:45:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:45:08.813592 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c4a10-6247-4d65-8592-d76235a8cbce admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:08.815292 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f61c4a10-6247-4d65-8592-d76235a8cbce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:08.849255 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:08.893102 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c4a10-6247-4d65-8592-d76235a8cbce admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:08.896646 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f77e1f-716f-4bf4-b0f9-d0eded435e61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:08.897246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f77e1f-716f-4bf4-b0f9-d0eded435e61 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:08.897522 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f77e1f-716f-4bf4-b0f9-d0eded435e61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:08.897792 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f77e1f-716f-4bf4-b0f9-d0eded435e61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:08.905803 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f77e1f-716f-4bf4-b0f9-d0eded435e61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:08.907211 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f77e1f-716f-4bf4-b0f9-d0eded435e61 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:08.916096 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1409/2850] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:45:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:45:12.176475 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dded7-f72f-4458-9d35-04c20e7c6112 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:12.238921 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dded7-f72f-4458-9d35-04c20e7c6112 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:12.243497 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1874740-7741-4236-8093-af1997b8552a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:12.244118 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1874740-7741-4236-8093-af1997b8552a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:12.244433 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1874740-7741-4236-8093-af1997b8552a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:12.244710 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1874740-7741-4236-8093-af1997b8552a admin admin] PATH_INFO: `/v3/users/99a3f27419874da2a7a5d229a5d9ff75` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:12.245820 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1874740-7741-4236-8093-af1997b8552a admin admin] RBAC: Authorizing `identity:delete_user(user_id=99a3f27419874da2a7a5d229a5d9ff75)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:12.247727 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1874740-7741-4236-8093-af1997b8552a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:12.443050 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b1874740-7741-4236-8093-af1997b8552a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99a3f27419874da2a7a5d229a5d9ff75'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:12.443669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b1874740-7741-4236-8093-af1997b8552a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99a3f27419874da2a7a5d229a5d9ff75'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:12.456543 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b1874740-7741-4236-8093-af1997b8552a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99a3f27419874da2a7a5d229a5d9ff75'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:12.531722 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b1874740-7741-4236-8093-af1997b8552a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99a3f27419874da2a7a5d229a5d9ff75'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:12.532339 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b1874740-7741-4236-8093-af1997b8552a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99a3f27419874da2a7a5d229a5d9ff75'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:12.544614 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1442/2851] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:45:12 2022] DELETE /identity/v3/users/99a3f27419874da2a7a5d229a5d9ff75 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:45:12.549140 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b4d77-205d-4d65-a3d2-03b7fd8763e6 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:12.549639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b4d77-205d-4d65-a3d2-03b7fd8763e6 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:12.549752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b4d77-205d-4d65-a3d2-03b7fd8763e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:12.568709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-f29b4d77-205d-4d65-a3d2-03b7fd8763e6 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:45:12.569957 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f29b4d77-205d-4d65-a3d2-03b7fd8763e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:12.628583 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1410/2852] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:45:12.638074 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1874740-7741-4236-8093-af1997b8552a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:12.639506 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b1874740-7741-4236-8093-af1997b8552a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:12.690388 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:12.695545 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1874740-7741-4236-8093-af1997b8552a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:12.699356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d3d23-cdfc-450d-8acb-4b9c4564a24b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:12.699947 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d3d23-cdfc-450d-8acb-4b9c4564a24b service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:12.700221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d3d23-cdfc-450d-8acb-4b9c4564a24b service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:12.700530 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d3d23-cdfc-450d-8acb-4b9c4564a24b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:12.709135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d3d23-cdfc-450d-8acb-4b9c4564a24b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:12.714674 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d3d23-cdfc-450d-8acb-4b9c4564a24b service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:12.720268 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1443/2853] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:45:13.116935 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b4d77-205d-4d65-a3d2-03b7fd8763e6 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:13.118411 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f29b4d77-205d-4d65-a3d2-03b7fd8763e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:13.131953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b4d77-205d-4d65-a3d2-03b7fd8763e6 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:13.137277 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f9b89-dffa-4803-8d39-28ead9e21ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:13.138140 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f9b89-dffa-4803-8d39-28ead9e21ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:13.138429 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f9b89-dffa-4803-8d39-28ead9e21ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:13.138703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f9b89-dffa-4803-8d39-28ead9e21ee3 admin admin] PATH_INFO: `/v3/projects/5b12a99a3dce454080ec042830ce17b2` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:13.139912 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f9b89-dffa-4803-8d39-28ead9e21ee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b12a99a3dce454080ec042830ce17b2)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:13.141756 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f9b89-dffa-4803-8d39-28ead9e21ee3 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:13.241001 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-232f9b89-dffa-4803-8d39-28ead9e21ee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b12a99a3dce454080ec042830ce17b2', 'request_id': 'req-232f9b89-dffa-4803-8d39-28ead9e21ee3'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:13.247194 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-232f9b89-dffa-4803-8d39-28ead9e21ee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b12a99a3dce454080ec042830ce17b2', 'request_id': 'req-232f9b89-dffa-4803-8d39-28ead9e21ee3'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:13.314936 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-232f9b89-dffa-4803-8d39-28ead9e21ee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b12a99a3dce454080ec042830ce17b2', 'request_id': 'req-232f9b89-dffa-4803-8d39-28ead9e21ee3'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:13.325794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-232f9b89-dffa-4803-8d39-28ead9e21ee3 admin admin] The token cache is being invalidate because project 5b12a99a3dce454080ec042830ce17b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:45:13.326583 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-232f9b89-dffa-4803-8d39-28ead9e21ee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:13.327228 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-232f9b89-dffa-4803-8d39-28ead9e21ee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:13.328729 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1411/2854] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:45:13 2022] DELETE /identity/v3/projects/5b12a99a3dce454080ec042830ce17b2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:45:13.333889 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4456f1-e26c-4496-916d-fee03c06af85 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:13.334376 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4456f1-e26c-4496-916d-fee03c06af85 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:13.334480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4456f1-e26c-4496-916d-fee03c06af85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:13.354350 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6c4456f1-e26c-4496-916d-fee03c06af85 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:45:13.355546 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6c4456f1-e26c-4496-916d-fee03c06af85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:13.413391 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1444/2855] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:45:13.476082 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c7043-044c-4142-a1c0-b01248909fb5 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:13.476390 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c7043-044c-4142-a1c0-b01248909fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:13.476668 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c7043-044c-4142-a1c0-b01248909fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:13.496177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-698c7043-044c-4142-a1c0-b01248909fb5 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:45:13.497330 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-698c7043-044c-4142-a1c0-b01248909fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:13.505025 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1412/2856] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:45:13.509096 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4456f1-e26c-4496-916d-fee03c06af85 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:13.519165 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4456f1-e26c-4496-916d-fee03c06af85 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:13.523695 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33d30c-8e8b-4c58-bd29-d0f9d70f1512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:13.524284 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33d30c-8e8b-4c58-bd29-d0f9d70f1512 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:13.524596 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33d30c-8e8b-4c58-bd29-d0f9d70f1512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:13.524870 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33d30c-8e8b-4c58-bd29-d0f9d70f1512 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:13.525504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33d30c-8e8b-4c58-bd29-d0f9d70f1512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:45:13.525804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33d30c-8e8b-4c58-bd29-d0f9d70f1512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:13.527390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33d30c-8e8b-4c58-bd29-d0f9d70f1512 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:13.539247 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1445/2857] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:45:13.543205 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c7043-044c-4142-a1c0-b01248909fb5 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:13.552076 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c7043-044c-4142-a1c0-b01248909fb5 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:13.556745 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bf591-1fb7-4640-871a-a49fb1500544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:13.557329 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bf591-1fb7-4640-871a-a49fb1500544 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:13.557607 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bf591-1fb7-4640-871a-a49fb1500544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:13.557875 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bf591-1fb7-4640-871a-a49fb1500544 admin admin] PATH_INFO: `/v3/projects` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:13.558492 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156bf591-1fb7-4640-871a-a49fb1500544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:13.560461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156bf591-1fb7-4640-871a-a49fb1500544 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:13.665506 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1413/2858] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:45:13 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:45:13.669100 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33d30c-8e8b-4c58-bd29-d0f9d70f1512 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:13.680017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33d30c-8e8b-4c58-bd29-d0f9d70f1512 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:13.742986 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eea27f-4653-4173-a9c9-d94af65a91a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:13.743576 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eea27f-4653-4173-a9c9-d94af65a91a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:13.743853 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eea27f-4653-4173-a9c9-d94af65a91a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:13.744120 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eea27f-4653-4173-a9c9-d94af65a91a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:13.744777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eea27f-4653-4173-a9c9-d94af65a91a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:13.746730 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eea27f-4653-4173-a9c9-d94af65a91a2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:13.830453 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1446/2859] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:45:13 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:45:13.836080 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bf591-1fb7-4640-871a-a49fb1500544 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:13.845266 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bf591-1fb7-4640-871a-a49fb1500544 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:13.849996 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7489c61-33d7-410f-b7c8-e4fb9ea83eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:13.850613 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7489c61-33d7-410f-b7c8-e4fb9ea83eab admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:13.850901 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7489c61-33d7-410f-b7c8-e4fb9ea83eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:13.851178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7489c61-33d7-410f-b7c8-e4fb9ea83eab admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:13.851817 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7489c61-33d7-410f-b7c8-e4fb9ea83eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:13.853498 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7489c61-33d7-410f-b7c8-e4fb9ea83eab admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:13.855572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:13.863699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1414/2860] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:45:13.872710 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eea27f-4653-4173-a9c9-d94af65a91a2 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:13.883462 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eea27f-4653-4173-a9c9-d94af65a91a2 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:13.888135 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165be37a-ac14-487d-9d04-75c4982dc603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:13.893098 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165be37a-ac14-487d-9d04-75c4982dc603 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:13.893098 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165be37a-ac14-487d-9d04-75c4982dc603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:13.893098 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165be37a-ac14-487d-9d04-75c4982dc603 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:13.893098 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165be37a-ac14-487d-9d04-75c4982dc603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:13.893098 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165be37a-ac14-487d-9d04-75c4982dc603 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:13.903504 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1447/2861] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:45:13.907752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7489c61-33d7-410f-b7c8-e4fb9ea83eab admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:13.917953 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7489c61-33d7-410f-b7c8-e4fb9ea83eab admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:13.922604 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae640f0-94d0-43e8-8ea6-8871bdb101ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:13.923250 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae640f0-94d0-43e8-8ea6-8871bdb101ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:13.923529 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae640f0-94d0-43e8-8ea6-8871bdb101ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:13.923802 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae640f0-94d0-43e8-8ea6-8871bdb101ed admin admin] PATH_INFO: `/v3/projects/9174b50e75c64be983509e026102ed71/users/c7cfd4e38aa0448aaf92167585cf759d/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:13.938886 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae640f0-94d0-43e8-8ea6-8871bdb101ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=9174b50e75c64be983509e026102ed71, user_id=c7cfd4e38aa0448aaf92167585cf759d, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:13.941566 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae640f0-94d0-43e8-8ea6-8871bdb101ed admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:14.115739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1415/2862] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:45:13 2022] PUT /identity/v3/projects/9174b50e75c64be983509e026102ed71/users/c7cfd4e38aa0448aaf92167585cf759d/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:45:14.126238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b7d26-e607-41fe-91d4-6c66b47bc4aa None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:14.126511 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b7d26-e607-41fe-91d4-6c66b47bc4aa None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:14.126790 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b7d26-e607-41fe-91d4-6c66b47bc4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:14.153735 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-2d6b7d26-e607-41fe-91d4-6c66b47bc4aa None None] MFA Rules not processed for user `c7cfd4e38aa0448aaf92167585cf759d`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:45:14.155053 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2d6b7d26-e607-41fe-91d4-6c66b47bc4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:14.198778 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:14.218639 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1448/2863] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:45:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:45:14.230053 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae640f0-94d0-43e8-8ea6-8871bdb101ed admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:14.231841 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-5ae640f0-94d0-43e8-8ea6-8871bdb101ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:14.287596 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae640f0-94d0-43e8-8ea6-8871bdb101ed admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:14.291193 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47af8b-b90b-4068-bf8f-e7e626a61c71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:14.291786 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47af8b-b90b-4068-bf8f-e7e626a61c71 service cinder] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:14.292062 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47af8b-b90b-4068-bf8f-e7e626a61c71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:14.292347 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47af8b-b90b-4068-bf8f-e7e626a61c71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:14.301300 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47af8b-b90b-4068-bf8f-e7e626a61c71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:14.302835 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47af8b-b90b-4068-bf8f-e7e626a61c71 service cinder] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:14.312414 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1416/2864] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:45:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:45:24.245764 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=7 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:24.307438 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=37,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:49.583617 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b7d26-e607-41fe-91d4-6c66b47bc4aa None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:49.585068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2d6b7d26-e607-41fe-91d4-6c66b47bc4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:49.674248 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b7d26-e607-41fe-91d4-6c66b47bc4aa None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:49.679230 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce534d-cce9-4854-ad54-b42defced0d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5deb7370bc3045c5be2d391d3b1dbd82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:49.679828 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce534d-cce9-4854-ad54-b42defced0d4 service placement] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:49.680104 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce534d-cce9-4854-ad54-b42defced0d4 service placement] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:49.680404 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce534d-cce9-4854-ad54-b42defced0d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:49.682107 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-07ce534d-cce9-4854-ad54-b42defced0d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:49.693204 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce534d-cce9-4854-ad54-b42defced0d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:49.695301 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce534d-cce9-4854-ad54-b42defced0d4 service placement] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:49.705363 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1449/2865] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:45:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:45:49.835133 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47af8b-b90b-4068-bf8f-e7e626a61c71 service cinder] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:49.895282 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47af8b-b90b-4068-bf8f-e7e626a61c71 service cinder] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:49.899770 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860854f-d2f7-461a-a8d9-85b0ae5d6947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:49.900415 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860854f-d2f7-461a-a8d9-85b0ae5d6947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:49.900692 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860854f-d2f7-461a-a8d9-85b0ae5d6947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:49.900961 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860854f-d2f7-461a-a8d9-85b0ae5d6947 admin admin] PATH_INFO: `/v3/users/c7cfd4e38aa0448aaf92167585cf759d` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:49.902065 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860854f-d2f7-461a-a8d9-85b0ae5d6947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7cfd4e38aa0448aaf92167585cf759d)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:49.903969 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860854f-d2f7-461a-a8d9-85b0ae5d6947 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:50.112382 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6860854f-d2f7-461a-a8d9-85b0ae5d6947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7cfd4e38aa0448aaf92167585cf759d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:50.113086 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6860854f-d2f7-461a-a8d9-85b0ae5d6947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7cfd4e38aa0448aaf92167585cf759d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:50.125881 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6860854f-d2f7-461a-a8d9-85b0ae5d6947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7cfd4e38aa0448aaf92167585cf759d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:50.206627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6860854f-d2f7-461a-a8d9-85b0ae5d6947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7cfd4e38aa0448aaf92167585cf759d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:50.207241 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-6860854f-d2f7-461a-a8d9-85b0ae5d6947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7cfd4e38aa0448aaf92167585cf759d'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:50.220205 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1417/2866] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:45:49 2022] DELETE /identity/v3/users/c7cfd4e38aa0448aaf92167585cf759d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:45:50.224646 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7edc5-b3f5-463c-bb77-3a5fb856ff2a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:50.224951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7edc5-b3f5-463c-bb77-3a5fb856ff2a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:50.225226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7edc5-b3f5-463c-bb77-3a5fb856ff2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:50.244395 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-beb7edc5-b3f5-463c-bb77-3a5fb856ff2a None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:45:50.245610 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-beb7edc5-b3f5-463c-bb77-3a5fb856ff2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:50.301914 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1450/2867] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:45:50.311480 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860854f-d2f7-461a-a8d9-85b0ae5d6947 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:50.312910 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6860854f-d2f7-461a-a8d9-85b0ae5d6947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:50.370267 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860854f-d2f7-461a-a8d9-85b0ae5d6947 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:50.373764 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187780ba-8228-47f0-82dc-38a443641227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:50.374360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187780ba-8228-47f0-82dc-38a443641227 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:50.374633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187780ba-8228-47f0-82dc-38a443641227 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:50.374900 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187780ba-8228-47f0-82dc-38a443641227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:50.384157 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187780ba-8228-47f0-82dc-38a443641227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:50.388524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187780ba-8228-47f0-82dc-38a443641227 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:50.394740 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1418/2868] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:45:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:45:50.826359 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7edc5-b3f5-463c-bb77-3a5fb856ff2a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:50.827798 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-beb7edc5-b3f5-463c-bb77-3a5fb856ff2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:50.841791 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7edc5-b3f5-463c-bb77-3a5fb856ff2a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:50.846467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef29e8-e762-48f8-8e4e-ba77a08a004e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:50.847097 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef29e8-e762-48f8-8e4e-ba77a08a004e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:50.847377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef29e8-e762-48f8-8e4e-ba77a08a004e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:50.847649 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef29e8-e762-48f8-8e4e-ba77a08a004e admin admin] PATH_INFO: `/v3/projects/9174b50e75c64be983509e026102ed71` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:50.848821 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef29e8-e762-48f8-8e4e-ba77a08a004e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9174b50e75c64be983509e026102ed71)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:50.850703 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef29e8-e762-48f8-8e4e-ba77a08a004e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:50.994984 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e9ef29e8-e762-48f8-8e4e-ba77a08a004e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9174b50e75c64be983509e026102ed71', 'request_id': 'req-e9ef29e8-e762-48f8-8e4e-ba77a08a004e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:51.001277 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e9ef29e8-e762-48f8-8e4e-ba77a08a004e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9174b50e75c64be983509e026102ed71', 'request_id': 'req-e9ef29e8-e762-48f8-8e4e-ba77a08a004e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:51.086975 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e9ef29e8-e762-48f8-8e4e-ba77a08a004e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9174b50e75c64be983509e026102ed71', 'request_id': 'req-e9ef29e8-e762-48f8-8e4e-ba77a08a004e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:51.091156 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:51.098089 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e9ef29e8-e762-48f8-8e4e-ba77a08a004e admin admin] The token cache is being invalidate because project 9174b50e75c64be983509e026102ed71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:45:51.098377 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e9ef29e8-e762-48f8-8e4e-ba77a08a004e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:51.099100 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e9ef29e8-e762-48f8-8e4e-ba77a08a004e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:45:51.100621 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1451/2869] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:45:50 2022] DELETE /identity/v3/projects/9174b50e75c64be983509e026102ed71 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:45:51.105612 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78a230-8505-463e-8f87-32f5aa532a29 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:51.106092 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78a230-8505-463e-8f87-32f5aa532a29 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:51.106233 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78a230-8505-463e-8f87-32f5aa532a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:51.125400 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-fc78a230-8505-463e-8f87-32f5aa532a29 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:45:51.126576 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-fc78a230-8505-463e-8f87-32f5aa532a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:51.143929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:51.184675 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1419/2870] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:45:51.193783 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c69fa-5fa1-4dbc-aca3-89c9736ff20e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:51.194080 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c69fa-5fa1-4dbc-aca3-89c9736ff20e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:51.194347 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c69fa-5fa1-4dbc-aca3-89c9736ff20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:51.215078 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6b2c69fa-5fa1-4dbc-aca3-89c9736ff20e None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:45:51.216275 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6b2c69fa-5fa1-4dbc-aca3-89c9736ff20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:51.224136 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1452/2871] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:45:51.228543 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78a230-8505-463e-8f87-32f5aa532a29 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:51.238160 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78a230-8505-463e-8f87-32f5aa532a29 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:51.242846 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923fe5a-1890-4680-b887-9547445bfa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:51.243492 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923fe5a-1890-4680-b887-9547445bfa68 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:51.243778 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923fe5a-1890-4680-b887-9547445bfa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:51.244054 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923fe5a-1890-4680-b887-9547445bfa68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:51.244730 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923fe5a-1890-4680-b887-9547445bfa68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:45:51.245081 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923fe5a-1890-4680-b887-9547445bfa68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:51.246687 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923fe5a-1890-4680-b887-9547445bfa68 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:51.258802 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1420/2872] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:45:51.263287 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c69fa-5fa1-4dbc-aca3-89c9736ff20e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:51.273480 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c69fa-5fa1-4dbc-aca3-89c9736ff20e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:51.278254 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fedf4f-e05d-4596-b405-0949620f0f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:51.278927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fedf4f-e05d-4596-b405-0949620f0f8e admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:51.279247 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fedf4f-e05d-4596-b405-0949620f0f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:51.279523 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fedf4f-e05d-4596-b405-0949620f0f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:51.280155 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fedf4f-e05d-4596-b405-0949620f0f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:51.282095 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fedf4f-e05d-4596-b405-0949620f0f8e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:51.423765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1453/2873] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:45:51 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:45:51.427929 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923fe5a-1890-4680-b887-9547445bfa68 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:51.438501 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923fe5a-1890-4680-b887-9547445bfa68 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:51.496364 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98b894-afe5-49f4-bf93-20fbce73ff7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:51.496915 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98b894-afe5-49f4-bf93-20fbce73ff7c admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:51.497208 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98b894-afe5-49f4-bf93-20fbce73ff7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:51.497461 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98b894-afe5-49f4-bf93-20fbce73ff7c admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:51.498082 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98b894-afe5-49f4-bf93-20fbce73ff7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:51.500048 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98b894-afe5-49f4-bf93-20fbce73ff7c admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:51.607058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1421/2874] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:45:51 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:45:51.611400 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fedf4f-e05d-4596-b405-0949620f0f8e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:51.622011 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fedf4f-e05d-4596-b405-0949620f0f8e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:51.626640 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ed913-a7af-4eb5-8b9f-b78104ed5197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:51.627228 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ed913-a7af-4eb5-8b9f-b78104ed5197 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:51.627505 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ed913-a7af-4eb5-8b9f-b78104ed5197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:51.627776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ed913-a7af-4eb5-8b9f-b78104ed5197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:51.628445 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ed913-a7af-4eb5-8b9f-b78104ed5197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:51.629993 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ed913-a7af-4eb5-8b9f-b78104ed5197 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:51.641085 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1454/2875] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:45:51.644912 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98b894-afe5-49f4-bf93-20fbce73ff7c admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:51.654825 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98b894-afe5-49f4-bf93-20fbce73ff7c admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:51.659435 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f0cb1-dc8e-424c-b7a6-943ce2910710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:51.660023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f0cb1-dc8e-424c-b7a6-943ce2910710 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:51.660303 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f0cb1-dc8e-424c-b7a6-943ce2910710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:51.660612 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f0cb1-dc8e-424c-b7a6-943ce2910710 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:51.661244 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f0cb1-dc8e-424c-b7a6-943ce2910710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:51.662831 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f0cb1-dc8e-424c-b7a6-943ce2910710 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:51.673246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1422/2876] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:45:51.677163 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ed913-a7af-4eb5-8b9f-b78104ed5197 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:51.687768 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ed913-a7af-4eb5-8b9f-b78104ed5197 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:51.692306 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af967f-bd63-4ad4-b552-3b9155e03471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:51.692966 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af967f-bd63-4ad4-b552-3b9155e03471 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:51.693241 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af967f-bd63-4ad4-b552-3b9155e03471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:51.693539 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af967f-bd63-4ad4-b552-3b9155e03471 admin admin] PATH_INFO: `/v3/projects/fa4fb7359bae4a64916985e3de8bc0f1/users/a90dea6bd0d74393b8ebead2acf9c121/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:51.708632 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af967f-bd63-4ad4-b552-3b9155e03471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4fb7359bae4a64916985e3de8bc0f1, user_id=a90dea6bd0d74393b8ebead2acf9c121, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:51.711229 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af967f-bd63-4ad4-b552-3b9155e03471 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:51.801335 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1455/2877] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:45:51 2022] PUT /identity/v3/projects/fa4fb7359bae4a64916985e3de8bc0f1/users/a90dea6bd0d74393b8ebead2acf9c121/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:45:51.806902 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b7506-68fe-452d-a4a1-c332815ce4c1 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:51.807277 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b7506-68fe-452d-a4a1-c332815ce4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:51.807588 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b7506-68fe-452d-a4a1-c332815ce4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:51.826650 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-491b7506-68fe-452d-a4a1-c332815ce4c1 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:45:51.827854 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-491b7506-68fe-452d-a4a1-c332815ce4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:51.886623 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1423/2878] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:45:51.896404 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af967f-bd63-4ad4-b552-3b9155e03471 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:51.898128 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-45af967f-bd63-4ad4-b552-3b9155e03471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:51.954706 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af967f-bd63-4ad4-b552-3b9155e03471 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:51.958323 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87d427-d2c3-43e9-97dc-8699afb7b158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:51.958919 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87d427-d2c3-43e9-97dc-8699afb7b158 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:51.959198 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87d427-d2c3-43e9-97dc-8699afb7b158 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:51.959471 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87d427-d2c3-43e9-97dc-8699afb7b158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:51.968286 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87d427-d2c3-43e9-97dc-8699afb7b158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:51.969721 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87d427-d2c3-43e9-97dc-8699afb7b158 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:51.979534 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1456/2879] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:45:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:45:53.212276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a91d47-f1a0-44fa-a264-8fafb6f2e382 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:53.212849 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a91d47-f1a0-44fa-a264-8fafb6f2e382 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:53.212849 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a91d47-f1a0-44fa-a264-8fafb6f2e382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:53.240666 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-a7a91d47-f1a0-44fa-a264-8fafb6f2e382 None None] MFA Rules not processed for user `a90dea6bd0d74393b8ebead2acf9c121`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:45:53.243649 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a7a91d47-f1a0-44fa-a264-8fafb6f2e382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:53.259319 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:53.308835 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1424/2880] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:45:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:45:53.320154 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87d427-d2c3-43e9-97dc-8699afb7b158 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:45:53.321605 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0d87d427-d2c3-43e9-97dc-8699afb7b158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:53.378848 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87d427-d2c3-43e9-97dc-8699afb7b158 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:45:53.382435 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13900e-cd8b-434b-9fe9-6b5c86bb2914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:45:53.383031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13900e-cd8b-434b-9fe9-6b5c86bb2914 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:53.383307 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13900e-cd8b-434b-9fe9-6b5c86bb2914 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:53.383578 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13900e-cd8b-434b-9fe9-6b5c86bb2914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:53.391776 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13900e-cd8b-434b-9fe9-6b5c86bb2914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:45:53.393220 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13900e-cd8b-434b-9fe9-6b5c86bb2914 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:45:53.401706 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1457/2881] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:45:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:45:55.263946 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26034da8-c6e3-41c5-af1a-3067c3a9361f None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:45:55.264481 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26034da8-c6e3-41c5-af1a-3067c3a9361f None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:45:55.264596 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26034da8-c6e3-41c5-af1a-3067c3a9361f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:45:55.283587 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-26034da8-c6e3-41c5-af1a-3067c3a9361f None None] MFA Rules not processed for user `a90dea6bd0d74393b8ebead2acf9c121`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:45:55.284820 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-26034da8-c6e3-41c5-af1a-3067c3a9361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:45:55.291689 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1425/2882] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:45:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:46:03.397894 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:DELETE=1,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:46:05.277948 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=22 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:46:27.257451 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922b047-b586-43eb-892b-a78877915296 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:46:27.257994 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922b047-b586-43eb-892b-a78877915296 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:46:27.257994 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922b047-b586-43eb-892b-a78877915296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:46:27.278434 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c922b047-b586-43eb-892b-a78877915296 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:46:27.279634 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c922b047-b586-43eb-892b-a78877915296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:46:27.287441 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1458/2883] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 27 16:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:46:27.318010 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26034da8-c6e3-41c5-af1a-3067c3a9361f None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:46:27.319371 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-26034da8-c6e3-41c5-af1a-3067c3a9361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:46:27.412182 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26034da8-c6e3-41c5-af1a-3067c3a9361f None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:46:27.418057 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a2ca8-9496-4d3f-8bb6-039b6ef96369 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:46:27.418657 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a2ca8-9496-4d3f-8bb6-039b6ef96369 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:46:27.418932 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a2ca8-9496-4d3f-8bb6-039b6ef96369 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:46:27.419203 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a2ca8-9496-4d3f-8bb6-039b6ef96369 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:46:27.427271 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a2ca8-9496-4d3f-8bb6-039b6ef96369 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:46:27.428878 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a2ca8-9496-4d3f-8bb6-039b6ef96369 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:46:27.438617 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1426/2884] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:46:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:46:31.656008 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527fd66-9914-4efb-832d-42c412fba5c9 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:46:31.656608 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527fd66-9914-4efb-832d-42c412fba5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:46:31.656608 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527fd66-9914-4efb-832d-42c412fba5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:46:31.675997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-7527fd66-9914-4efb-832d-42c412fba5c9 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:46:31.677219 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7527fd66-9914-4efb-832d-42c412fba5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:46:31.684990 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1459/2885] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 27 16:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:46:31.727049 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a2ca8-9496-4d3f-8bb6-039b6ef96369 service nova] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:46:31.728464 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-6d9a2ca8-9496-4d3f-8bb6-039b6ef96369 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:46:31.742674 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a2ca8-9496-4d3f-8bb6-039b6ef96369 service nova] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:46:31.748626 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99280a5-874e-487f-9266-2b78fae7cf33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:46:31.749210 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99280a5-874e-487f-9266-2b78fae7cf33 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:46:31.749487 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99280a5-874e-487f-9266-2b78fae7cf33 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:46:31.749754 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99280a5-874e-487f-9266-2b78fae7cf33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:46:31.757816 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99280a5-874e-487f-9266-2b78fae7cf33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:46:31.759394 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99280a5-874e-487f-9266-2b78fae7cf33 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:46:31.769529 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1427/2886] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:46:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:46:36.295023 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948daac-ec99-494e-b23e-839dfa534f7b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:46:36.295567 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948daac-ec99-494e-b23e-839dfa534f7b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:46:36.295721 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948daac-ec99-494e-b23e-839dfa534f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:46:36.314740 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9948daac-ec99-494e-b23e-839dfa534f7b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:46:36.315938 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9948daac-ec99-494e-b23e-839dfa534f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:46:36.323694 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1460/2887] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 27 16:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:46:36.346406 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99280a5-874e-487f-9266-2b78fae7cf33 service nova] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:46:36.357699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99280a5-874e-487f-9266-2b78fae7cf33 service nova] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:46:36.363305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ea37c-91c0-474d-b3ee-3389e7454355 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:46:36.363891 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ea37c-91c0-474d-b3ee-3389e7454355 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:46:36.364167 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ea37c-91c0-474d-b3ee-3389e7454355 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:46:36.364480 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ea37c-91c0-474d-b3ee-3389e7454355 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:46:36.372686 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ea37c-91c0-474d-b3ee-3389e7454355 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:46:36.374258 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ea37c-91c0-474d-b3ee-3389e7454355 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:46:36.383899 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1428/2888] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:46:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:46:40.156441 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199a28e-2cba-4d66-932d-204e9ec470f2 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:46:40.156932 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199a28e-2cba-4d66-932d-204e9ec470f2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:46:40.157051 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199a28e-2cba-4d66-932d-204e9ec470f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:46:40.177421 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b199a28e-2cba-4d66-932d-204e9ec470f2 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:46:40.183758 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b199a28e-2cba-4d66-932d-204e9ec470f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:46:40.186528 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1461/2889] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 27 16:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:46:40.210585 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ea37c-91c0-474d-b3ee-3389e7454355 service nova] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:46:40.222284 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ea37c-91c0-474d-b3ee-3389e7454355 service nova] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:46:40.227557 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb74636-f9da-4dc3-9172-f9c718480364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:46:40.228143 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb74636-f9da-4dc3-9172-f9c718480364 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:46:40.228485 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb74636-f9da-4dc3-9172-f9c718480364 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:46:40.228746 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb74636-f9da-4dc3-9172-f9c718480364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:46:40.236851 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb74636-f9da-4dc3-9172-f9c718480364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:46:40.238494 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb74636-f9da-4dc3-9172-f9c718480364 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:46:40.248256 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1429/2890] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:46:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:46:43.403643 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cb68c-18fb-4003-9473-55a81f4ab17a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:46:43.404147 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cb68c-18fb-4003-9473-55a81f4ab17a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:46:43.404257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cb68c-18fb-4003-9473-55a81f4ab17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:46:43.423748 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-f92cb68c-18fb-4003-9473-55a81f4ab17a None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:46:43.424930 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f92cb68c-18fb-4003-9473-55a81f4ab17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:46:43.432677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1462/2891] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 27 16:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:46:43.456698 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb74636-f9da-4dc3-9172-f9c718480364 service nova] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:46:43.467855 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb74636-f9da-4dc3-9172-f9c718480364 service nova] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:46:43.473511 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3d8c7-d8de-4131-b924-0897298417ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:46:43.474112 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3d8c7-d8de-4131-b924-0897298417ef service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:46:43.474394 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3d8c7-d8de-4131-b924-0897298417ef service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:46:43.474691 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3d8c7-d8de-4131-b924-0897298417ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:46:43.483054 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3d8c7-d8de-4131-b924-0897298417ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:46:43.484679 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3d8c7-d8de-4131-b924-0897298417ef service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:46:43.494013 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1430/2892] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:46:46.629669 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0f44b-7b77-46ba-9b90-46672584880f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:46:46.630174 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0f44b-7b77-46ba-9b90-46672584880f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:46:46.630279 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0f44b-7b77-46ba-9b90-46672584880f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:46:46.649680 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-bcf0f44b-7b77-46ba-9b90-46672584880f None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:46:46.650829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-bcf0f44b-7b77-46ba-9b90-46672584880f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:46:46.658531 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1463/2893] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 27 16:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:46:46.692290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3d8c7-d8de-4131-b924-0897298417ef service nova] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:46:46.704280 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3d8c7-d8de-4131-b924-0897298417ef service nova] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:46:46.709803 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca3fe2-c8ec-46e9-bbf5-71045c72660e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:46:46.710398 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca3fe2-c8ec-46e9-bbf5-71045c72660e service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:46:46.710699 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca3fe2-c8ec-46e9-bbf5-71045c72660e service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:46:46.711041 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca3fe2-c8ec-46e9-bbf5-71045c72660e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:46:46.719378 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca3fe2-c8ec-46e9-bbf5-71045c72660e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:46:46.721002 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca3fe2-c8ec-46e9-bbf5-71045c72660e service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:46:46.730388 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1431/2894] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:46:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:46:49.716400 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0f44b-7b77-46ba-9b90-46672584880f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:46:49.726267 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0f44b-7b77-46ba-9b90-46672584880f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:46:49.729981 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c3c2b-695a-410a-b1c8-af7c8857c206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edca8115256546ee8a209f1eca99d972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:46:49.730579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c3c2b-695a-410a-b1c8-af7c8857c206 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:46:49.730858 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c3c2b-695a-410a-b1c8-af7c8857c206 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:46:49.731131 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c3c2b-695a-410a-b1c8-af7c8857c206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:46:49.732906 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-336c3c2b-695a-410a-b1c8-af7c8857c206 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:46:49.746736 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c3c2b-695a-410a-b1c8-af7c8857c206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:46:49.748239 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c3c2b-695a-410a-b1c8-af7c8857c206 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:46:49.759794 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1464/2895] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:46:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:46:53.838923 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca3fe2-c8ec-46e9-bbf5-71045c72660e service nova] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:46:53.840531 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-beca3fe2-c8ec-46e9-bbf5-71045c72660e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:46:53.852639 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca3fe2-c8ec-46e9-bbf5-71045c72660e service nova] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:46:53.856360 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc7d26-59ba-498a-ac89-4ffd9a22ff59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:46:53.856979 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc7d26-59ba-498a-ac89-4ffd9a22ff59 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:46:53.857267 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc7d26-59ba-498a-ac89-4ffd9a22ff59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:46:53.857543 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc7d26-59ba-498a-ac89-4ffd9a22ff59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:46:53.859216 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-e8dc7d26-59ba-498a-ac89-4ffd9a22ff59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:46:53.872653 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc7d26-59ba-498a-ac89-4ffd9a22ff59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:46:53.874088 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc7d26-59ba-498a-ac89-4ffd9a22ff59 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:46:53.885834 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1432/2896] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:46:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:46:59.754879 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=24 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:47:03.880179 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=79 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:47:05.282626 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47f59a-65f7-4e4d-8fab-15a62993c9f8 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:47:05.283118 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47f59a-65f7-4e4d-8fab-15a62993c9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:47:05.283230 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47f59a-65f7-4e4d-8fab-15a62993c9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:47:05.302292 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-af47f59a-65f7-4e4d-8fab-15a62993c9f8 None None] MFA Rules not processed for user `a90dea6bd0d74393b8ebead2acf9c121`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:47:05.303469 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-af47f59a-65f7-4e4d-8fab-15a62993c9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:47:05.310308 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1465/2897] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:47:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:47:12.280246 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc7d26-59ba-498a-ac89-4ffd9a22ff59 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:47:12.288852 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc7d26-59ba-498a-ac89-4ffd9a22ff59 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:47:12.293068 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d06a80-deb7-40a1-89d6-94c3d6a03f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:47:12.293650 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d06a80-deb7-40a1-89d6-94c3d6a03f79 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:47:12.293927 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d06a80-deb7-40a1-89d6-94c3d6a03f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:47:12.294196 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d06a80-deb7-40a1-89d6-94c3d6a03f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:47:12.295865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-d1d06a80-deb7-40a1-89d6-94c3d6a03f79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:47:12.305505 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d06a80-deb7-40a1-89d6-94c3d6a03f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:47:12.306911 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d06a80-deb7-40a1-89d6-94c3d6a03f79 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:47:12.314924 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1433/2898] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:47:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:47:15.297348 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:47:22.311177 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=6 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:47:25.374564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b883c-56e6-4e38-9a70-6fc0c0fab524 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:47:25.375070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b883c-56e6-4e38-9a70-6fc0c0fab524 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:47:25.375070 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b883c-56e6-4e38-9a70-6fc0c0fab524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:47:25.395258 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a57b883c-56e6-4e38-9a70-6fc0c0fab524 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:47:25.396497 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a57b883c-56e6-4e38-9a70-6fc0c0fab524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:47:25.404262 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1466/2899] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 27 16:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:47:25.423812 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d06a80-deb7-40a1-89d6-94c3d6a03f79 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:47:25.437062 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d06a80-deb7-40a1-89d6-94c3d6a03f79 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:47:25.442978 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24085976-12f9-4dc5-b492-da531e87cf90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:47:25.443576 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24085976-12f9-4dc5-b492-da531e87cf90 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:47:25.443858 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24085976-12f9-4dc5-b492-da531e87cf90 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:47:25.444158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24085976-12f9-4dc5-b492-da531e87cf90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:47:25.452542 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24085976-12f9-4dc5-b492-da531e87cf90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:47:25.454110 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24085976-12f9-4dc5-b492-da531e87cf90 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:47:25.463958 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1434/2900] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:47:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:47:29.017821 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084379b-a039-4076-98cc-b3b10bc02c4b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:47:29.018396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084379b-a039-4076-98cc-b3b10bc02c4b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:47:29.018396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084379b-a039-4076-98cc-b3b10bc02c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:47:29.038042 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-f084379b-a039-4076-98cc-b3b10bc02c4b None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:47:29.043017 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f084379b-a039-4076-98cc-b3b10bc02c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:47:29.046997 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1467/2901] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 27 16:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:47:29.067265 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24085976-12f9-4dc5-b492-da531e87cf90 service nova] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:47:29.078794 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24085976-12f9-4dc5-b492-da531e87cf90 service nova] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:47:29.084276 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ed580-9155-47a2-b06e-567f4aa154f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:47:29.084894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ed580-9155-47a2-b06e-567f4aa154f9 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:47:29.085178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ed580-9155-47a2-b06e-567f4aa154f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:47:29.085456 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ed580-9155-47a2-b06e-567f4aa154f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:47:29.093514 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ed580-9155-47a2-b06e-567f4aa154f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:47:29.095091 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ed580-9155-47a2-b06e-567f4aa154f9 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:47:29.105068 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1435/2902] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:47:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:47:31.817873 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ffa56-8325-4999-aa2e-72702f9af8a3 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:47:31.818327 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ffa56-8325-4999-aa2e-72702f9af8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:47:31.818442 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ffa56-8325-4999-aa2e-72702f9af8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:47:31.838526 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-708ffa56-8325-4999-aa2e-72702f9af8a3 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:47:31.839664 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-708ffa56-8325-4999-aa2e-72702f9af8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:47:31.847496 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1468/2903] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 27 16:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:47:31.870995 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ed580-9155-47a2-b06e-567f4aa154f9 service nova] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:47:31.882752 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ed580-9155-47a2-b06e-567f4aa154f9 service nova] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:47:31.888267 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37645e17-cbfa-4a43-87da-a67387477f60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:47:31.888880 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37645e17-cbfa-4a43-87da-a67387477f60 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:47:31.889157 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37645e17-cbfa-4a43-87da-a67387477f60 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:47:31.889428 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37645e17-cbfa-4a43-87da-a67387477f60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:47:31.897530 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37645e17-cbfa-4a43-87da-a67387477f60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:47:31.899134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37645e17-cbfa-4a43-87da-a67387477f60 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:47:31.908348 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1436/2904] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:47:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:47:35.076502 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7b1d0-3934-4276-9d87-a7b50b43ef2c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:47:35.077238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7b1d0-3934-4276-9d87-a7b50b43ef2c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:47:35.077238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7b1d0-3934-4276-9d87-a7b50b43ef2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:47:35.097175 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c5c7b1d0-3934-4276-9d87-a7b50b43ef2c None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:47:35.098417 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c5c7b1d0-3934-4276-9d87-a7b50b43ef2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:47:35.106328 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1469/2905] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 27 16:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:47:35.129472 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37645e17-cbfa-4a43-87da-a67387477f60 service nova] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:47:35.140622 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37645e17-cbfa-4a43-87da-a67387477f60 service nova] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:47:35.146058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bea34-5c33-4ccf-ad8a-98a48ffb10e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:47:35.146646 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bea34-5c33-4ccf-ad8a-98a48ffb10e1 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:47:35.146925 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bea34-5c33-4ccf-ad8a-98a48ffb10e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:47:35.147193 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bea34-5c33-4ccf-ad8a-98a48ffb10e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:47:35.155200 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bea34-5c33-4ccf-ad8a-98a48ffb10e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:47:35.156787 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bea34-5c33-4ccf-ad8a-98a48ffb10e1 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:47:35.166686 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1437/2906] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:47:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:47:38.312477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f93a9-2d4e-4f69-96a4-97714f33d5af None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:47:38.313021 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f93a9-2d4e-4f69-96a4-97714f33d5af None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:47:38.313021 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f93a9-2d4e-4f69-96a4-97714f33d5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:47:38.333063 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d06f93a9-2d4e-4f69-96a4-97714f33d5af None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:47:38.334264 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d06f93a9-2d4e-4f69-96a4-97714f33d5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:47:38.342040 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1470/2907] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 27 16:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:47:38.368387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bea34-5c33-4ccf-ad8a-98a48ffb10e1 service nova] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:47:38.379393 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bea34-5c33-4ccf-ad8a-98a48ffb10e1 service nova] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:47:38.385096 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f86000-1b73-40be-af5b-4c9845f46466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:47:38.385677 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f86000-1b73-40be-af5b-4c9845f46466 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:47:38.385957 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f86000-1b73-40be-af5b-4c9845f46466 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:47:38.386235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f86000-1b73-40be-af5b-4c9845f46466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:47:38.394949 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f86000-1b73-40be-af5b-4c9845f46466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:47:38.396535 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f86000-1b73-40be-af5b-4c9845f46466 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:47:38.405957 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1438/2908] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:47:48.326958 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=15 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:47:48.401715 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=30 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:47:48.687642 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f93a9-2d4e-4f69-96a4-97714f33d5af None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:47:48.700200 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f93a9-2d4e-4f69-96a4-97714f33d5af None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:47:48.705928 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c2e7b-fde7-44f1-806e-45ee3b8c1c53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:47:48.706527 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c2e7b-fde7-44f1-806e-45ee3b8c1c53 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:47:48.706806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c2e7b-fde7-44f1-806e-45ee3b8c1c53 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:47:48.707081 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c2e7b-fde7-44f1-806e-45ee3b8c1c53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:47:48.708886 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e90c2e7b-fde7-44f1-806e-45ee3b8c1c53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:47:48.721205 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c2e7b-fde7-44f1-806e-45ee3b8c1c53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:47:48.723288 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c2e7b-fde7-44f1-806e-45ee3b8c1c53 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:47:48.734041 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1471/2909] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:47:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:47:58.729390 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=6 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:48:10.878757 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f86000-1b73-40be-af5b-4c9845f46466 service nova] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:10.889115 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f86000-1b73-40be-af5b-4c9845f46466 service nova] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:10.902506 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e2fc4-0ee7-4368-9eb4-ca85780e8de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:10.902506 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e2fc4-0ee7-4368-9eb4-ca85780e8de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:10.902506 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e2fc4-0ee7-4368-9eb4-ca85780e8de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:10.902506 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e2fc4-0ee7-4368-9eb4-ca85780e8de8 admin admin] PATH_INFO: `/v3/users/a90dea6bd0d74393b8ebead2acf9c121` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:10.903031 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e2fc4-0ee7-4368-9eb4-ca85780e8de8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a90dea6bd0d74393b8ebead2acf9c121)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:10.903031 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e2fc4-0ee7-4368-9eb4-ca85780e8de8 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:11.098990 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-706e2fc4-0ee7-4368-9eb4-ca85780e8de8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90dea6bd0d74393b8ebead2acf9c121'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:48:11.099601 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-706e2fc4-0ee7-4368-9eb4-ca85780e8de8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90dea6bd0d74393b8ebead2acf9c121'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:48:11.112300 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-706e2fc4-0ee7-4368-9eb4-ca85780e8de8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90dea6bd0d74393b8ebead2acf9c121'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:48:11.176013 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-706e2fc4-0ee7-4368-9eb4-ca85780e8de8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90dea6bd0d74393b8ebead2acf9c121'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:48:11.176649 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-706e2fc4-0ee7-4368-9eb4-ca85780e8de8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90dea6bd0d74393b8ebead2acf9c121'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:48:11.188976 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1439/2910] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:48:10 2022] DELETE /identity/v3/users/a90dea6bd0d74393b8ebead2acf9c121 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:48:11.477291 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c2e7b-fde7-44f1-806e-45ee3b8c1c53 service nova] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:11.488191 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c2e7b-fde7-44f1-806e-45ee3b8c1c53 service nova] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:11.548962 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb9bd3-1b4b-44e6-a85f-6e257ad00b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:11.549584 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb9bd3-1b4b-44e6-a85f-6e257ad00b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:11.549862 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb9bd3-1b4b-44e6-a85f-6e257ad00b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:11.550140 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb9bd3-1b4b-44e6-a85f-6e257ad00b71 admin admin] PATH_INFO: `/v3/projects/fa4fb7359bae4a64916985e3de8bc0f1` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:11.551238 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb9bd3-1b4b-44e6-a85f-6e257ad00b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa4fb7359bae4a64916985e3de8bc0f1)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:11.553164 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb9bd3-1b4b-44e6-a85f-6e257ad00b71 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:11.699354 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0abb9bd3-1b4b-44e6-a85f-6e257ad00b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa4fb7359bae4a64916985e3de8bc0f1', 'request_id': 'req-0abb9bd3-1b4b-44e6-a85f-6e257ad00b71'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:48:11.705804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0abb9bd3-1b4b-44e6-a85f-6e257ad00b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa4fb7359bae4a64916985e3de8bc0f1', 'request_id': 'req-0abb9bd3-1b4b-44e6-a85f-6e257ad00b71'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:48:11.805613 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0abb9bd3-1b4b-44e6-a85f-6e257ad00b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa4fb7359bae4a64916985e3de8bc0f1', 'request_id': 'req-0abb9bd3-1b4b-44e6-a85f-6e257ad00b71'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:48:11.816590 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0abb9bd3-1b4b-44e6-a85f-6e257ad00b71 admin admin] The token cache is being invalidate because project fa4fb7359bae4a64916985e3de8bc0f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:48:11.816883 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0abb9bd3-1b4b-44e6-a85f-6e257ad00b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:48:11.817498 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0abb9bd3-1b4b-44e6-a85f-6e257ad00b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:48:11.818983 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1472/2911] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:48:11 2022] DELETE /identity/v3/projects/fa4fb7359bae4a64916985e3de8bc0f1 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:48:11.824874 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509f730-50d2-4e3c-b3e0-42b0d9b4ff28 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:11.825163 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509f730-50d2-4e3c-b3e0-42b0d9b4ff28 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:11.825441 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509f730-50d2-4e3c-b3e0-42b0d9b4ff28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:11.845977 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-c509f730-50d2-4e3c-b3e0-42b0d9b4ff28 None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:48:11.847172 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-c509f730-50d2-4e3c-b3e0-42b0d9b4ff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:48:11.904567 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1440/2912] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:48:11.912519 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93bf72-0ca8-4527-a832-cbd925423e0c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:11.912805 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93bf72-0ca8-4527-a832-cbd925423e0c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:11.913081 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93bf72-0ca8-4527-a832-cbd925423e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:11.932980 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ae93bf72-0ca8-4527-a832-cbd925423e0c None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:48:11.934179 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ae93bf72-0ca8-4527-a832-cbd925423e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:48:11.941947 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1473/2913] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:48:11.946625 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509f730-50d2-4e3c-b3e0-42b0d9b4ff28 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:11.956488 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509f730-50d2-4e3c-b3e0-42b0d9b4ff28 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:11.961005 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d52c0-02ba-4569-90d9-0f0d6f8db68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:11.961594 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d52c0-02ba-4569-90d9-0f0d6f8db68a admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:11.961871 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d52c0-02ba-4569-90d9-0f0d6f8db68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:11.962142 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d52c0-02ba-4569-90d9-0f0d6f8db68a admin admin] PATH_INFO: `/v3/domains` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:11.962781 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d52c0-02ba-4569-90d9-0f0d6f8db68a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 16:48:11.963082 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d52c0-02ba-4569-90d9-0f0d6f8db68a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:11.964709 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d52c0-02ba-4569-90d9-0f0d6f8db68a admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:11.975870 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1441/2914] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 27 16:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 16:48:11.979841 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93bf72-0ca8-4527-a832-cbd925423e0c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:11.988893 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93bf72-0ca8-4527-a832-cbd925423e0c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:11.994220 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee1962-80eb-4139-9aa7-6fe006ae9e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:11.994815 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee1962-80eb-4139-9aa7-6fe006ae9e40 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:11.995091 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee1962-80eb-4139-9aa7-6fe006ae9e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:11.995362 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee1962-80eb-4139-9aa7-6fe006ae9e40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:11.995981 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee1962-80eb-4139-9aa7-6fe006ae9e40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:11.997927 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee1962-80eb-4139-9aa7-6fe006ae9e40 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:12.109783 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1474/2915] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:48:11 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:48:12.113716 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d52c0-02ba-4569-90d9-0f0d6f8db68a admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:12.124120 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d52c0-02ba-4569-90d9-0f0d6f8db68a admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:12.178196 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2140d-9a9e-4de5-befe-4e63d581e7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:12.178798 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2140d-9a9e-4de5-befe-4e63d581e7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:12.179693 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2140d-9a9e-4de5-befe-4e63d581e7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:12.179966 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2140d-9a9e-4de5-befe-4e63d581e7a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:12.180616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2140d-9a9e-4de5-befe-4e63d581e7a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:12.182512 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2140d-9a9e-4de5-befe-4e63d581e7a7 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:12.190322 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:48:12.279309 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1442/2916] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:48:12 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:48:12.283616 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee1962-80eb-4139-9aa7-6fe006ae9e40 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:12.294786 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee1962-80eb-4139-9aa7-6fe006ae9e40 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:12.299746 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8c273-1520-4bdb-a140-d6ac9922cfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:12.300374 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8c273-1520-4bdb-a140-d6ac9922cfff admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:12.300661 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8c273-1520-4bdb-a140-d6ac9922cfff admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:12.300937 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8c273-1520-4bdb-a140-d6ac9922cfff admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:12.301579 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8c273-1520-4bdb-a140-d6ac9922cfff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:12.303220 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8c273-1520-4bdb-a140-d6ac9922cfff admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:12.313829 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1475/2917] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:48:12.317506 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2140d-9a9e-4de5-befe-4e63d581e7a7 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:12.327375 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2140d-9a9e-4de5-befe-4e63d581e7a7 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:12.332180 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593cc69-f2a3-472f-aad1-785b09efbe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:12.332806 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593cc69-f2a3-472f-aad1-785b09efbe65 admin admin] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:12.333087 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593cc69-f2a3-472f-aad1-785b09efbe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:12.333362 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593cc69-f2a3-472f-aad1-785b09efbe65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:12.334024 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593cc69-f2a3-472f-aad1-785b09efbe65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:12.335611 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593cc69-f2a3-472f-aad1-785b09efbe65 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:12.346286 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1443/2918] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:48:12.350128 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8c273-1520-4bdb-a140-d6ac9922cfff admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:12.360457 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8c273-1520-4bdb-a140-d6ac9922cfff admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:12.365074 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895dc6ad-37a8-4119-a64b-43f16cb21c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:12.365714 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dc6ad-37a8-4119-a64b-43f16cb21c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:12.366036 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dc6ad-37a8-4119-a64b-43f16cb21c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:12.366312 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dc6ad-37a8-4119-a64b-43f16cb21c1f admin admin] PATH_INFO: `/v3/projects/245aa993eef747868147606c9872cdc1/users/64b317dcb0814382b3d2cf134b0bcc86/roles/e7e5b03d7a3d404f841a8341244d5d78` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:12.381257 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895dc6ad-37a8-4119-a64b-43f16cb21c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=245aa993eef747868147606c9872cdc1, user_id=64b317dcb0814382b3d2cf134b0bcc86, role_id=e7e5b03d7a3d404f841a8341244d5d78)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:12.383870 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895dc6ad-37a8-4119-a64b-43f16cb21c1f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:12.479327 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1476/2919] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:48:12 2022] PUT /identity/v3/projects/245aa993eef747868147606c9872cdc1/users/64b317dcb0814382b3d2cf134b0bcc86/roles/e7e5b03d7a3d404f841a8341244d5d78 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:48:12.484244 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc808454-7325-45ac-8354-a552cf6cc0dc None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:12.484555 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc808454-7325-45ac-8354-a552cf6cc0dc None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:12.484832 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc808454-7325-45ac-8354-a552cf6cc0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:12.503723 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-bc808454-7325-45ac-8354-a552cf6cc0dc None None] MFA Rules not processed for user `09247daecb7c4c7e95eb12e5544033af`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:48:12.504947 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-bc808454-7325-45ac-8354-a552cf6cc0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:48:12.563820 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1444/2920] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:48:12.573778 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895dc6ad-37a8-4119-a64b-43f16cb21c1f admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:12.575478 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-895dc6ad-37a8-4119-a64b-43f16cb21c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:48:12.596011 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:48:12.632210 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895dc6ad-37a8-4119-a64b-43f16cb21c1f admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:12.636058 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11120f0f-25b9-40e8-be4a-4f62c21dff0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:12.637019 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11120f0f-25b9-40e8-be4a-4f62c21dff0e service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:12.637345 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11120f0f-25b9-40e8-be4a-4f62c21dff0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:12.637620 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11120f0f-25b9-40e8-be4a-4f62c21dff0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:12.646640 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11120f0f-25b9-40e8-be4a-4f62c21dff0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:12.648656 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11120f0f-25b9-40e8-be4a-4f62c21dff0e service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:12.658053 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1477/2921] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:48:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:48:17.966549 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa817b-e9ce-4311-873d-c4b9bc86ac8d None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:17.967007 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa817b-e9ce-4311-873d-c4b9bc86ac8d None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:17.967105 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa817b-e9ce-4311-873d-c4b9bc86ac8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:17.997767 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-50fa817b-e9ce-4311-873d-c4b9bc86ac8d None None] MFA Rules not processed for user `64b317dcb0814382b3d2cf134b0bcc86`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:48:17.999000 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-50fa817b-e9ce-4311-873d-c4b9bc86ac8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:48:18.068697 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1445/2922] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:48:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:48:18.074799 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11120f0f-25b9-40e8-be4a-4f62c21dff0e service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:18.085896 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11120f0f-25b9-40e8-be4a-4f62c21dff0e service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:18.102002 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735adfda-a0df-4ba9-9c97-74526fafb9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:18.102002 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735adfda-a0df-4ba9-9c97-74526fafb9e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:18.102002 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735adfda-a0df-4ba9-9c97-74526fafb9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:18.102002 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735adfda-a0df-4ba9-9c97-74526fafb9e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:18.102495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735adfda-a0df-4ba9-9c97-74526fafb9e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:18.102495 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735adfda-a0df-4ba9-9c97-74526fafb9e0 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:18.197874 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1478/2923] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 27 16:48:18 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 16:48:18.202107 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa817b-e9ce-4311-873d-c4b9bc86ac8d None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:18.214976 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa817b-e9ce-4311-873d-c4b9bc86ac8d None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:18.277610 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170cd78-7520-41be-9d0c-37cbef75db6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:18.278229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170cd78-7520-41be-9d0c-37cbef75db6b admin admin] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:18.278505 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170cd78-7520-41be-9d0c-37cbef75db6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:18.278774 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170cd78-7520-41be-9d0c-37cbef75db6b admin admin] PATH_INFO: `/v3/users` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:18.279403 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170cd78-7520-41be-9d0c-37cbef75db6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:18.281375 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170cd78-7520-41be-9d0c-37cbef75db6b admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:18.368588 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:48:18.374894 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1446/2924] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 27 16:48:18 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 16:48:18.379052 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735adfda-a0df-4ba9-9c97-74526fafb9e0 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:18.389650 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735adfda-a0df-4ba9-9c97-74526fafb9e0 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:18.394301 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee702246-fe14-43b2-8750-d24e1dfeb15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:18.397001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee702246-fe14-43b2-8750-d24e1dfeb15a admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:18.397001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee702246-fe14-43b2-8750-d24e1dfeb15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:18.397001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee702246-fe14-43b2-8750-d24e1dfeb15a admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:18.397001 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee702246-fe14-43b2-8750-d24e1dfeb15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:18.397741 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee702246-fe14-43b2-8750-d24e1dfeb15a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:18.408171 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1479/2925] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:48:18.412524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170cd78-7520-41be-9d0c-37cbef75db6b admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:18.422959 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170cd78-7520-41be-9d0c-37cbef75db6b admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:18.427538 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc59a04-b123-4b6f-b3fe-cff6c5ba0bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:18.428184 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc59a04-b123-4b6f-b3fe-cff6c5ba0bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:18.428507 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc59a04-b123-4b6f-b3fe-cff6c5ba0bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:18.428806 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc59a04-b123-4b6f-b3fe-cff6c5ba0bc3 admin admin] PATH_INFO: `/v3/projects/5b3f84b71c60410a96ff036ac9aa8a92/users/ad6a793fa5c9407486b9601d8734eeb0/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:18.443952 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc59a04-b123-4b6f-b3fe-cff6c5ba0bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3f84b71c60410a96ff036ac9aa8a92, user_id=ad6a793fa5c9407486b9601d8734eeb0, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:18.446674 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc59a04-b123-4b6f-b3fe-cff6c5ba0bc3 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:18.551304 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1447/2926] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:48:18 2022] PUT /identity/v3/projects/5b3f84b71c60410a96ff036ac9aa8a92/users/ad6a793fa5c9407486b9601d8734eeb0/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:48:18.555467 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee702246-fe14-43b2-8750-d24e1dfeb15a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:18.565515 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee702246-fe14-43b2-8750-d24e1dfeb15a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:18.626226 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f58aeb-6bda-4eed-9152-409f4b990fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:18.626884 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f58aeb-6bda-4eed-9152-409f4b990fac admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:18.627196 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f58aeb-6bda-4eed-9152-409f4b990fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:18.627477 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f58aeb-6bda-4eed-9152-409f4b990fac admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:18.628118 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f58aeb-6bda-4eed-9152-409f4b990fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:18.629806 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f58aeb-6bda-4eed-9152-409f4b990fac admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:18.639929 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1480/2927] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 27 16:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 16:48:18.645706 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc59a04-b123-4b6f-b3fe-cff6c5ba0bc3 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:18.655416 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc59a04-b123-4b6f-b3fe-cff6c5ba0bc3 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:18.660632 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89ec15-f33b-474f-a91b-5fcf343f23b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:18.661298 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89ec15-f33b-474f-a91b-5fcf343f23b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:18.661575 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89ec15-f33b-474f-a91b-5fcf343f23b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:18.661849 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89ec15-f33b-474f-a91b-5fcf343f23b3 admin admin] PATH_INFO: `/v3/projects/5b3f84b71c60410a96ff036ac9aa8a92/users/ad6a793fa5c9407486b9601d8734eeb0/roles/0a55cc35c9c84cd4969edd4038dc7724` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:18.664495 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89ec15-f33b-474f-a91b-5fcf343f23b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3f84b71c60410a96ff036ac9aa8a92, user_id=ad6a793fa5c9407486b9601d8734eeb0, role_id=0a55cc35c9c84cd4969edd4038dc7724)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:18.667134 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89ec15-f33b-474f-a91b-5fcf343f23b3 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:18.677703 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1448/2928] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 27 16:48:18 2022] PUT /identity/v3/projects/5b3f84b71c60410a96ff036ac9aa8a92/users/ad6a793fa5c9407486b9601d8734eeb0/roles/0a55cc35c9c84cd4969edd4038dc7724 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:48:24.436870 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2f3e5-c059-4ea8-bc77-c2d4ae983d8e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:24.437356 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2f3e5-c059-4ea8-bc77-c2d4ae983d8e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:24.437678 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2f3e5-c059-4ea8-bc77-c2d4ae983d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:24.468677 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-40c2f3e5-c059-4ea8-bc77-c2d4ae983d8e None None] MFA Rules not processed for user `ad6a793fa5c9407486b9601d8734eeb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:48:24.470062 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-40c2f3e5-c059-4ea8-bc77-c2d4ae983d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:48:24.544111 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1481/2929] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:48:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:48:24.560229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89ec15-f33b-474f-a91b-5fcf343f23b3 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:24.561948 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-da89ec15-f33b-474f-a91b-5fcf343f23b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:48:24.647209 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89ec15-f33b-474f-a91b-5fcf343f23b3 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:24.653941 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83201366-ee6b-4e38-865d-020070343897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:24.654658 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83201366-ee6b-4e38-865d-020070343897 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:24.655013 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83201366-ee6b-4e38-865d-020070343897 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:24.655520 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83201366-ee6b-4e38-865d-020070343897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:24.732158 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83201366-ee6b-4e38-865d-020070343897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:24.733817 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83201366-ee6b-4e38-865d-020070343897 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:24.743334 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1449/2930] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:48:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:48:27.743749 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2e2a3-92ad-479f-892f-12b4529cce2f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:27.744291 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2e2a3-92ad-479f-892f-12b4529cce2f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:27.744291 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2e2a3-92ad-479f-892f-12b4529cce2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:27.764580 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-90b2e2a3-92ad-479f-892f-12b4529cce2f None None] MFA Rules not processed for user `64b317dcb0814382b3d2cf134b0bcc86`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:48:27.765810 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-90b2e2a3-92ad-479f-892f-12b4529cce2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:48:27.773555 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1482/2931] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 27 16:48:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:48:34.738826 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:48:37.759117 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:48:43.894034 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83201366-ee6b-4e38-865d-020070343897 service nova] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:43.947099 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83201366-ee6b-4e38-865d-020070343897 service nova] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:43.950692 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74135218-3595-4319-b264-8a6859fd18b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:43.951290 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74135218-3595-4319-b264-8a6859fd18b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:43.951572 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74135218-3595-4319-b264-8a6859fd18b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:43.951843 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74135218-3595-4319-b264-8a6859fd18b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:43.953579 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-74135218-3595-4319-b264-8a6859fd18b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:48:43.963235 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74135218-3595-4319-b264-8a6859fd18b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:43.964666 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74135218-3595-4319-b264-8a6859fd18b5 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:43.972526 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1450/2932] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:48:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:48:45.762737 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2e2a3-92ad-479f-892f-12b4529cce2f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:45.762737 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-90b2e2a3-92ad-479f-892f-12b4529cce2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:48:45.840799 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2e2a3-92ad-479f-892f-12b4529cce2f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:45.845833 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6c625-d1fb-4179-b455-a98f77aab01a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5deb7370bc3045c5be2d391d3b1dbd82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:45.846499 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6c625-d1fb-4179-b455-a98f77aab01a service placement] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:45.846777 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6c625-d1fb-4179-b455-a98f77aab01a service placement] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:45.847060 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6c625-d1fb-4179-b455-a98f77aab01a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:45.848804 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-92e6c625-d1fb-4179-b455-a98f77aab01a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:48:45.861203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6c625-d1fb-4179-b455-a98f77aab01a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:45.862775 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6c625-d1fb-4179-b455-a98f77aab01a service placement] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:45.873813 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1483/2933] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:48:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:48:53.968921 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=26 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:48:55.869203 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=32 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:48:57.004627 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74135218-3595-4319-b264-8a6859fd18b5 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:57.008924 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-74135218-3595-4319-b264-8a6859fd18b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:48:57.023494 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74135218-3595-4319-b264-8a6859fd18b5 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:57.029178 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc04bbf-3cc6-4d02-a6ed-e01a19824350 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:57.031524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc04bbf-3cc6-4d02-a6ed-e01a19824350 service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:57.031524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc04bbf-3cc6-4d02-a6ed-e01a19824350 service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:57.031524 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc04bbf-3cc6-4d02-a6ed-e01a19824350 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:57.032042 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-2cc04bbf-3cc6-4d02-a6ed-e01a19824350 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:48:57.044399 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc04bbf-3cc6-4d02-a6ed-e01a19824350 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:57.045958 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc04bbf-3cc6-4d02-a6ed-e01a19824350 service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:57.057451 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1451/2934] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:48:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:48:59.955945 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6c625-d1fb-4179-b455-a98f77aab01a service placement] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:48:59.965335 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6c625-d1fb-4179-b455-a98f77aab01a service placement] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:48:59.968906 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938028f6-8840-4e72-9f17-bdbaf554b217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:48:59.969503 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938028f6-8840-4e72-9f17-bdbaf554b217 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:48:59.969784 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938028f6-8840-4e72-9f17-bdbaf554b217 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:48:59.970068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938028f6-8840-4e72-9f17-bdbaf554b217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:48:59.979298 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938028f6-8840-4e72-9f17-bdbaf554b217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:48:59.980758 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938028f6-8840-4e72-9f17-bdbaf554b217 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:48:59.990396 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1484/2935] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:48:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:49:01.819465 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc04bbf-3cc6-4d02-a6ed-e01a19824350 service nova] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:49:01.831353 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc04bbf-3cc6-4d02-a6ed-e01a19824350 service nova] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:49:01.837265 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67deb5b3-4eee-4793-8074-8fad539008cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71fea96b2b949f9abca12172e69284b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:49:01.837898 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deb5b3-4eee-4793-8074-8fad539008cc service nova] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:49:01.838180 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deb5b3-4eee-4793-8074-8fad539008cc service nova] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:49:01.838452 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deb5b3-4eee-4793-8074-8fad539008cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:49:01.840176 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-67deb5b3-4eee-4793-8074-8fad539008cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:49:01.854317 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67deb5b3-4eee-4793-8074-8fad539008cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:49:01.855045 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67deb5b3-4eee-4793-8074-8fad539008cc service nova] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:49:01.866300 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1452/2936] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:49:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:49:09.986037 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=6 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:49:11.861336 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=12 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:50:55.615705 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938028f6-8840-4e72-9f17-bdbaf554b217 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:50:55.627364 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938028f6-8840-4e72-9f17-bdbaf554b217 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:50:55.632253 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd3ea5-4427-4efc-ae9a-8d0d63db5c18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5deb7370bc3045c5be2d391d3b1dbd82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:50:55.632903 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd3ea5-4427-4efc-ae9a-8d0d63db5c18 service placement] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:50:55.633184 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd3ea5-4427-4efc-ae9a-8d0d63db5c18 service placement] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:50:55.633476 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd3ea5-4427-4efc-ae9a-8d0d63db5c18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:50:55.635175 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-35bd3ea5-4427-4efc-ae9a-8d0d63db5c18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:50:55.647088 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd3ea5-4427-4efc-ae9a-8d0d63db5c18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:50:55.648706 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd3ea5-4427-4efc-ae9a-8d0d63db5c18 service placement] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:50:55.658444 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1485/2937] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:50:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:51:05.654225 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=6 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:51:14.022865 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6abed-dbed-4241-bbac-49839883a1f8 None None] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:51:14.023372 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6abed-dbed-4241-bbac-49839883a1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:51:14.023475 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6abed-dbed-4241-bbac-49839883a1f8 None None] PATH_INFO: `/` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:51:14.024772 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1453/2938] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 27 16:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:51:14.030684 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8854c5d-4651-4b11-9f02-4a4cd3fe2680 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:51:14.031197 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8854c5d-4651-4b11-9f02-4a4cd3fe2680 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:51:14.031309 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8854c5d-4651-4b11-9f02-4a4cd3fe2680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:51:14.070514 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a8854c5d-4651-4b11-9f02-4a4cd3fe2680 None None] MFA Rules not processed for user `758380280e33458f8f9112147d5a7819`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:51:14.071734 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a8854c5d-4651-4b11-9f02-4a4cd3fe2680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:51:14.078636 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1486/2939] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 27 16:51:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 16:51:14.091433 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6abed-dbed-4241-bbac-49839883a1f8 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:51:14.093199 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a4a6abed-dbed-4241-bbac-49839883a1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:51:14.107010 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6abed-dbed-4241-bbac-49839883a1f8 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:51:14.110482 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf371b4-1ed1-4781-ad7f-cc9d0cebbaca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:51:14.111072 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf371b4-1ed1-4781-ad7f-cc9d0cebbaca service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:51:14.111348 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf371b4-1ed1-4781-ad7f-cc9d0cebbaca service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:51:14.111616 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf371b4-1ed1-4781-ad7f-cc9d0cebbaca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:51:14.118517 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf371b4-1ed1-4781-ad7f-cc9d0cebbaca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:51:14.119925 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf371b4-1ed1-4781-ad7f-cc9d0cebbaca service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:51:14.127504 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1454/2940] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:51:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:51:14.213065 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f18f9d-bab2-4762-98fa-738b8260a08c None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:51:14.213351 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f18f9d-bab2-4762-98fa-738b8260a08c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:51:14.213623 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f18f9d-bab2-4762-98fa-738b8260a08c None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:51:14.214974 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1487/2941] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 27 16:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 16:51:14.220287 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7a85d-e117-4688-9fb5-0aa1f0efe984 None None] REQUEST_METHOD: `POST` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:51:14.220596 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7a85d-e117-4688-9fb5-0aa1f0efe984 None None] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:51:14.220872 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7a85d-e117-4688-9fb5-0aa1f0efe984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:51:14.257933 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.auth.core [None req-28f7a85d-e117-4688-9fb5-0aa1f0efe984 None None] MFA Rules not processed for user `e71fea96b2b949f9abca12172e69284b`. Rule list: `[]` (Enabled: `True`). {{(pid=81630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 16:51:14.259122 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-28f7a85d-e117-4688-9fb5-0aa1f0efe984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:51:14.268251 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1455/2942] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 27 16:51:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 16:51:14.279162 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f18f9d-bab2-4762-98fa-738b8260a08c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:51:14.290098 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f18f9d-bab2-4762-98fa-738b8260a08c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:51:14.293641 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea33d4-9fde-4842-a4b7-02903b18dba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:51:14.294221 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea33d4-9fde-4842-a4b7-02903b18dba9 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:51:14.294501 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea33d4-9fde-4842-a4b7-02903b18dba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:51:14.294772 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea33d4-9fde-4842-a4b7-02903b18dba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:51:14.304622 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea33d4-9fde-4842-a4b7-02903b18dba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:51:14.306031 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea33d4-9fde-4842-a4b7-02903b18dba9 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:51:14.316839 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1488/2943] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:51:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 16:51:24.255645 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=15 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:51:24.311785 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=15 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:52:39.394242 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7a85d-e117-4688-9fb5-0aa1f0efe984 None None] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:52:39.405633 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7a85d-e117-4688-9fb5-0aa1f0efe984 None None] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:52:39.408387 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7692821-80fc-42db-b0ae-3992484f2505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:52:39.409023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7692821-80fc-42db-b0ae-3992484f2505 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:52:39.409302 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7692821-80fc-42db-b0ae-3992484f2505 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:52:39.409587 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7692821-80fc-42db-b0ae-3992484f2505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:52:39.411305 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-f7692821-80fc-42db-b0ae-3992484f2505 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:52:39.421992 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7692821-80fc-42db-b0ae-3992484f2505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:52:39.423395 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7692821-80fc-42db-b0ae-3992484f2505 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:52:39.431705 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1456/2944] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:52:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:52:39.728353 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea33d4-9fde-4842-a4b7-02903b18dba9 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:52:39.739096 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea33d4-9fde-4842-a4b7-02903b18dba9 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:52:39.742902 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba492d3-bc05-4f85-9054-6b4c95968a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:52:39.743520 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba492d3-bc05-4f85-9054-6b4c95968a7b service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:52:39.743798 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba492d3-bc05-4f85-9054-6b4c95968a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:52:39.744072 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba492d3-bc05-4f85-9054-6b4c95968a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:52:39.746508 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4ba492d3-bc05-4f85-9054-6b4c95968a7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:52:39.761100 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba492d3-bc05-4f85-9054-6b4c95968a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:52:39.762561 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba492d3-bc05-4f85-9054-6b4c95968a7b service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:52:39.774682 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1489/2945] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:52:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:52:40.979206 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7692821-80fc-42db-b0ae-3992484f2505 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:52:40.988090 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7692821-80fc-42db-b0ae-3992484f2505 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:52:40.991645 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa86bf-3aa4-4290-b4d8-8071e503b798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758380280e33458f8f9112147d5a7819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:52:40.992229 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa86bf-3aa4-4290-b4d8-8071e503b798 service neutron] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:52:40.992544 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa86bf-3aa4-4290-b4d8-8071e503b798 service neutron] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:52:40.992837 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa86bf-3aa4-4290-b4d8-8071e503b798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:52:40.994507 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-9bfa86bf-3aa4-4290-b4d8-8071e503b798 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:52:41.007381 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa86bf-3aa4-4290-b4d8-8071e503b798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:52:41.008856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa86bf-3aa4-4290-b4d8-8071e503b798 service neutron] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:52:41.019873 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1457/2946] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:52:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:52:48.087387 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba492d3-bc05-4f85-9054-6b4c95968a7b service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:52:48.088860 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4ba492d3-bc05-4f85-9054-6b4c95968a7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:52:48.103373 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba492d3-bc05-4f85-9054-6b4c95968a7b service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:52:48.108486 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac035d69-5dd8-4c2e-893e-70b90e8abbf8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5deb7370bc3045c5be2d391d3b1dbd82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:52:48.109540 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac035d69-5dd8-4c2e-893e-70b90e8abbf8 service placement] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:52:48.109540 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac035d69-5dd8-4c2e-893e-70b90e8abbf8 service placement] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:52:48.109765 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac035d69-5dd8-4c2e-893e-70b90e8abbf8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:52:48.111371 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ac035d69-5dd8-4c2e-893e-70b90e8abbf8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:52:48.124248 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac035d69-5dd8-4c2e-893e-70b90e8abbf8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:52:48.125951 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac035d69-5dd8-4c2e-893e-70b90e8abbf8 service placement] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:52:48.136068 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1490/2947] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:52:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:52:51.015362 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=12 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:52:51.762510 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa86bf-3aa4-4290-b4d8-8071e503b798 service neutron] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:52:51.824981 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa86bf-3aa4-4290-b4d8-8071e503b798 service neutron] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:52:51.829486 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8ff18-20e9-4865-87b7-731520f06bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:52:51.830112 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8ff18-20e9-4865-87b7-731520f06bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:52:51.830391 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8ff18-20e9-4865-87b7-731520f06bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:52:51.830666 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8ff18-20e9-4865-87b7-731520f06bc0 admin admin] PATH_INFO: `/v3/users/64b317dcb0814382b3d2cf134b0bcc86` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:52:51.831777 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8ff18-20e9-4865-87b7-731520f06bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b317dcb0814382b3d2cf134b0bcc86)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:52:51.833735 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8ff18-20e9-4865-87b7-731520f06bc0 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:52:51.997057 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-7cf8ff18-20e9-4865-87b7-731520f06bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b317dcb0814382b3d2cf134b0bcc86'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:51.998268 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-7cf8ff18-20e9-4865-87b7-731520f06bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b317dcb0814382b3d2cf134b0bcc86'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:52.010192 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-7cf8ff18-20e9-4865-87b7-731520f06bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b317dcb0814382b3d2cf134b0bcc86'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:52.075457 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-7cf8ff18-20e9-4865-87b7-731520f06bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b317dcb0814382b3d2cf134b0bcc86'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:52.076023 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-7cf8ff18-20e9-4865-87b7-731520f06bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b317dcb0814382b3d2cf134b0bcc86'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:52.088463 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1458/2948] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:52:51 2022] DELETE /identity/v3/users/64b317dcb0814382b3d2cf134b0bcc86 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:52:52.301714 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac035d69-5dd8-4c2e-893e-70b90e8abbf8 service placement] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:52:52.313018 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac035d69-5dd8-4c2e-893e-70b90e8abbf8 service placement] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:52:52.375036 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7d07d-204e-4620-99f3-4891c840409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:52:52.375681 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7d07d-204e-4620-99f3-4891c840409f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:52:52.375965 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7d07d-204e-4620-99f3-4891c840409f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:52:52.376243 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7d07d-204e-4620-99f3-4891c840409f admin admin] PATH_INFO: `/v3/projects/245aa993eef747868147606c9872cdc1` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:52:52.377376 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7d07d-204e-4620-99f3-4891c840409f admin admin] RBAC: Authorizing `identity:delete_project(project_id=245aa993eef747868147606c9872cdc1)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:52:52.379284 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7d07d-204e-4620-99f3-4891c840409f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:52:52.476728 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-31c7d07d-204e-4620-99f3-4891c840409f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '245aa993eef747868147606c9872cdc1', 'request_id': 'req-31c7d07d-204e-4620-99f3-4891c840409f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:52.485642 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-31c7d07d-204e-4620-99f3-4891c840409f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '245aa993eef747868147606c9872cdc1', 'request_id': 'req-31c7d07d-204e-4620-99f3-4891c840409f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:52.538809 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-31c7d07d-204e-4620-99f3-4891c840409f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '245aa993eef747868147606c9872cdc1', 'request_id': 'req-31c7d07d-204e-4620-99f3-4891c840409f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:52.549658 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-31c7d07d-204e-4620-99f3-4891c840409f admin admin] The token cache is being invalidate because project 245aa993eef747868147606c9872cdc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:52:52.549947 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-31c7d07d-204e-4620-99f3-4891c840409f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:52.550564 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-31c7d07d-204e-4620-99f3-4891c840409f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:52.552028 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1491/2949] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:52:52 2022] DELETE /identity/v3/projects/245aa993eef747868147606c9872cdc1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:52:52.556352 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8ff18-20e9-4865-87b7-731520f06bc0 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:52:52.557768 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-7cf8ff18-20e9-4865-87b7-731520f06bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:52:52.571058 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8ff18-20e9-4865-87b7-731520f06bc0 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:52:52.627683 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e09e5-8874-4920-a6d7-d7e8f7f9ffd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:52:52.628259 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e09e5-8874-4920-a6d7-d7e8f7f9ffd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:52:52.628548 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e09e5-8874-4920-a6d7-d7e8f7f9ffd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:52:52.628819 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e09e5-8874-4920-a6d7-d7e8f7f9ffd1 admin admin] PATH_INFO: `/v3/users/ad6a793fa5c9407486b9601d8734eeb0` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:52:52.629936 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e09e5-8874-4920-a6d7-d7e8f7f9ffd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad6a793fa5c9407486b9601d8734eeb0)` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:52:52.631856 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e09e5-8874-4920-a6d7-d7e8f7f9ffd1 admin admin] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:52:52.653124 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:52:52.804561 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a13e09e5-8874-4920-a6d7-d7e8f7f9ffd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad6a793fa5c9407486b9601d8734eeb0'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:52.805234 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a13e09e5-8874-4920-a6d7-d7e8f7f9ffd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad6a793fa5c9407486b9601d8734eeb0'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:52.817157 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a13e09e5-8874-4920-a6d7-d7e8f7f9ffd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad6a793fa5c9407486b9601d8734eeb0'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:52.875911 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a13e09e5-8874-4920-a6d7-d7e8f7f9ffd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad6a793fa5c9407486b9601d8734eeb0'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:52.876546 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.notifications [None req-a13e09e5-8874-4920-a6d7-d7e8f7f9ffd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad6a793fa5c9407486b9601d8734eeb0'} {{(pid=81630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:52.889922 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1459/2950] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 27 16:52:52 2022] DELETE /identity/v3/users/ad6a793fa5c9407486b9601d8734eeb0 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 16:52:53.123909 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7d07d-204e-4620-99f3-4891c840409f admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:52:53.137695 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-31c7d07d-204e-4620-99f3-4891c840409f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:52:53.139651 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7d07d-204e-4620-99f3-4891c840409f admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:52:53.195338 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142629a-3ad6-4cdf-8f6e-e0e3c135c348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09247daecb7c4c7e95eb12e5544033af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4cc0d5ca9c1419e8012fd96a408e70a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:52:53.195991 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142629a-3ad6-4cdf-8f6e-e0e3c135c348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:52:53.196268 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142629a-3ad6-4cdf-8f6e-e0e3c135c348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:52:53.196573 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142629a-3ad6-4cdf-8f6e-e0e3c135c348 admin admin] PATH_INFO: `/v3/projects/5b3f84b71c60410a96ff036ac9aa8a92` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:52:53.197679 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142629a-3ad6-4cdf-8f6e-e0e3c135c348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3f84b71c60410a96ff036ac9aa8a92)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:52:53.199688 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142629a-3ad6-4cdf-8f6e-e0e3c135c348 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:52:53.206802 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:52:53.313119 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0142629a-3ad6-4cdf-8f6e-e0e3c135c348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3f84b71c60410a96ff036ac9aa8a92', 'request_id': 'req-0142629a-3ad6-4cdf-8f6e-e0e3c135c348'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:53.319261 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0142629a-3ad6-4cdf-8f6e-e0e3c135c348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3f84b71c60410a96ff036ac9aa8a92', 'request_id': 'req-0142629a-3ad6-4cdf-8f6e-e0e3c135c348'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:53.367180 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0142629a-3ad6-4cdf-8f6e-e0e3c135c348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3f84b71c60410a96ff036ac9aa8a92', 'request_id': 'req-0142629a-3ad6-4cdf-8f6e-e0e3c135c348'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:53.379044 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0142629a-3ad6-4cdf-8f6e-e0e3c135c348 admin admin] The token cache is being invalidate because project 5b3f84b71c60410a96ff036ac9aa8a92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 16:52:53.379331 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0142629a-3ad6-4cdf-8f6e-e0e3c135c348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:53.379949 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0142629a-3ad6-4cdf-8f6e-e0e3c135c348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 16:52:53.381577 dv-cinder-855060-2-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1492/2951] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 27 16:52:53 2022] DELETE /identity/v3/projects/5b3f84b71c60410a96ff036ac9aa8a92 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 16:53:02.885739 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:53:03.375899 dv-cinder-855060-2-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:56:03.527459 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e09e5-8874-4920-a6d7-d7e8f7f9ffd1 admin admin] Authenticating user token {{(pid=81630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 16:56:03.528950 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-a13e09e5-8874-4920-a6d7-d7e8f7f9ffd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:56:03.663354 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e09e5-8874-4920-a6d7-d7e8f7f9ffd1 admin admin] Validating token access rules against request {{(pid=81630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 16:56:03.720767 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aab91b-b0a4-4486-bcf6-c34a1b7b6222 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5deb7370bc3045c5be2d391d3b1dbd82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad230723d90a439daf38443915c2282f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 16:56:03.721375 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aab91b-b0a4-4486-bcf6-c34a1b7b6222 service placement] REQUEST_METHOD: `GET` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 16:56:03.721653 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aab91b-b0a4-4486-bcf6-c34a1b7b6222 service placement] SCRIPT_NAME: `/identity` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 16:56:03.721925 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aab91b-b0a4-4486-bcf6-c34a1b7b6222 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 16:56:03.723663 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.fernet_utils [None req-29aab91b-b0a4-4486-bcf6-c34a1b7b6222 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 16:56:03.734586 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aab91b-b0a4-4486-bcf6-c34a1b7b6222 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 16:56:03.736147 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aab91b-b0a4-4486-bcf6-c34a1b7b6222 service placement] RBAC: Authorization granted {{(pid=81630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 16:56:03.746526 dv-cinder-855060-2-smb devstack@keystone.service[81630]: [pid: 81630|app: 0|req: 1460/2952] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 27 16:56:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 16:56:13.741696 dv-cinder-855060-2-smb devstack@keystone.service[81630]: DEBUG dbcounter [-] [81630] Writing DB stats keystone:SELECT=89 {{(pid=81630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}